Note recognition and association based on grouping indicators

Patent metadata

Field	Value
Publication number	US-9600718-B2
Application number	US-201514685174-A
Country	US
Kind code	B2
Filing date	Apr 13, 2015
Priority date	Oct 16, 2013
Publication date	Mar 21, 2017
Grant date	Mar 21, 2017

Abstract

Techniques are described for creating and manipulating software notes representative of physical notes. A computing device is described that includes a processor and an image collection module executable on the processor and configured to receive an input image of an environment having a plurality of physical notes. An image processing engine executable on the processor is configured to identify the plurality of physical notes in the input image and generate, for each of the physical notes, a corresponding digital note. The image processing engine is further configured to identify an indication of one or more groups of the plurality of identified notes in the input image and group the plurality of digital notes according to the indication.

First claim

The invention claimed is:

1. A method comprising:
receiving, by a computing device, an input image of an environment having a plurality of physical notes;
processing the input image with the computing device to identify the plurality of physical notes in the input image;
generating, by the computing device, a plurality of digital notes corresponding to the plurality of notes identified in the input image, wherein the plurality of digital notes include information represented by the plurality of notes in the input image;
identifying, by the computing device, an indication of one or more groups of the plurality of physical notes based on at least one line in the environment; and
grouping, by the computing device, the plurality of digital notes according to the indication of the one or more groups.

2. The method of claim 1 , wherein the at least one line comprises a physically drawn line.

3. The method of claim 1 , wherein the at least one line comprises a tape disposed in the environment.

4. The method of claim 1 , further comprising:
displaying, by the computing device, the one or more groups of the plurality of digital notes.

5. A method, comprising:
receiving, by a computing device, an input image of an environment having a plurality of physical notes;
processing the input image with the computing device to identify the plurality of physical notes in the input image;
generating, by the computing device, a plurality of digital notes corresponding to the plurality of notes identified in the input image, wherein the plurality of digital notes include information represented by the plurality of notes in the input image;
selecting, by the computing device, one or more of the plurality of digital notes based on at least one line in the environment; and
grouping, by the computing device, the one or more selected digital notes into a group.

6. The method of claim 5 , further comprising:
displaying, by the computing device, the one or more groups of the plurality of digital notes.

7. The method of claim 5 , wherein the at least one line comprises a physically drawn line.

8. The device method of claim 5 , wherein the at least one line comprises a tape disposed in the environment.

9. A non-transitory computer-readable medium comprising instructions that cause a programmable processor to:
receive, by a computing device, an input image of an environment having a plurality of physical notes;
process the input image with the computing device to identify the plurality of physical notes in the input image;
generate, by the computing device, a plurality of digital notes corresponding to the plurality of physical notes identified in the input image, wherein the plurality of digital notes include information represented by the plurality of physical notes in the input image;
identify, by the computing device, an indication of one or more groups of the plurality of physical notes identified in the input image based on at least one line in the environment; and
group, by the computing device, the plurality of digital notes according to the indication of the one or more groups.

10. The non-transitory computer-readable medium of claim 9 , wherein the at least one line comprises a physically drawn line.

11. The non-transitory computer-readable medium of claim 9 , wherein the at least one line comprises a tape disposed in the environment.

12. A computing device comprising:
a processor;
an image collection module executable on the processor and configured to receive an input image of an environment having a plurality of physical notes; and
an image processing engine executable on the processor and configured to identify the plurality of physical notes in the input image and generate, for each of the physical notes, a corresponding digital note,
wherein the image processing engine is configured to identify an indication of one or more groups of the plurality of identified notes in the input image based on at least one line in the environment and group the plurality of digital notes according to the indication.

13. The device of claim 12 , wherein the image processing engine is configured to display the input image including the plurality of grouped digital notes in place of the identified plurality of notes on a graphical user interface.

14. The device of claim 12 , wherein the image collection module includes an image capture device configured to capture the input image.

15. The device of claim 12 , wherein the image collection module includes a communication interface configured to receive the input image.

16. The device of claim 12 , wherein the at least one line comprises a physically drawn line.

17. The device of claim 12 , wherein the at least one line comprises a tape disposed in the environment.

Assignees

• 3M Innovative Properties Co

Inventors

• Wolk Diane R
• Mahli David M
• Moran Cristin E
• Somasundaram Guruprasad
• Bastiaens Willem V
• Moore Richard J
• Axelsson Pontus
• Rotstein Michael
• Persson Roland
• Åkerlund Linus
• Nakayama Tasuku

Classifications

• G06V20/62 Primary

  Text, e.g. of license plates, overlay texts or captions on TV images · CPC title

• G06V30/36

  Matching; Classification · CPC title

• G06F18/23

  Clustering techniques · CPC title

• G06K9/00456

  Physics · mapped topic

• G06T2207/30176

  Document · CPC title