Organizing digital notes on a user interface

Patent metadata

Field	Value
Publication number	US-10698560-B2
Application number	US-201815862464-A
Country	US
Kind code	B2
Filing date	Jan 4, 2018
Priority date	Oct 16, 2013
Publication date	Jun 30, 2020
Grant date	Jun 30, 2020

Abstract

At least some aspects of the present disclosure feature a computing device configured to display visual representations of digital notes and one or more group images representing one or more groups on a user interface, where each group may include one or more digital notes. The computing device is further configured to receive one or more user inputs via the user interface and change the compositions of the groups based on the received user inputs.

First claim

What is claimed is:

1. A method comprising:
capturing, by an image capture device included within a computing system, an image of a scene having a plurality of physical notes, each of the plurality of physical notes comprising a separately movable physical object and having recognizable content thereon, wherein the plurality of physical notes includes a first physical note and a second physical note, and wherein the first physical note includes an overlapping portion that overlaps an overlapped portion of the second physical note so as to occlude at least a portion of the recognizable content on the second physical note;
extracting, by the computing system, the recognizable content from the first physical note to create a first digital note corresponding to the first physical note;
storing, by the computing system, first note information associated with the first digital note and derived from the recognizable content from the first physical note;
extracting, by the computing system, the recognizable content from the second physical note to create a second digital note corresponding to the second physical note;
storing, by the computing system, second note information associated with the second digital note and derived from the recognizable content from the second physical note; and
presenting a hint associated with a quality of the captured image of the plurality of physical notes,
wherein the presenting step comprises presenting as the hint a visual indication regarding a distance between the image capture device and the plurality of physical notes.

2. The method of claim 1 , wherein extracting recognizable content from the first and/or second physical note is done by an image rendering module, implemented by a processor.

3. The method of claim 1 , further comprising:
receiving, by a hardware user input device, a first user input indicating a first position within a first group image;
identifying, responsive to receiving the first user input, a digital note in the first group of digital notes based on the first position; and
modifying the first group image by removing the identified digital note from the first group.

4. The method of claim 3 , wherein the hardware user input device includes a touch sensitive device.

5. The method of claim 1 , wherein a size of the first digital note is reduced or enlarged relative to a size of the first physical note.

6. The method of claim 1 , wherein the first and second digital notes are arranged in a grid format.

7. The method of claim 1 , further comprising:
recognizing, by a note identification module implemented by the processor, one or more of the plurality of physical notes; and
generating a digital note corresponding to each of the recognized physical notes, wherein each of the generated digital notes includes a respective image of the corresponding recognized physical note.

8. The method of claim 1 , wherein the overlapping portion of the first physical note and the overlapped portion of the second physical note are a same color.

9. The method of claim 1 , wherein the presenting step further comprises presenting feedback regarding the quality of the captured image of the plurality of physical notes.

10. The method of claim 1 , wherein the presenting step further comprises presenting feedback to move closer to the plurality of physical notes.

11. A method comprising:
capturing, by an image capture device included within a computing system, an image of a scene having a plurality of physical notes, each of the plurality of physical notes comprising a separately movable physical object and having recognizable content thereon, wherein the plurality of physical notes includes a first physical note and a second physical note, and wherein the first physical note includes an overlapping portion that overlaps an overlapped portion of the second physical note so as to occlude at least a portion of the recognizable content on the second physical note;
extracting, by the computing system, the recognizable content from the first physical note to create a first digital note corresponding to the first physical note;
storing, by the computing system, first note information associated with the first digital note and derived from the recognizable content from the first physical note;
extracting, by the computing system, the recognizable content from the second physical note to create a second digital note corresponding to the second physical note;
storing, by the computing system, second note information associated with the second digital note and derived from the recognizable content from the second physical note; and
presenting a hint associated with a quality of the captured image of the plurality of physical notes,
wherein the presenting step comprises presenting as the hint a desired size for display of the physical notes on a user interface.

12. A method comprising:
capturing, by an image capture device included within a computing system, an image of a scene having a plurality of physical notes, each of the plurality of physical notes comprising a separately movable physical object and having recognizable content thereon, wherein the plurality of physical notes includes a first physical note and a second physical note, and wherein the first physical note includes an overlapping portion that overlaps an overlapped portion of the second physical note so as to occlude at least a portion of the recognizable content on the second physical note;
extracting, by the computing system, the recognizable content from the first physical note to create a first digital note corresponding to the first physical note;
storing, by the computing system, first note information associated with the first digital note and derived from the recognizable content from the first physical note;
extracting, by the computing system, the recognizable content from the second physical note to create a second digital note corresponding to the second physical note;
storing, by the computing system, second note information associated with the second digital note and derived from the recognizable content from the second physical note; and
presenting a hint associated with a quality of the captured image of the plurality of physical notes,
wherein the presenting step comprises presenting as the hint one or more of the following: a visual indication regarding a lighting condition; a visual indication regarding motion of the image capture device; a grid overlaid with a visual representation of the physical notes; and

an animation.

13. The method of claim 12 , wherein the presenting step further comprises presenting feedback to use a flash.

14. The method of claim 12 , wherein the presenting step further comprises presenting feedback to hold still.

Assignees

• 3M Innovative Properties Co

Inventors

• Axelsson Pontus
• English Kyle W
• Mahli David M
• Moore Richard J
• Moran Cristin E
• Persson Roland
• Rotstein Michael
• Somasundaram Guruprasad
• Wolk Diane R
• Åkerlund Linus

Classifications

• G06V30/40

  Document-oriented image-based pattern recognition · CPC title

• H04L51/10

  Multimedia information · CPC title

• H04L51/08

  Annexed information, e.g. attachments · CPC title

• H04L12/1827

  Network arrangements for conference optimisation or adaptation · CPC title

• G06F3/0483

  Interaction with page-structured environments, e.g. book metaphor · CPC title