Adding, deleting digital notes from a group of digital notes

Patent metadata

Field	Value
Publication number	US-9310983-B2
Application number	US-201414514568-A
Country	US
Kind code	B2
Filing date	Oct 15, 2014
Priority date	Oct 16, 2013
Publication date	Apr 12, 2016
Grant date	Apr 12, 2016

Abstract

In general, the disclosure describes techniques for creating and manipulating software notes representative of physical notes. A computing device includes a processor, an image collection module configured to receive an input image of an environment having a plurality of physical notes, an image processing engine configured to identify the plurality of physical notes in the input image and generate a plurality of digital notes corresponding to the plurality of notes identified in the input image, wherein the plurality of digital notes include information represented by the plurality of notes in the input image, and a graphical user interface configured to display the input image overlaid with the plurality of digital notes in place of the identified plurality of notes on a first portion of the graphical user interface and to display a set of one or more of the digital notes on a second portion of the graphical user interface.

First claim

The invention claimed is:

1. A method comprising:
receiving, by a computing device, an input image of an environment having a plurality of physical notes, each of the physical notes comprising a separate physical object having a predefined boundary and recognizable content thereon;
processing, by the computing device, the input image to identify each of the plurality of physical notes in the input image;
responsive to identifying each of the plurality of physical notes, and by the computing device:
processing the input image to extract content from a note segment associated with a respective one of the plurality of physical notes in the input image; and
processing the input image to determine one or more attributes of the respective one of the plurality of physical notes in the input image;

generating, by the computing device and within a database, a plurality of records representing a plurality of digital notes corresponding to the plurality of physical notes identified in the input image, wherein each of the records stores the respective one or more attributes associated with the corresponding one of the plurality of the physical notes and includes the respective extracted content from the note segment associated with the corresponding physical note;
displaying, on a graphical user interface of the computing device, the input image overlaid with the plurality of digital notes in place of the identified plurality of physical notes;
receiving, by the computing device, a user input selecting a subset of the digital notes overlaid on the physical notes of the input image to form a group of the digital notes representative of a collaboration session;
displaying, by the computing device and separate from the digital notes displayed as overlaid on the physical notes of the input image, the selected subset of the plurality of digital notes, wherein each of the digital notes in the group of digital notes corresponds to a respective one of the plurality of digital notes overlaid on the plurality of physical notes of the input image; and
responsive to input from the graphical user interface, updating the respective records of the database corresponding to the selected subset of the plurality of digital notes to store metadata assigning the subset of the digital notes to the group of digital notes.

2. The method of claim 1 , further comprising:
receiving, by the computing device, a user input selecting for deletion at least one of the plurality of digital notes overlaid on the physical notes of the input image; and
removing, by the computing device and from the group of digital notes, digital notes that correspond to the digital notes selected for deletion.

3. The method of claim 1 , wherein the plurality of digital notes includes more digital notes than the subset of the digital notes, the method further comprising:
receiving, by the computing device, a user input selecting at least one digital note from the plurality of the digital notes overlaid on the physical notes of the input image that is not displayed in the group of digital notes;
updating the database to add, by the computing device, the at least one selected digital note to the group of digital notes; and
separately displaying the at least one selected digital note separate from the digital notes displayed overlaid on the physical notes of the input image.

4. The method of claim 1 , wherein the group of digital notes is organized according to a group hierarchy defined by the user input.

5. A computer system comprising:
one or more non-transitory computer-readable media having instructions stored thereon; and
one or more processors comprising integrated or discrete logic circuitry, wherein the instructions, when executed by the one or more processors, configure the computer system to:
receive, by a computing device of the computer system, an input image of an environment having a plurality of physical notes, each of the physical notes comprising a separate physical object having a predefined boundary and recognizable content thereon;
process the input image with the computing device to identify each of the plurality of physical notes in the input image;
responsive to identifying each of the plurality of physical notes:
process the input image to extract content from a note segment associated with a respective one of the plurality of physical notes in the input image; and
process the input image to determine one or more attributes of the respective one of the plurality of physical notes in the input image;

generate, by the computing device and within a database, a plurality of records representing a plurality of digital notes corresponding to the plurality of physical notes identified in the input image, wherein each of the records stores the respective one or more attributes associated with the corresponding one of the plurality of the physical notes and includes the respective extracted content from the note segment associated with the corresponding physical note;
display, on a graphical user interface of the computing device, the input image overlaid with the plurality of digital notes in place of the identified plurality of physical notes;
receive, by the computing device, a user input selecting a subset of the digital notes overlaid on the physical notes of the input image to form a group of the digital notes representative of a collaboration session;
display, by the computing device and separate from the digital notes displayed as overlaid on the physical notes of the input image, the selected subset of the plurality of digital notes, wherein each of the digital notes in the group of digital notes corresponds to a respective one of the plurality of digital notes overlaid on the plurality of physical notes of the input image; and
responsive to input from the graphical user interface, update the respective records of the database corresponding to the selected subset of the plurality of digital notes to store metadata assigning the subset of the digital notes to the group of digital notes.

6. A non-transitory computer-readable medium comprising instructions that cause a programmable processor of a computing device to:
receive an input image of an environment having a plurality of physical notes, each of the physical notes comprising a separate physical object having a predefined boundary and recognizable content thereon;
process the input image to identify each of the plurality of physical notes in the input image;
responsive to identifying each of the plurality of physical notes:
process the input image to extract content from a note segment associated with a respective one of the plurality of physical notes in the input image; and
process the input image to determine one or more attributes of the respective one of the plurality of physical notes in the input image;

generate, within a database, a plurality of records representing a plurality of digital notes corresponding to the plurality of physical notes identified in the input image, wherein each of the records stores the respective one or more attributes associated with the corresponding one of the plurality of the physical notes and includes the respective extracted content from the note segment associated with the corresponding physical note;
display, on a graphical user interface of the computing device, the input image overlaid with the plurality of digital notes in place of the identified plurality of physical notes;
receive a user input selecting a subset of the digital notes overlaid on the physical notes of the input image to form a group of the digital notes representative of a collaboration session;
display, by the computing device and separate from the digital notes displayed as overlaid on the physical notes of the input image, the sele

Assignees

• 3M Innovative Properties Co

Inventors

• Somasundaram Guruprasad
• Moran Cristin E
• Mahli David M
• Wolk Diane R
• Moore Richard J
• Axelsson Pontus
• Rotstein Michael
• Persson Roland

Classifications

• G06F3/04842 Primary

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06K9/46

  Physics · mapped topic

• H04L51/08

  Annexed information, e.g. attachments · CPC title

• H04L12/1822

  Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission · CPC title

• H04L12/1827

  Network arrangements for conference optimisation or adaptation · CPC title