Creating a summary of content and stroke association

Patent metadata

Field	Value
Publication number	US-9304618-B2
Application number	US-201414194508-A
Country	US
Kind code	B2
Filing date	Feb 28, 2014
Priority date	Feb 28, 2014
Publication date	Apr 5, 2016
Grant date	Apr 5, 2016

Abstract

A method and apparatus for summarizing a session are described. In one embodiment, the system associates strokes with image data and comprises: a display surface; a memory coupled to the display surface to store stroke contexts for a plurality of strokes, wherein each stroke context represents an association between at least one stroke and a portion of image data previously displayed; a stroke capture module operable with the display surface and communicably coupled with the memory to capture one or more strokes written over image data presented on the display surface; and a summarization unit coupled to the memory to generate a summary of a session based on content displayed during the session containing one or more strokes made during the session.

First claim

We claim:

1. A system for associating strokes with image data, the system comprising:
a display surface;
a memory coupled to the display surface to store stroke contexts for a plurality of strokes, wherein each stroke context represents an association between at least one stroke and a portion of image data previously displayed;
a stroke capture module operable with the display surface and communicably coupled with the memory to capture one or more strokes written over image data presented on the display surface; and
a summarization unit coupled to the memory to generate at least one summary page of a session based on content displayed during the session containing one or more strokes made during the session, wherein the at least one summary page comprises a composition of a background image corresponding to content displayed during the session that is associated with at least one stroke made during the session, with all strokes associated with the content during the session incorporated onto the background image.

2. The system defined in claim 1 wherein the summarization unit is operable to generate the at least one summary page by:
a) accessing the memory to obtain stroke data corresponding to a first stroke that is not part of a summary page, the first stroke being associated with first image data;
b) accessing the memory to obtain stroke data corresponding to any other stroke that is associated with the first image data;
c) forming a first summary page with the first stroke and said any other stroke associated with first image data; and
d) repeating a)-c) for another stroke that is not part of a summary page.

3. The system defined in claim 2 further comprising e) repeating d) until all strokes have been included in at least one summary page.

4. The system defined in claim 1 wherein the summarization unit selects content for the summary based on user strokes.

5. The system defined in claim 1 wherein the summary is based on strokes automatically matched with content.

6. The system defined in claim 1 wherein the summary contains an output containing all strokes that occurred at least once.

7. The system defined in claim 1 wherein the summary is generated as the system is being used.

8. The system defined in claim 1 wherein the summary comprises a plurality of pages that are currently displayed in one or more windows on the display surface.

9. A method comprising:
capturing, by a display surface, one or more strokes written over content being shown on the display surface;
associating, by a processor communicably coupled with the display surface, captured stroke data corresponding to the one or more strokes with the content over which they are written to create stroke contexts, wherein each stroke context represents an association between at least one stroke and a portion of content previously displayed on a display surface;
storing, in a memory coupled with the display surface and the processor, stroke contexts for the one or more strokes; and
generating, by the processor, at least one summary page of a session based on content displayed during the session containing one or more strokes made during the session, wherein the at least one summary page comprises a composition of a background image corresponding to content displayed during the session that is associated with at least one stroke made during the session, with all strokes associated with the content during the session incorporated onto the background image.

10. The method defined in claim 9 wherein generating the at least one summary page comprises:
a) accessing the memory to obtain stroke data corresponding to a first stroke that is not part of a summary page, the first stroke being associated with first image data;
b) accessing the memory to obtain stroke data corresponding to any other stroke that is associated with the first image data;
c) forming a first summary page with the first stroke and said any other stroke associated with first image data; and
d) repeating a)-c) for another stroke that is not part of a summary page.

11. The method defined in claim 10 wherein the method further comprises e) repeating d) until all strokes have been included in at least one summary page.

12. The method defined in claim 9 further comprising selecting content for the summary based on user strokes.

13. The method defined in claim 9 wherein the summary is based on strokes automatically matched with content.

14. The method defined in claim 9 wherein the summary contains an output containing all strokes that occurred at least once.

15. The method defined in claim 9 wherein the summary comprises a plurality of pages that are currently displayed in one or more windows on the display surface.

16. A non-transitory computer readable media storing instructions thereon which, when executed by a system, cause the system to perform a method comprising:
capturing one or more strokes written over content being shown on the display surface;
associating captured stroke data corresponding to the one or more strokes with the content over which they are written to create stroke contexts, wherein each stroke context represents an association between at least one stroke and a portion of content previously displayed on a display surface;
storing stroke contexts for the one or more strokes in a memory; and
generating at least one summary page of a session based on content displayed during the session containing one or more strokes made during the session, wherein the at least one summary page comprises a composition of a background image corresponding to content displayed during the session that is associated with at least one stroke made during the session, with all strokes associated with the content during the session incorporated onto the background image.

17. The non-transitory computer readable media defined in claim 16 wherein generating the at least one summary page comprises:
a) accessing the memory to obtain stroke data corresponding to a first stroke that is not part of a summary page, the first stroke being associated with first image data;
b) accessing the memory to obtain stroke data corresponding to any other stroke that is associated with the first image data;
c) forming a first summary page with the first stroke and said any other stroke associated with first image data; and
d) repeating a)-c) for another stroke that is not part of a summary page.

18. The non-transitory computer readable media defined in claim 17 wherein the method further comprises e) repeating d) until all strokes have been included in at least one summary page.

19. The non-transitory computer readable media defined in claim 16 wherein the summary contains an output containing all strokes that occurred at least once.

20. The non-transitory computer readable media defined in claim 16 wherein the summary comprises a plurality of pages that are currently displayed in one or more windows on the display surface.

Assignees

• Barrus John
• Gormish Michael
• Ricoh Co Ltd

Inventors

• Barrus John
• Gormish Michael

Classifications

• G06V30/36 Primary

  Matching; Classification · CPC title

• G06F3/041 Primary

  Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means · CPC title

• G06F40/171

  by use of digital ink · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06V30/416

  Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors · CPC title