System and processes to capture, edit, and publish problem solving techniques

Patent metadata

Field	Value
Publication number	US-9965131-B1
Application number	US-201314032015-A
Country	US
Kind code	B1
Filing date	Sep 19, 2013
Priority date	Sep 19, 2013
Publication date	May 8, 2018
Grant date	May 8, 2018

Abstract

This disclosure is directed to systems and processes of capturing a user's actions, computing actions, and/or other data, and then publishing relevant portions of the user's actions, computing actions, and/or other data to other users in a user community. The systems and processes provide techniques to minimize time and effort to create publications for the user community, while allowing the user to select relevant content and possibly annotate the content. Publication may be directed to other users that are likely to perform a similar computing action and/or to shared repositories.

First claim

What is claimed is:

1. A computer-implemented method comprising:
under control of one or more computing devices configured with executable instructions,
detecting a trigger associated with an event, the detecting to initiate a collection of data associated with a computing activity;
collecting, from a computing device associated with a user, data associated with the computing activity that is performed in part based on inputs from a user and in response to the event, wherein collecting the data includes capturing one or more of screen renderings from a display associated with the computing device and audio data from an input device associated with the computing device;
storing the data as collected data;
segmenting the collected data into data segments;
analyzing, by a processor, performance of the computing activity in the data segments with respect to a standard operating procedure for resolving a computing related task, wherein the analyzing includes performing one or more of image recognition on one or more of the screen renderings and speech recognition on at least a portion of the audio data;
generating, by the processor based at least in part on the analyzing, one or more tags that describes the data segments, wherein at least one of the one or more tags is based, at least in part, on one or more of the image recognition and the audio data;
associating the one or more tags with the data segments;
receiving, from the user, a selection of one or more of the data segments; and
publishing the selection of one or more of the data segments.

2. The method as recited in claim 1 , wherein the data comprises one or more of operating environment data, user input data, user interface graphical data, audio data, or system response data.

3. The method as recited in claim 1 , further comprising detecting another trigger, received before the publishing, the detection to terminate the collecting.

4. The method as recited in claim 1 , wherein segmenting is based at least in part on one of detecting a change in a focus of a window in a user interface (UI) or detecting a change in a different portion of the UI.

5. The method as recited in claim 1 , further comprising storing the selection of one or more of the data segments and the one or more tags associated with the data segments; and wherein the publishing the selection of one or more of the data segments is performed in part by selecting a location or event for publication based in part on the one or more tags.

6. The method as recited in claim 1 , wherein the associating the one or more tags with the data segments includes systematically determining information associated with the data segments.

7. The method as recited in claim 1 , further comprising receiving from the user an annotation to the selection of one or more of the data segments.

8. The method as recited in claim 7 , wherein the selection of one or more of the data segments are maintained after the publishing to allow further selection and annotation by the user or other users after the publishing.

9. The method as recited in claim 7 , wherein the annotation comprises one or more of: inserting a slide, text, audio commentary, highlight or shape to the selection of one or more of the data segments.

10. The method as recited in claim 7 , wherein the annotation comprises information regarding how the collected data diverges or adheres to a standard operating procedure (SOP) for handling the event.

11. The method as recited in claim 1 , wherein the publishing further includes:
causing the selection of one or more of the data segments to be presented to a user community; and
receiving from the user community, one or more of comments, ratings, and tags for association with the data segments.

12. The method as recited in claim 1 , further comprising presenting the data segments to perform at least operations of view, select, annotate, and edit.

13. A system, comprising:
at least one computing device configured to implement one or more services, wherein the one or more services are configured to:
detect a first indication of an event that triggers data collection;
collect data from a computing device associated with a user to form collected data, wherein collecting the data includes capturing one or more of screen renderings from a display of the computing device associated with the user or audio data from an input device associated with the computing device associated with the user;
segment the collected data into data segments;
analyze the collected data in at least one of the data segments, wherein the analyzing includes to perform one or more of image recognition on one or more of the screen renderings or speech recognition on at least a portion of the audio data;
generate one or more tags that describe the at least one of the data segments, wherein at least one of the one or more tags is based, at least in part, on one or more of the image recognition and the audio data;
associate the one or more tags with the data segments;
receive a selection of the data segments; and
publish the selection of the data segments.

14. The system as recited in claim 13 , wherein the segment the collected data is based at least in part on one of detecting a change in a focus of a window in a user interface (UI) or detecting a change in a different portion of the UI.

15. The system as recited in claim 13 , wherein the one or more services are further configured to:
receive an annotation to the selection of the data segments; and wherein the selection of the data segments is maintained after the publish to allow further selection and annotation after the publish.

16. The system as recited in claim 13 , wherein the one or more services are further configured to:
cause the selection of the data segments to be presented to a user community; and
receive from the user community, one or more of comments, ratings, and tags for association with the selection of the data segments.

17. The system as recited in claim 13 , wherein the data comprises one or more of user interface graphical data, user input data, or audio data.

18. One or more computer-readable media storing computer-executable instructions that, when executed on one or more processors, performs acts comprising:
collecting data associated with a computing activity to form collected data wherein collecting the data includes capturing one or more of screen renderings from a display associated with a computing device of a user and audio data from an input device associated with the computing device;
segmenting the collected data into data segments;
analyzing the collected data in at least one of the data segments, wherein the analyzing includes performing one or more of image recognition on one or more of the screen renderings and speech recognition on at least a portion of the audio data;
generating one or more tags that describe the at least one of the data segments;
associating the one or more tags with the data segments, wherein at least one of the one or more tags is based, at least in part, on one or more of the image recognition and the audio data;
receiving a selection of the data segments; and
publishing the selection of the data segments.

19. The one or more computer-readable media as recited in claim 18 , wherein the acts further include:
receiving annotation to selection of the data segments, the annotation comprises one or more of inserting a slide, text, audio commentary, highlight or shape to the selection of the data segments.

20.

Assignees

• Amazon Tech Inc

Inventors

• Mcinerny Michael James

Classifications

• G06Q10/40

  Business processes related to social networking or social networking services · CPC title

• G06Q10/10

  Office automation; Time management · CPC title

• G06F11/3495

  for systems · CPC title

• G06F3/01

  Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) · CPC title

• G06F3/038

  Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry · CPC title