Enhanced copy and paste between applications

Patent metadata

Field	Value
Publication number	US-8949729-B2
Application number	US-201213495755-A
Country	US
Kind code	B2
Filing date	Jun 13, 2012
Priority date	Jun 13, 2012
Publication date	Feb 3, 2015
Grant date	Feb 3, 2015

Abstract

Enhanced copying and pasting between applications includes capturing information about open applications including a screenshot of each of the open applications shown in a viewable area of the open applications; in response to receiving a copy command while the user is interacting with a first application, presenting the screenshots of the other open applications to the user for selection; in response to the user selecting one of the screenshots corresponding to a second application, displaying visual content segments from the second application; in response to receiving a user selection of two or more of the visual content segments, copying the selected visual content segments; and inserting the selected visual content segments into the first application such that original spatial relations between the visual content segments from the second application are maintained when the visual content segments are inserted into the first application.

First claim

We claim:

1. A computer-implemented method for enhanced copying and pasting between applications, the method performed by program instructions executed on a computer having at least one processor, the method comprising:
capturing information about open applications including a screenshot of each of the open applications shown in a viewable area of the open applications;
in response to receiving a copy command while the user is interacting with a first application, presenting the screenshots of the other open applications to the user for selection;
in response to the user selecting one of the screenshots corresponding to a second application, displaying visual content segments from the selected screenshot;
in response to receiving a user selection of two or more of the visual content segments, copying the selected visual content segments; and
inserting the selected visual content segments into the first application such that original spatial relations between the visual content segments from the second application are maintained when the visual content segments are inserted into the first application.

2. The method of claim 1 wherein capturing information about open applications further includes querying an operating system to capture visual context data including a list of titles and the screenshot of the open applications that record visible items displayed on the display screen.

3. The method of claim 2 further comprising capturing the visual context data upon at least one of a context change in each application and on-demand of the user.

4. The method of claim 1 wherein presenting the screenshots of the other open applications to the user for selection further comprises displaying the visual context data in one or more user interface elements for user selection and copying of the visual context data.

5. The method of claim 4 further comprising placing most recently accessed applications in front of the user interface element to present most likely candidates for copying.

6. The method of claim 5 wherein the user interface element is implemented as an electronic flipbook having at least one page showing the visual context data of the open applications.

7. The method of claim 6 wherein the flipbook includes a series of pages that the user may cause to turn, and wherein the title and screenshot for each application is shown on a separate page of the flipbook.

8. The method of claim 1 wherein displaying visual content segments further comprises capturing the visual context including borders of elements comprising visual content from the applications by searching for a template that best defines a layout of the application.

9. The method of claim 8 wherein displaying visual content segments further comprises determining edge boundaries in the screenshot if a matching template cannot be found.

10. The method of claim 1 wherein copying the selected visual content segments further comprises further breaking down the content segments in response to a user input to generate sub-segments.

11. An executable software product stored on a computer-readable medium containing program instructions for enhanced copying and pasting between applications, the program instructions for:
capturing information about open applications including a screenshot of each of the open applications shown in a viewable area of the open applications;
in response to receiving a copy command while the user is interacting with a first application, presenting the screenshots of the other open applications to the user for selection;
in response to the user selecting one of the screenshots corresponding to a second application, displaying visual content segments from the selected screenshot;
in response to receiving a user selection of two or more of the visual content segments, copying the selected visual content segments; and
inserting the selected visual content segments into the first application such that original spatial relations between the visual content segments from the second application are maintained when the visual content segments are inserted into the first application.

12. The executable software product of claim 11 wherein the program instructions for capturing information about open applications further comprises program instructions for querying an operating system to capture visual context data including a list of titles and the screenshot of the open applications that record visible items displayed on the display screen.

13. The executable software product of claim 11 further comprising program instructions for capturing the visual context data upon at least one of a context change in each application and on-demand of the user.

14. The executable software product of claim 11 wherein the program instructions for presenting the screenshots of the other open applications to the user for selection further comprises program instructions for displaying the visual context data in one or more user interface elements for user selection and copying of the visual context data.

15. The executable software product of claim 14 further comprises program instructions for placing most recently accessed applications in a front of the user interface element to present most likely candidates for copying.

16. The executable software product of claim 15 wherein the user interface element is implemented as an electronic flipbook having at least one page showing the visual context data of the open applications.

17. The executable software product of claim 16 wherein the flipbook includes a series of pages that the user may cause to turn, and wherein the title and screenshot for each application is shown on a separate page of the flipbook.

18. The executable software product of claim 11 wherein the program instructions for displaying visual content segments further comprises capturing the visual context including borders of elements comprising visual content from the applications by searching for a template that best defines a layout of the application.

19. The executable software product of claim 18 wherein the program instructions for displaying visual content segments further comprises determining edge boundaries in the screenshot if a matching template cannot be found.

20. The executable software product of claim 11 wherein the program instructions for copying the selected visual content segments further comprises further breaking down the content segments in response to a user input to generate sub-segments.

21. A system comprising:
a computer comprising a memory, processor and a display screen;
at least two open applications executing on the computer, each of the applications displaying respective visual content on the display screen;
an enhanced capture and insert (ECI) module executing on the computer, the ECI module configured to:
capture information about the open applications including a screenshot of each of the open applications shown in a viewable area of the open applications;
in response to receiving a copy command while the user is interacting with a first application, present the screenshots of the other open applications to the user for selection;
in response to the user selecting one of the screenshots corresponding to a second application, display visual content segments from the selected screenshot;
in response to receiving a user selection of two or more of the visual content segments, copy the selected visual content segments; and
insert the selected visual content segments into the first a

Assignees

• Bastide Paul R
• Leblanc Jr Ralph E
• Lu Fang
• Mahmoud Alaa Abou
• IBM

Inventors

• Bastide Paul R
• Leblanc Jr Ralph E
• Lu Fang
• Mahmoud Alaa Abou

Classifications

• G06F9/451

  Execution arrangements for user interfaces · CPC title

• G06F40/166 Primary

  Editing, e.g. inserting or deleting · CPC title

• G06F3/0484 Primary

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G06F40/169

  Annotation, e.g. comment data or footnotes · CPC title

• G06F17/24 Primary

  Physics · mapped topic