Method and system for accessing table content in a digital image of the table

Patent metadata

Field	Value
Publication number	US-11966758-B2
Application number	US-202117338889-A
Country	US
Kind code	B2
Filing date	Jun 4, 2021
Priority date	Jan 26, 2017
Publication date	Apr 23, 2024
Grant date	Apr 23, 2024

Abstract

A system and method for accessing elements of a table in a digital image of the table, including: obtaining the digital image of the table; finding table elements in the digital image based on digital table properties, wherein the table elements define table cells; calculating coordinates of the table cells in the digital image based on the table elements; and accessing content of a selected table cell in the digital image using the coordinates of the selected table element.

First claim

The invention claimed is:

1. A method for enabling graphic-based interoperability with a computer executed application, the method comprising, on a computer system operating as a client and displaying a graphical user interface (GUI) generated by a third-party application, the GUI comprising control graphic items:
examining, using a computer processor executing a software program, changes in a captured screen image of the GUI, and based on the examination correspondingly taking an action, the action selected from:
updating properties of an object construct corresponding to the captured screen image; and
raising a software event corresponding to an object construct corresponding to a control graphic item.

2. The method as in claim 1 , wherein the event communicates information to the third-party application.

3. The method as in claim 1 , wherein the properties are object-oriented properties.

4. The method as in claim 1 , wherein the event comprises a function which sends a message to a listener or an event handler.

5. The method as in claim 1 , comprising examining the captured screen image upon an occurrence of the end of a time period, a detection of keyboard input, a detection of mouse input, or an indication that the GUI has changed.

6. The method as in claim 1 , wherein the control graphic item comprises one of a button, a link, a list box, a check box, a table, a drop-list, a combination box, a tab, and a slider.

7. The method as in claim 1 , comprising examining the captured screen image of the GUI to identify within the GUI a control graphic item.

8. The method of claim 1 , wherein the third-party application comprises server software modules executed on a computer remote from the computer system.

9. The method of claim 1 , wherein raising an event comprises determining that a state of the control graphic item has changed and notifying a process of the change.

10. A system for enabling graphic-based interoperability with a computer executed application, the system comprising:
a computer system operating as a client comprising a memory and a processor, the processor configured to:
display a graphical user interface (GUI) generated by a third-party application;
examine, by executing a software program, a captured screen image of the GUI to determine if there has been a change in the GUI, and based on the examination correspondingly take an action, the action selected from:
updating properties of an object construct corresponding to the captured screen image; and
raising a software event corresponding to an object construct corresponding to the captured screen image.

11. The system as in claim 10 , wherein the event communicates information to the third-party application.

12. The system as in claim 10 , wherein the properties are object-oriented properties.

13. The system as in claim 10 , wherein the event comprises a function which sends a message to a listener or an event handler.

14. The system as in claim 10 , the processor configured to execute the computer executed application and a second program on the computer system, the second program to perform the examining.

15. The system of claim 10 , wherein raising an event comprises determining that a state of the captured screen image has changed and notifying a process of the change.

16. A method for communication between a first executing software program and a second executing software program, the method comprising, using one or more computer processors:
the first executing software program executed by at least one of the one or more computer processors and obtaining a captured screen image generated by a third-party application executed by at least one of the one or more computer processors and displayed by the second executing software program;
the first executing software program determining if there has been a change in the obtained captured screen image; and
if there has been a change then performing one of:
notifying via a software message the third-party application of the change;
updating properties of an object construct corresponding to an item in image; and
raising a software event corresponding to an object corresponding to an item in the image.

17. The method as in claim 16 , comprising determining if there has been a change upon an occurrence of the end of a time period, a detection of keyboard input, a detection of mouse input, or an indication that the GUI has changed.

18. The method as in claim 16 , comprising simulating a functionality of a graphical control in the captured screen image based on the type of the graphical control.

19. The method as in claim 16 , comprising examining the obtained graphical image to identify within the obtained captured screen image a graphical control.

20. The method of claim 16 , comprising executing the first executing software program and the second executing software program on the same computer.

Assignees

• Nice Ltd

Inventors

• Vaindiner Alexander
• Shelest Vitaly
• Kleinerman Semyon

Classifications

• G06F9/451 Primary

  Execution arrangements for user interfaces · CPC title

• G06F8/10

  Requirements analysis; Specification techniques · CPC title

• G06F8/38

  for implementing user interfaces · CPC title

• G06T5/003

  Physics · mapped topic

• G06T5/20

  using local operators · CPC title