System and Method for Determining Distances Among User Interface Elements

Patent metadata

Field	Value
Publication number	US-2016239162-A1
Application number	US-201514623048-A
Country	US
Kind code	A1
Filing date	Feb 16, 2015
Priority date	Feb 16, 2015
Publication date	Aug 18, 2016
Grant date	—

Abstract

Disclosed is a system for determining distance between two or more user UI elements present on a GUI. A UI element extraction module extracts a plurality of UI elements from the GUI. A margin determination module derives a left margin of the GUI based on a position of a first UI element of the plurality of elements. A logical block creation module creates a plurality of logical blocks comprising the plurality of UI elements. A logical block, of the plurality of logical blocks, is created based upon a UI element lying on the left margin. A neighboring UI element identification module identifies one or more neighboring UI elements of at least one UI element present in the same or adjacent logical block. A distance computation module computes distance between the at least one UI element and each neighboring UI element. A distance displaying module creates a reference UI element for displaying the distance.

First claim

We claim:

1 . A method for determining distance between two or more user interface (UI) elements present on a Graphical User Interface (GUI), the method comprising:
extracting, by a processor, a plurality of UI elements from a Graphical User Interface (GUI); deriving, by the processor, a left margin of the GUI based on a position of a first UI element, of the plurality of elements, on the GUI; creating, by the processor, a plurality of logical blocks comprising the plurality of UI elements, wherein a logical block, of the plurality of logical blocks, is created based upon a UI element lying on the left margin, and wherein the logical block comprises a subset of the plurality of UI elements, and wherein the subset includes the UI element; identifying, by the processor, one or more neighboring UI elements of at least one UI element present in the logical block; computing, by the processor, distance between the at least one UI element and each neighboring UI element; and creating, by the processor, a reference UI element between the at least one UI element and each neighboring UI element, wherein the reference UI element is created to display the distance.

2 . The method of claim 1 , wherein the plurality of UI elements comprises a heading, an image, a video, a text, a label, and a text box.

3 . The method of claim 1 further comprising filtering one or more UI elements from the plurality of UI elements based on one or more parameters comprising dimension, visibility associated to each UI control.

4 . The method of claim 1 , wherein the one or more neighboring UI elements are identified in at least one location comprising a top, a bottom, a right, and a left.

5 . The method of claim 1 , wherein the reference UI element is an edge created between the at least one UI element and each neighboring UI element.

6 . A system for determining distance between two or more user interface (UI) elements present on a Graphical User Interface (GUI), the system comprising:
a processor; and a memory coupled to the processor, wherein the processor is capable of executing a plurality of modules stored in the memory, and wherein the plurality of module comprising:
a UI element extraction module for extracting a plurality of UI elements from a Graphical User Interface (GUI);
a margin determination module for deriving a left margin of the GUI based on a position of a first UI element, of the plurality of elements, on the GUI;
a logical block creation module for creating a plurality of logical blocks comprising the plurality of UI elements, wherein a logical block, of the plurality of logical blocks, is created based upon a UI element lying on the left margin, and wherein the logical block comprises a subset of the plurality of UI elements, and wherein the subset includes the UI element;
a neighboring UI element identification module for identifying one or more neighboring UI elements of at least one UI element present in the logical block;
a distance computation module for computing distance between the at least one UI element and each neighboring UI element; and
a distance displaying module for creating a reference UI element between the at least one UI element and each neighboring UI element, wherein the reference UI element is created to display the distance.

7 . The system of claim 6 further comprising a filtration module for filtering one or more UI elements from the plurality of UI elements, wherein the one or more UI elements are filtered based on one or more parameters comprising dimension, visibility associated to each UI control.

8 . The system of claim 6 , wherein the reference UI element is an edge created between the at least one UI element and each neighboring UI element, and wherein the distance displaying module displays the distance on the edge.

9 . A non-transitory computer readable medium embodying a program executable in a computing device for determining distance between two or more user interface (UI) elements present on a Graphical User Interface (GUI), the program comprising a program code comprising:
a program code for extracting a plurality of UI elements from a Graphical User Interface (GUI); a program code for deriving a left margin of the GUI based on a position of a first UI element, of the plurality of elements, on the GUI; a program code for creating a plurality of logical blocks comprising the plurality of UI elements, wherein a logical block, of the plurality of logical blocks, is created based upon a UI element lying on the left margin, and wherein the logical block comprises a subset of the plurality of UI elements, and wherein the subset includes the UI element; a program code for identifying one or more neighboring UI elements of at least one UI element present in the logical block; a program code for computing distance between the at least one UI element and each neighboring UI element; and a program code for creating a reference UI element between the at least one UI element and each neighboring UI element, wherein the reference UI element is created to display the distance.

Assignees

• Hcl Technologies Ltd

Inventors

• Sivasubramanian Geetha Natarajan
• Venkata Krishna Rao Vatturi Veera
• Gajjalakonda Lakshmi Narayana

Classifications

• G06F8/38 Primary

  for implementing user interfaces · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G06F3/0482 Primary

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F11/3604

  Analysis of software for verifying properties of programs (testing of software G06F11/3668) · CPC title