User interface accessibility navigation guide

Patent metadata

Field	Value
Publication number	US-2022398112-A1
Application number	US-202117303984-A
Country	US
Kind code	A1
Filing date	Jun 11, 2021
Priority date	Jun 11, 2021
Publication date	Dec 15, 2022
Grant date	—

Abstract

A method is provided. The method may include, in response to electronically receiving on a first computing device a navigation file from a secondary computing device, generating a graphical navigation guide for a user interface (UI) based on the navigation file, wherein generating the graphical navigation guide comprises generating computer operations for the first computing device corresponding to the sequence of computer operations from the navigation file. The method may further include, based on the generated computer operations, executing the graphical navigation guide on the UI associated with the first computing device, wherein executing the graphical navigation guide comprises displaying a screen and a UI element corresponding to the sequence of computer operations, and wherein displaying the UI element comprises rendering an overlay on the UI element that highlights the UI element on the displayed screen and instructs a user to perform an input action on the UI element.

First claim

1 . A computer-implemented method comprising:
in response to electronically receiving on a first computing device a navigation file from a secondary computing device, generating a graphical navigation guide for a user interface (UI) associated with the first computing device based on the navigation file, wherein the navigation file comprises a sequence of computer operations based on user actions performed on the secondary computing device, and wherein generating the graphical navigation guide comprises generating computer operations for the first computing device corresponding to the sequence of computer operations from the navigation file; and based on the generated computer operations, executing the graphical navigation guide on the UI associated with the first computing device, wherein executing the graphical navigation guide comprises displaying a screen and a UI element corresponding to the sequence of computer operations, wherein displaying the screen and the UI element further comprises displaying a sequence of different screens and at least one UI element for each screen associated with the sequence of different screens, and wherein displaying the UI element comprises rendering an overlay on the UI element that highlights the UI element on the displayed screen and instructs a user to perform an input action on the UI element.

2 . The computer-implemented method of claim 1 , further comprising:
tracking and capturing user action data based on the user actions performed on a second user interface associated with the secondary computing device, with the tracking and capturing being performed by UI hooks.

3 . The computer-implemented method of claim 2 , wherein the tracked and captured user action data is selected from a group comprising at least one of operating system (OS) data, performed computer operations data, code language data, timestamp data, screen data, screen sequence data, UI element identifiers, and metadata.

4 . The computer-implemented method of claim 2 , further comprising:
creating the navigation file, wherein creating the navigation file comprises storing the tracked and captured user action data as a set of sequential steps comprising the sequence of computer operations.

5 . The computer-implemented method of claim 1 , further comprising:
sending the navigation file to the first computing device via a messaging application; and receiving and reading the navigation file on the first computing device.

6 . The computer-implemented method of claim 1 , wherein generating the graphical navigation guide further comprises:
determining, based on the navigation file, whether a first operating system associated with the first computing device is compatible with a second operating system associated with the secondary computing device.

7 . The computer-implemented method of claim 1 , further comprising:
in response to receiving the input action on a first UI element on the first computing device, triggering navigation to a second UI element on the first computing device based on the generated computer operations and according to the sequence of computer operations performed on the secondary computing device.

8 . A computer system, comprising:
one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage devices, and program instructions stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, wherein the computer system is capable of performing a method comprising:
in response to electronically receiving on a first computing device a navigation file from a secondary computing device, generating a graphical navigation guide for a user interface (UI) associated with the first computing device based on the navigation file, wherein the navigation file comprises a sequence of computer operations based on user actions performed on the secondary computing device, and wherein generating the graphical navigation guide comprises generating computer operations for the first computing device corresponding to the sequence of computer operations from the navigation file; and
based on the generated computer operations, executing the graphical navigation guide on the UI associated with the first computing device, wherein executing the graphical navigation guide comprises displaying a screen and a UI element corresponding to the sequence of computer operations, wherein displaying the screen and the UI element further comprises displaying a sequence of different screens and at least one UI element for each screen associated with the sequence of different screens, and wherein displaying the UI element comprises rendering an overlay on the UI element that highlights the UI element on the displayed screen and instructs a user to perform an input action on the UI element.

9 . The computer system of claim 8 , further comprising:
tracking and capturing user action data based on the user actions performed on a second user interface associated with the secondary computing device, with the tracking and capturing being performed by UI hooks.

10 . The computer system of claim 9 , wherein the tracked and captured user action data is selected from a group comprising at least one of operating system (OS) data, performed computer operations data, code language data, timestamp data, screen data, screen sequence data, UI element identifiers, and metadata.

11 . The computer system of claim 9 , further comprising:
creating the navigation file, wherein creating the navigation file comprises storing the tracked and captured user action data as a set of sequential steps comprising the sequence of computer operations.

12 . The computer system of claim 8 , further comprising:
sending the navigation file to the first computing device via a messaging application; and receiving and reading the navigation file on the first computing device.

13 . The computer system of claim 8 , wherein generating the graphical navigation guide comprises further comprises:
determining, based on the navigation file, whether a first operating system associated with the first computing device is compatible with a second operating system associated with the secondary computing device.

14 . The computer system of claim 8 , further comprising:
in response to receiving the input action on a first UI element on the first computing device, triggering navigation to a second UI element on the first computing device based on the generated computer operations and according to the sequence of computer operations performed on the secondary computing device.

15 . A computer program product, comprising:
one or more tangible computer-readable storage devices and program instructions stored on at least one of the one or more tangible computer-readable storage devices, the program instructions executable by a processor, the program instructions comprising: in response to electronically receiving on a first computing device a navigation file from a secondary computing device, generating a graphical navigation guide for a user interface (UI) associated with the first computing device based on the navigation file, wherein the navigation file comprises a sequence of computer operations based on user actions performed on the secondary computing device, and wherein generating the graphical navigation guide comprises generating computer operations for the first computing device corresponding to the sequence of computer operations from the navigation file; and base

Assignees

• IBM

Inventors

• Lu Cindy Han
• Tran Thai Quoc
• Brahmaroutu Srinivas R

Classifications

• G06F9/453 Primary

  Help systems · CPC title

• G06F8/38 Primary

  for implementing user interfaces · CPC title