Testing computer program accessibility for users with disabilities, such as for use with mobile phones

Patent metadata

Field	Value
Publication number	US-11860767-B2
Application number	US-202218074377-A
Country	US
Kind code	B2
Filing date	Dec 2, 2022
Priority date	Nov 4, 2021
Publication date	Jan 2, 2024
Grant date	Jan 2, 2024

Abstract

Disclosed here is a system to enable interaction between a user with a disability and a computer program. The system can obtain a representation of a user interface to present to a user. The system can determine an element associated with the user interface, where the element is configured to provide information to the user, however, the user interface presentation of the element at least partially fails to provide the information to the user. Based on the element, the system can determine an appropriate test to perform. The appropriate test indicates at least two of: a test to perform with a keyboard, a gesture test to perform with a mobile screen reader, and an audio test to perform with a screen reader. The system can generate an indication of the appropriate test. The system can provide the indication of the appropriate test prior to releasing the user interface to the user.

First claim

I claim:

1. A non-transitory computer-readable medium, storing instructions, which when executed by a data processor, performs operations, comprising:
obtaining a user selection for identifying an element associated with a user interface to be tested,
wherein a user interface presentation of the element at least partially fails to provide information represented by the element to a user with a disability using the user interface;

generating an indication user interface of a test to perform of the user interface presentation of the element by:
indicating an audio test as the test comprising an audio and a function to be performed by the audio,
wherein the audio test includes a group, and a state,
wherein the group indicates to check whether selecting a visible label associated with the element selects the element, and
wherein the state indicates to check whether the audio correctly describes a selection state associated with the element including selected and unselected; and

performing the test on the user interface; and
upon determining that the user interface passed the test, indicating by the indication user interface that the user interface is ready for release.

2. The computer-readable medium of claim 1 , wherein the instructions include:
determining a type of program associated with the user interface;
based on the type of program, determining multiple categories associated with the user interface;
categorizing the element associated with the user interface into a category among the multiple categories; and
enabling a selection of the test by presenting the multiple categories, the element, and the category associated with the element.

3. The computer-readable medium of claim 1 , wherein the user interface is associated with a web page, and wherein the instructions include:
determining multiple categories associated with the user interface including at least four of: HTML, header, navigation, main, form, and footer;
categorizing the element associated with the user interface into a category among the multiple categories; and
enabling a selection of the test by presenting the multiple categories, the element, and the category associated with the element.

4. The computer-readable medium of claim 1 , wherein the user interface is associated with an application, and wherein the instructions include:
determining multiple categories associated with the user interface including controls and notifications;
categorizing the element associated with the user interface into a category among the multiple categories; and
enabling a selection of the test by presenting the multiple categories, the element, and the category associated with the element.

5. The computer-readable medium of claim 1 , wherein the user interface includes at least two of a graphical user interface, an audio user interface, or a haptic user interface.

6. The computer-readable medium of claim 1 , wherein the instructions include:
obtaining a program associated with the user interface and the test,
executing the program associated with the user interface and the audio test;
performing natural language processing on the audio test to determine whether the audio test corresponds to an output indicated in the test; and
upon determining that the audio test does not correspond to the output indicating the test, indicating that the program did not pass the test.

7. A testing system, comprising:
at least one hardware processor;
at least one memory, coupled to the at least one hardware processor, and storing instructions, which when executed by the at least one hardware processor, implements instructions to:
obtain a user selection to identify an element associated with a user interface to be tested,
wherein a user interface presentation of the element at least partially fails to provide information represented by the element to a user with a disability using the user interface;

generate an indication user interface of a test to perform of the user interface presentation of the element by:
indicating an audio test as the test comprising an audio and a function to be performed by the audio,
wherein the audio test includes a group, and a state,
wherein the group indicates to check whether selecting a visible label associated with the element selects the element, and
wherein the state indicates to check whether the audio correctly describes a selection state associated with the element including selected and unselected; and

perform the test on the user interface; and
upon determining that the user interface passed the test, indicate by the indication user interface that the user interface is ready for release.

8. The system of claim 7 , wherein the instructions include:
determining a type of program associated with the user interface;
based on the type of program, determining multiple categories associated with the user interface;
categorizing the element associated with the user interface into a category among the multiple categories; and
enabling a selection of the test by presenting the multiple categories, the element, and the category associated with the element.

9. The system of claim 7 , wherein the user interface is associated with a web page, and wherein the instructions include:
determining multiple categories associated with the user interface including at least four of: HTML, header, navigation, main, form, and footer;
categorizing the element associated with the user interface into a category among the multiple categories; and
enabling a selection of the test by presenting the multiple categories, the element, and the category associated with the element.

10. The system of claim 7 , wherein the user interface is associated with an application, and wherein the instructions include:
determining multiple categories associated with the user interface including controls and notifications;
categorizing the element associated with the user interface into a category among the multiple categories; and
enabling a selection of the test by presenting the multiple categories, the element, and the category associated with the element.

11. The system of claim 7 , wherein the user interface includes at least two of a graphical user interface, an audio user interface, or a haptic user interface.

12. The system of claim 7 , wherein the instructions include:
obtaining a program associated with the user interface and the test,
executing the program associated with the user interface and the audio test;
performing natural language processing on the audio test to determine whether the audio test corresponds to an output indicated in the test; and
upon determining that the audio test does not correspond to the output indicating the test, indicating that the program did not pass the test.

13. A method comprising:
obtaining a user selection for identifying an element associated with a user interface to be tested,
wherein a user interface presentation of the element at least partially fails to provide information represented by the element to a user with a disability using the user interface;

generating an indication user interface of a test to perform of the user interface presentation of the element by:
indicating an audio test as the test comprising an audio and a function to be performed by the audio,
wherein the audio test includes a group, and a state,
wherein the group indicates to check whether selecting a visible label associated with the element selects the element, and
wherein the state indicates to check whether the audio correctly describes a selection state associated with the element including selected and unselec

Assignees

• T Mobile Usa Inc

Inventors

• Triplett Charles Roy

Classifications

• G06F11/3698

  Environments for analysis, debugging or testing of software · CPC title

• G06F11/3676 Primary

  for coverage analysis · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/0489

  using dedicated keyboard keys or combinations thereof · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title