Modifying readable and focusable elements on a page during execution of automated scripts

Patent metadata

Field	Value
Publication number	US-11334374-B2
Application number	US-202017247369-A
Country	US
Kind code	B2
Filing date	Dec 9, 2020
Priority date	May 15, 2019
Publication date	May 17, 2022
Grant date	May 17, 2022

Abstract

A device may initiate an automated script to perform one or more interactions with a browser application and identify a first element in a page rendered by the browser application that satisfies one or more accessibility criteria, wherein the first element may include text that is readable by a screen reader application and/or an attribute that causes the first element to be navigable using a keyboard. The device may modify the first element to be inaccessible to the screen reader application and the keyboard and insert, into the page, a second element including text that is readable by the screen reader application to describe the one or more interactions that the automated script is performing. The client device may restore the page to an original state based on determining that the automated script has finished executing.

First claim

What is claimed is:

1. A method, comprising:
initiating, by a device, an automated script to perform an interaction with a browser application executing on the device;
identifying, by the device, an element, in a page rendered by the browser application, that satisfies one or more accessibility criteria,
wherein the element includes text readable by a screen reader application executing on the device;

modifying, by the device, content on the page to make the text associated with the element inaccessible to the screen reader application while the automated script is executing on the device;
inserting, by the device, an explanatory element into the page based on the interaction that the automated script is performing;
determining, by the device, that the automated script has finished executing; and
restoring, by the device, an original state of the content on the page based on determining that the automated script has finished executing.

2. The method of claim 1 , further comprising:
identifying another element, in the page rendered by the browser application, that satisfies the one or more accessibility criteria,
wherein the other element is navigable using a keyboard associated with the device; and

modifying the content on the page to make the other element inaccessible using the keyboard associated with the device.

3. The method of claim 1 , wherein the screen reader application is to enable a visually impaired user to interact with the other element associated with a text alternative using one or more of:
text-to-speech software, or
text-to-Braille hardware.

4. The method of claim 1 , further comprising:
caching the original state of the content on the page; and
wherein restoring the original state of the content on the page comprises:
restoring the cached original state of the content on the page based on determining that the automated script has finished executing.

5. The method of claim 1 , wherein modifying the content on the page comprises:
modifying the content on the page based on the one or more accessibility criteria obtained from a web accessibility platform.

6. The method of claim 1 , further comprising:
identifying another element, in the page rendered by the browser application, that satisfies the one or more accessibility criteria,
wherein the other element includes an interactive element; and

wherein modifying the content on the page comprises:
modifying the content on the page to make the interactive element be non-interactive.

7. The method of claim 1 , wherein modifying the content on the page comprises:
decreasing a focus on the element that is not relevant to the interaction that the automated script is performing.

8. A device, comprising:
one or more memories; and
one or more processors, communicatively coupled to the one or more memories, configured to:
initiate an automated script to perform an interaction with a browser application executing on the device;
identify an element, in a page rendered by the browser application, that satisfies one or more accessibility criteria,
wherein the element includes text readable by a screen reader application executing on the device; and

modify content on the page to make the text associated with the element inaccessible to the screen reader application while the automated script is executing on the device;
determine, by the device, that the automated script has finished executing; and
restore, by the device, an original state of the content on the page based on determining that the automated script has finished executing.

9. The device of claim 8 , wherein the one or more processors are further configured to:
identify another element, in the page rendered by the browser application, that satisfies the one or more accessibility criteria,
wherein the other element is navigable using a keyboard associated with the device; and

modify the content on the page to make the other element inaccessible using the keyboard associated with the device.

10. The device of claim 8 , wherein the screen reader application is to enable a visually impaired user to interact with the element associated with a text alternative using one or more of:
text-to-speech software, or
text-to-Braille hardware.

11. The device of claim 8 , wherein the one or more processors, when modifying the content on the page, are to:
decrease a focus on the element that is not relevant to the interaction that the automated script is performing.

12. The device of claim 8 , wherein the one or more processors are further configured to:
insert an explanatory element into the page based on the interaction that the automated script is performing;
cache the original state of the content on the page; and
wherein the one or more processors, when restoring the original state of the content, are to:
restore the cached original state of the content on the page based on determining that the automated script has finished executing.

13. The device of claim 8 , wherein the one or more processors, when modifying the content on the page, are to:
modify the content on the page based on the one or more accessibility criteria obtained from a web accessibility platform.

14. The device of claim 8 , wherein the one or more processors are further configured to:
identify another element, in the page rendered by the browser application, that satisfies the one or more accessibility criteria,
wherein the other element includes an interactive element; and

wherein the one or more processors when modifying the content on the page are to:
modify the content on the page to make the interactive element be non-interactive.

15. A non-transitory computer-readable medium storing instructions, the instructions comprising:
one or more instructions that, when executed by one or more processors on a device, cause the one or more processors to:
initiate an automated script to perform an interaction with a browser application executing on the device;
identify an element, in a page rendered by the browser application, that satisfies one or more accessibility criteria,
wherein the element includes text readable by a screen reader application executing on the device;

modify content on the page to make the text associated with the element inaccessible to the screen reader application while the automated script is executing on the device; and
insert an element into the page based on the interaction that the automated script is performing;
determine that the automated script has finished executing; and
restore an original state of the content on the page based on determining that the automated script has finished executing.

16. The non-transitory computer-readable medium of claim 15 , wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:
identify another element, in the page rendered by the browser application, that satisfies the one or more accessibility criteria,
wherein the other element is navigable using a keyboard associated with the device; and

modify the content on the page to make the other element inaccessible using the keyboard associated with the device.

17. The non-transitory computer-readable medium of claim 15 , wherein the screen reader application is to enable a visually impaired user to interact with the element associated with a text alternative using one or more of:
text-to-speech software, or
text-to-Braille hardware.

18. The non-transitory computer-readable medium of claim 15 , wherei

Assignees

• Capital One Service Llc
• Capital One Services Llc

Inventors

• Nguyen Vu
• Yucra Rodriguez Jonatan
• Vukich Adam
• Edwards Joshua
• Gabriele David
• Benkreira Abdelkadar M'Hamed

Classifications

• H04L67/568

  Storing data temporarily at an intermediate stage, e.g. caching · CPC title

• G06F40/143 Primary

  Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD] · CPC title

• G06F16/958

  Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06F9/45529

  Embedded in an application, e.g. JavaScript in a Web browser · CPC title