Interface scanning for disabled users

Patent metadata

Field	Value
Publication number	US-9792013-B2
Application number	US-201313782843-A
Country	US
Kind code	B2
Filing date	Mar 1, 2013
Priority date	Jan 25, 2013
Publication date	Oct 17, 2017
Grant date	Oct 17, 2017

Abstract

Systems and processes for scanning a user interface are disclosed. One process can include scanning multiple elements within a user interface by highlighting the elements. The process can further include receiving a selection while one of the elements is highlighted and performing an action on the element that was highlighted when the selection was received. The action can include scanning the contents of the selected element or performing an action associated with the selected element. The process can be used to navigate an array of application icons, a menu of options, a standard desktop or laptop operating system interface, or the like. The process can also be used to perform gestures on a touch-sensitive device or mouse and track pad gestures (e.g., flick, tap, or freehand gestures).

First claim

What is claimed is:

1. A method comprising:
at an electronic device with a display and one or more input devices:
scanning a plurality of elements displayed on the display, wherein scanning the plurality of elements comprises sequentially highlighting the plurality of elements, and wherein a first element of the plurality of elements comprises a plurality of sub-elements;
receiving, via the one or more input devices, a first selection input when the first element of the plurality of elements is highlighted;
in response to receiving the first selection input, scanning a region of the display that includes the plurality of sub-elements of the first element, wherein scanning the region of the display includes scanning the plurality of sub-elements;
receiving a second selection input, via the one or more input devices, while scanning the region of the display that includes the plurality of sub-elements; and
in response to receiving the second selection input:
in accordance with a determination that the second selection input includes selection of a respective sub-element of the plurality of sub-elements, performing an action associated with the respective sub-element of the plurality of sub-elements; and
in accordance with a determination that the second selection input includes selection of an escape element associated with an escape command, performing the escape command, wherein the escape element includes a graphical element that encompasses the plurality of sub-elements.

2. The method of claim 1 , wherein performing the escape command includes returning to scanning elements in the plurality of elements.

3. The method of claim 1 , wherein the escape command is performed without performing the action associated with the respective sub-element.

4. The method of claim 1 , wherein the first selection input and the second selection input are received via a common input device of the one or more input devices.

5. The method of claim 1 , wherein scanning the region of the display that includes the plurality of sub-elements of the first element comprises sequentially highlighting the plurality of sub-elements and then highlighting the first element of the plurality of elements.

6. The method of claim 5 , wherein the determination that the second selection input includes selection of an escape element associated with an escape command comprises determining that the second selection input is received when the first element of the plurality of elements is highlighted.

7. The method of claim 1 , wherein the escape element comprises highlighting of the first element of the plurality of elements.

8. The method of claim 1 , wherein the escape element comprises an indication of a selection of the first element of the plurality of elements.

9. An electronic device comprising:
a display;
one or more input devices; and
one or more processors coupled to the display and the one or more input devices, the one or more processors capable of:
scanning a plurality of elements displayed on the display, wherein scanning the plurality of elements comprises sequentially highlighting the plurality of elements, and wherein a first element of the plurality of elements comprises a plurality of sub-elements;
receiving, via the one or more input devices, a first selection input when the first element of the plurality of elements is highlighted;
in response to receiving the first selection input, scanning a region of the display that includes the plurality of sub-elements of the first element, wherein scanning the region of the display includes scanning the plurality of sub-elements;
receiving a second selection input, via the one or more input devices, while scanning the region of the display that includes the plurality of sub-elements; and
in response to receiving the second selection input:
in accordance with a determination that the second selection input includes selection of a respective sub-element of the plurality of sub-elements, performing an action associated with the respective sub-element of the plurality of sub-elements; and
in accordance with a determination that the second selection input includes selection of an escape element associated with an escape command, performing the escape command, wherein the escape element includes a graphical element that encompasses the plurality of sub-elements.

10. The electronic device of claim 9 , wherein performing the escape command includes returning to scanning elements in the plurality of elements.

11. The electronic device of claim 9 , wherein the escape command is performed without performing the action associated with the respective sub-element.

12. The electronic device of claim 9 , wherein the first selection input and the second selection input are received via a common input device of the one or more input devices.

13. The electronic device of claim 9 , wherein scanning the region of the display that includes the plurality of sub-elements of the first element comprises sequentially highlighting the plurality of sub-elements and then highlighting the first element of the plurality of elements.

14. The electronic device of claim 13 , wherein the determination that the second selection input includes selection of an escape element associated with an escape command comprises determining that the second selection input is received when the first element of the plurality of elements is highlighted.

15. The electronic device of claim 9 , wherein the escape element comprises highlighting of the first element of the plurality of elements.

16. The electronic device of claim 9 , wherein the escape element comprises an indication of a selection of the first element of the plurality of elements.

17. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with one or more processors, a display and one or more input devices, cause the device to:
scan a plurality of elements displayed on the display, wherein scanning the plurality of elements comprises sequentially highlighting the plurality of elements, and wherein a first element of the plurality of elements comprises a plurality of sub-elements;
receive, via the one or more input devices, a first selection input when the first element of the plurality of elements is highlighted;
in response to receiving the first selection input, scan a region of the display that includes the plurality of sub-elements of the first element, wherein scanning the region of the display includes scanning the plurality of sub-elements;
receive a second selection input, via the one or more input devices, while scanning the region of the display that includes the plurality of sub-elements; and
in response to receiving the second selection input:
in accordance with a determination that the second selection input includes selection of a respective sub-element of the plurality of sub-elements, perform an action associated with the respective sub-element of the plurality of sub-elements; and
in accordance with a determination that the second selection input includes selection of an escape element associated with an escape command, perform the escape command, wherein the escape element includes a graphical element that encompasses the plurality of sub-elements.

18. The non-transitory computer-readable storage medium of claim 17 , wherein performing the escape command includes returning to scanning elements in the plurality of elements.

19. The non-transitory c

Assignees

• Apple Inc

Inventors

• Fleizach Christopher
• Seymour Eric T
• KASEMSET Clare
• White Samuel
• Minifie Darren C
• Fisch Ian
• Hughes Gregory F
• Kaufman Justin
• Hoa Patti P

Classifications

• H04M1/2474

  Telephone terminals specially adapted for disabled people (user interfaces for cordless or mobile telephones specially adapted for disabled users H04M1/72475; network based special services or facilities for hearing-impaired persons H04M3/42391; devices for conversing with the deaf-blind G09B21/04) · CPC title

• G06F3/0487

  using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser · CPC title

• G06F3/04842 Primary

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• H04M1/72475

  specially adapted for disabled users · CPC title