Interface scanning for disabled users

Patent metadata

Field	Value
Publication number	US-10509549-B2
Application number	US-201715785375-A
Country	US
Kind code	B2
Filing date	Oct 16, 2017
Priority date	Jan 25, 2013
Publication date	Dec 17, 2019
Grant date	Dec 17, 2019

Abstract

Systems and processes for scanning a user interface are disclosed. One process can include scanning multiple elements within a user interface by highlighting the elements. The process can further include receiving a selection while one of the elements is highlighted and performing an action on the element that was highlighted when the selection was received. The action can include scanning the contents of the selected element or performing an action associated with the selected element. The process can be used to navigate an array of application icons, a menu of options, a standard desktop or laptop operating system interface, or the like. The process can also be used to perform gestures on a touch-sensitive device or mouse and track pad gestures (e.g., flick, tap, or freehand gestures).

First claim

What is claimed is:

1. A method comprising:
at an electronic device with a display and one or more input devices:
receiving a request to simulate a gesture;
in response to receiving the request to simulate the gesture, displaying a positional indicator that indicates a starting point of the gesture performed with a simulated contact and a movement indicator that indicates a direction of movement of the simulated contact;
displaying a plurality of options for changing the movement of the simulated contact;
receiving a selection input that corresponds to a respective option of the plurality of options for changing the movement of the simulated contact; and
in response to receiving the selection input:
in accordance with a determination that a first option, of the plurality of options for changing the movement of the simulated contact, was selected, changing the movement indicator in a first manner to indicate a first path of movement of the simulated contact; and
in accordance with a determination that a second option, of the plurality of options for changing the movement of the simulated contact, was selected, changing the movement indicator in a second manner different from the first manner to indicate a second path of movement of the simulated contact different from the first path of movement of the simulated contact;

after receiving the selection input, receiving a request to perform the simulated gesture in a respective user interface; and
in response to receiving the request to perform the simulated gesture, updating an appearance of the respective user interface in a manner in which the respective user interface would be updated in response to detecting touchdown of a contact at a respective location in the user interface that corresponds to a location of the positional indicator and movement of the simulated contact along a path determined by the movement indicator.

2. The method of claim 1 , wherein the plurality of options for changing the movement of the simulated contact comprises one or more options for displacing the movement indicator.

3. The method of claim 2 , wherein the one or more options for displacing the movement indicator comprises an option for displacing the movement indicator by rotation of the movement indicator.

4. The method of claim 3 , wherein the option for displacing the movement indicator by rotation of the movement indicator comprises rotation in a clockwise or counter-clockwise direction by a predetermined amount.

5. The method of claim 1 , wherein the plurality of options for changing the movement of the simulated contact comprises one or more option for changing the shape of the movement indicator.

6. The method of claim 5 , wherein the one or more options for changing the shape of the movement indicator comprise curving or straightening the movement indicator.

7. The method of claim 1 , wherein the request to perform the simulated gesture comprises a request to move the positional indicator along the path determined by the movement indicator.

8. The method of claim 7 , wherein the request to perform the simulated gesture further comprises a request to stop moving the positional indicator.

9. An electronic device, comprising:
one or more processors;
a display;
one or more input devices;
memory; and
one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
receiving a request to simulate a gesture;
in response to receiving the request to simulate the gesture, displaying a positional indicator that indicates a starting point of the gesture performed with a simulated contact and a movement indicator that indicates a direction of movement of the simulated contact;
displaying a plurality of options for changing the movement of the simulated contact;
receiving a selection input that corresponds to a respective option of the plurality of options for changing the movement of the simulated contact; and
in response to receiving the selection input:
in accordance with a determination that a first option, of the plurality of options for changing the movement of the simulated contact, was selected, changing the movement indicator in a first manner to indicate a first path of movement of the simulated contact; and
in accordance with a determination that a second option, of the plurality of options for changing the movement of the simulated contact, was selected, changing the movement indicator in a second manner different from the first manner to indicate a second path of movement of the simulated contact different from the first path of movement of the simulated contact;

after receiving the selection input, receiving a request to perform the simulated gesture in a respective user interface; and

in response to receiving the request to perform the simulated gesture, updating an appearance of the respective user interface in a manner in which the respective user interface would be updated in response to detecting touchdown of a contact at a respective location in the user interface that corresponds to a location of the positional indicator and movement of the simulated contact along a path determined by the movement indicator.

10. The electronic device of claim 9 , wherein the plurality of options for changing the movement of the simulated contact comprises one or more options for displacing the movement indicator.

11. The electronic device of claim 10 , wherein the one or more options for displacing the movement indicator comprises an option for displacing the movement indicator by rotation of the movement indicator.

12. The electronic device of claim 11 , wherein the option for displacing the movement indicator by rotation of the movement indicator comprises rotation in a clockwise or counter-clockwise direction by a predetermined amount.

13. The electronic device of claim 9 , wherein the plurality of options for changing the movement of the simulated contact comprises one or more option for changing the shape of the movement indicator.

14. The electronic device of claim 13 , wherein the one or more options for changing the shape of the movement indicator comprise curving or straightening the movement indicator.

15. The electronic device of claim 9 , wherein the request to perform the simulated gesture comprises a request to move the positional indicator along the path determined by the movement indicator.

16. The electronic device of claim 15 , wherein the request to perform the simulated gesture further comprises a request to stop moving the positional indicator.

17. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
receive a request to simulate a gesture;
in response to receiving the request to simulate the gesture, display a positional indicator that indicates a starting point of the gesture performed with a simulated contact and a movement indicator that indicates a direction of movement of the simulated contact;
display a plurality of options for changing the movement of the simulated contact;
receive a selection input that corresponds to a respective option of the plurality of options for changing the movement of the simulated contact; and
in response to receiving the selection input:
in accordance with a determination that a first option, of the plurality of options for changing the movement of the simulated contact, was selected, change

Assignees

• Apple Inc

Inventors

• Fleizach Christopher
• Seymour Eric T
• KASEMSET Clare
• White Samuel
• Minifie Darren C
• Fisch Ian
• Hughes Gregory F
• Kaufman Justin
• Hoa Patti P

Classifications

• G06F3/0487

  using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser · CPC title

• G06F3/04842 Primary

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• H04M1/2474

  Telephone terminals specially adapted for disabled people (user interfaces for cordless or mobile telephones specially adapted for disabled users H04M1/72475; network based special services or facilities for hearing-impaired persons H04M3/42391; devices for conversing with the deaf-blind G09B21/04) · CPC title

• H04M1/72588

  Electricity · mapped topic

• H04M1/72475

  specially adapted for disabled users · CPC title