Devices, methods, and graphical user interfaces for providing control of a touch-based user interface absent physical touch capabilities

Patent metadata

Field	Value
Publication number	US-9513799-B2
Application number	US-201113217654-A
Country	US
Kind code	B2
Filing date	Aug 25, 2011
Priority date	Jun 5, 2011
Publication date	Dec 6, 2016
Grant date	Dec 6, 2016

Abstract

An electronic device with a display and a touch-sensitive surface displays, on the display, a first visual indicator that corresponds to a virtual touch. The device receives a first input from an adaptive input device. In response to receiving the first input from the adaptive input device, the device displays a first menu on the display. The first menu includes a virtual touches selection icon. In response to detecting selection of the virtual touches selection icon, a menu of virtual multitouch contacts is displayed.

First claim

What is claimed is:

1. An electronic device, comprising:
a display;
a touch-sensitive surface;
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, on the display, a user interface;
while displaying the user interface, receiving a request to display options for interacting with the user interface using virtual multitouch contacts;
in response to receiving the request to display the options for interacting with the user interface using virtual multitouch contacts, displaying, on the display a menu of a plurality of virtual multitouch contacts;
after displaying the menu of the plurality of virtual multitouch contacts on the display, receiving a sequence of one or more inputs that includes selection of a respective virtual multitouch contact of the plurality of virtual multitouch contacts; and,
in response to receiving the sequence of one or more inputs, performing an operation in the user interface that corresponds to the respective virtual multitouch contact.

2. The device of claim 1 , wherein the one or more programs include instructions for:
in response to detecting selection of the respective virtual multitouch contact of the plurality of virtual multitouch contacts, displaying one or more visual indicators that correspond to the respective virtual multitouch contact.

3. The device of claim 2 , wherein the one or more programs include instructions for:
in response to receiving the sequence of one or more inputs:
moving the one or more visual indicators.

4. The device of claim 1 , wherein the one or more programs include instructions for:
displaying a virtual gestures icon;
detecting selection of the virtual gestures icon;
in response to detecting selection of the virtual gestures icon, displaying a menu of virtual gestures, the menu of virtual gestures including a plurality of icons representing types of virtual gestures;
detecting selection of a respective virtual gesture icon in the menu of virtual gestures; and,
in response to detecting selection of the respective virtual gesture icon in the menu of virtual gestures, performing an action that corresponds to the respective virtual gesture.

5. The device of claim 1 , wherein the one or more programs include instructions for:
displaying a virtual gestures icon;
detecting selection of the virtual gestures icon;
in response to detecting selection of the virtual gestures icon, displaying a menu of virtual gestures, the menu of virtual gestures including a plurality of icons representing types of virtual gestures;
detecting selection of a respective virtual gesture icon in the menu of virtual gestures;
in response to detecting selection of the respective virtual gesture icon in the menu of virtual gestures, displaying a number of visual indicators that correspond to the respective virtual gesture icon;
receiving a second input from the adaptive input device; and,
in response to receiving the second input from the adaptive input device, performing an operation in accordance with the respective virtual gesture.

6. The device of claim 1 , wherein the one or more programs include instructions for:
displaying a pinch/depinch gesture icon;
detecting selection of the virtual pinch/depinch gesture icon;
in response to detecting selection of the virtual pinch/depinch gesture icon, displaying two visual indicators that correspond to contacts in the virtual pinch/depinch gesture;
receiving a second input from the adaptive input device; and,
in response to receiving the second input from the adaptive input device, performing an operation in accordance with the virtual pinch/depinch gesture.

7. The device of claim 1 , wherein the one or more programs include instructions for:
displaying a virtual device icon;
detecting selection of the virtual device icon;
in response to detecting selection of the virtual device icon, displaying a menu of virtual device operations, the menu of virtual device operations including a plurality of icons representing types of virtual device operations;
detecting selection of a respective virtual device operation icon in the menu of virtual device operations; and,
in response to detecting selection of the respective virtual device operation icon in the menu of virtual device operations, performing an action that corresponds to the respective virtual device operation.

8. The device of claim 1 , wherein the one or more programs include instructions for:
displaying a virtual device rotation icon;
detecting selection of the virtual device rotation icon;
in response to detecting selection of the virtual device rotation icon, displaying a menu of virtual device orientations, the menu of virtual device orientations including a plurality of icons representing types of virtual device orientations;
detecting selection of a respective virtual device orientation icon in the menu of virtual device orientations; and,
in response to detecting selection of the respective virtual device orientation icon in the menu of virtual device orientations, orienting the display in accordance with the respective virtual device orientation.

9. The device of claim 1 , wherein the device includes a home button, and the one or more programs include instructions for:
displaying a home button icon;
detecting selection of the home button icon; and,
in response to detecting selection of the home button icon, performing an action that corresponds to activation of the home button.

10. The device of claim 1 , wherein the operation does not correspond to a multitouch contact actually detected on the touch-sensitive surface.

11. The device of claim 1 , wherein the sequence of one or more inputs does not include a corresponding multitouch contact actually detected on the touch-sensitive surface.

12. A method, comprising:
at an electronic device with a display and a touch-sensitive surface:
displaying, on the display, a user interface;
while displaying the user interface, receiving a request to display options for interacting with the user interface using virtual multitouch contacts;
in response to receiving the request to display the options for interacting with the user interface using virtual multitouch contacts,

displaying, on the display a menu of a plurality of virtual multitouch contacts;
after displaying the menu of the plurality of virtual multitouch contacts on the display, receiving a sequence of one or more inputs that includes selection of a respective virtual multitouch contact of the plurality of virtual multitouch contacts; and,
in response to receiving the sequence of one or more inputs, performing an operation in the user interface that corresponds to the respective virtual multitouch contact.

13. The method of claim 12 , including:
in response to detecting selection of the respective virtual multitouch contact of the plurality of virtual multitouch contacts, displaying one or more visual indicators that correspond to the respective virtual multitouch contact.

14. The method of claim 13 , including:
in response to receiving the sequence of one or more inputs:
moving the one or more visual indicators.

15. The method of claim 12 , including:
displaying a virtual gestures icon;
detecting selection of the virtual gestures icon;
in response to detecting selection of the virtual gestures icon, displaying a menu of virtual gestures, the menu of virtual gestures including a plurality of icons representing

Assignees

• Fleizach Christopher Brian
• Seymour Eric Taylor
• Craig James P
• Apple Inc

Inventors

• Fleizach Christopher Brian
• Seymour Eric Taylor
• Craig James P

Classifications

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06F3/0488 Primary

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/0485

  Scrolling or panning · CPC title

• G06F3/04883 Primary

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title