Devices, methods, and graphical user interfaces for touch input processing

Patent metadata

Field	Value
Publication number	US-11747975-B2
Application number	US-202217679036-A
Country	US
Kind code	B2
Filing date	Feb 23, 2022
Priority date	May 16, 2017
Publication date	Sep 5, 2023
Grant date	Sep 5, 2023

Abstract

An electronic device, while displaying a user interface of an application, detects a user input on a portion of the user interface associated with a plurality of gesture recognizers. A first set of standard gesture recognizers are associated with the portion of the user interface by the application; a second set of supplemental gesture recognizers are associated with the portion of the user interface by a system process; and a first failure requirement determines which gesture recognizers must fail before other gesture recognizers can recognize a user input. In one example, the first failure requirement is that a particular standard gesture recognizer (e.g., an intensity-based gesture recognizer) must fail before a particular supplemental gesture recognizer (e.g., a drag start gesture recognizer) can recognize a user input.

First claim

What is claimed is:

1. A method, comprising:
at an electronic device with a display and a touch-sensitive surface:
displaying, on the display, a user interface of an application;
while displaying the user interface of the application, detecting a user input that corresponds to a portion of the user interface of the application that is associated with a plurality of gesture recognizers; and

in response to detecting the user input:
in accordance with a determination that the user input corresponds to a first type of gesture, processing the user input in accordance with a first standard gesture recognizer, a first supplemental gesture recognizer, and a first failure requirement involving the first standard gesture recognizer and the first supplemental gesture recognizer, wherein:
a first set of one or more standard gesture recognizers of the plurality of gesture recognizers were associated with the portion of the user interface by the application, the first set of one or more standard gesture recognizers including the first standard gesture recognizer;
a second set of one or more supplemental gesture recognizers in the plurality of gesture recognizers were associated with the portion of the user interface by a system process, the second set of one or more supplemental gesture recognizers including the first supplemental gesture recognizer; and
the first failure requirement involving the first standard gesture recognizer and the first supplemental gesture recognizer was associated with the portion of the user interface by the system process; and

in accordance with a determination that the user input corresponds to a second type of gesture that is different from the first type of gesture, processing the user input in accordance with the first standard gesture recognizer without using the first supplemental gesture recognizer and the first failure requirement.

2. The method of claim 1 , wherein the first set of one or more standard gesture recognizers and the second set of one or more supplemental gesture recognizers are arranged in a gesture recognition hierarchy, wherein the first failure requirement includes a requirement that a first respective gesture recognizer fail in order for a second respective gesture recognizer to successfully recognize a gesture, wherein the first respective gesture recognizer is at a higher level in the gesture recognition hierarchy than the second respective gesture recognizer.

3. The method of claim 1 , wherein the first failure requirement includes a requirement that the first supplemental gesture recognizer fail in order for the first standard gesture recognizer to successfully recognize a gesture.

4. The method of claim 3 , wherein the first supplemental gesture recognizer is a drag add gesture recognizer, and the first standard gesture recognizer is a tap gesture recognizer.

5. The method of claim 4 , wherein the drag add gesture recognizer includes, in order for a drag add gesture to be recognized, a requirement that the user input include a contact, at a location that corresponds to a respective user interface element in the user interface, and liftoff of the contact within a predefined period of time.

6. The method of claim 5 , wherein processing the user input in accordance with the first standard gesture recognizer, the first supplemental gesture recognizer, and the first failure requirement includes:
in accordance with a determination that content associated with the respective user interface element cannot be added to a drag operation, failing to recognize the user input using the drag add gesture recognizer, and processing the user input using the tap gesture recognizer; and
in accordance with a determination that the content associated with the respective user interface element can be added to the drag operation, recognizing a drag add gesture and adding the content to the drag operation.

7. The method of claim 3 , wherein the first supplemental gesture recognizer is a drag start gesture recognizer, and the first standard gesture recognizer is a long press gesture recognizer.

8. The method of claim 7 , wherein processing the user input in accordance with the first standard gesture recognizer, the first supplemental gesture recognizer, and the first failure requirement is performed in accordance with a determination that the electronic device satisfies compact display criteria.

9. The method of claim 1 , wherein, in accordance with a determination that the electronic device does not satisfy compact display criteria:
the first failure requirement includes a requirement that successful recognition of the user input as a first gesture by the first standard gesture recognizer be canceled in accordance with successful recognition of the user input as a second gesture by the first supplemental gesture recognizer; and
processing the user input in accordance with the first standard gesture recognizer, the first supplemental gesture recognizer, and the first failure requirement includes:
recognizing, using the first standard gesture recognizer, the user input as the first gesture; and
subsequent to recognizing the user input as the first gesture using the first standard gesture recognizer:
recognizing, using the first supplemental gesture recognizer, the user input as the second gesture; and
ceasing to recognize the user input as the first gesture using the first standard gesture recognizer.

10. The method of claim 1 , wherein the first failure requirement includes a requirement that the first standard gesture recognizer fail in order for the first supplemental gesture recognizer to successfully recognize a gesture.

11. The method of claim 10 , wherein the first standard gesture recognizer is an intensity-based gesture recognizer, and the first supplemental gesture recognizer is a drag start gesture recognizer.

12. The method of claim 1 , wherein the first supplemental gesture recognizer is a drag start gesture recognizer, and wherein the drag start gesture recognizer includes, in order for a drag start gesture to be recognized:
a requirement that the user input include a contact at a location that corresponds to a respective user interface element in the user interface for at least a predefined period of time; and
a requirement that, subsequent to the location of the contact corresponding to the respective user interface element for at least the predefined period of time, a change in location of the contact satisfy a lateral displacement threshold.

13. The method of claim 1 , wherein the first supplemental gesture recognizer is a drag start gesture recognizer, and wherein the drag start gesture recognizer includes, in order for a drag start gesture to be recognized:
a requirement that the user input include two concurrent contacts, on the touch-sensitive surface, at locations that correspond to a respective user interface element in the user interface; and
a requirement that changes in locations of the two concurrent contacts satisfy a lateral displacement threshold.

14. The method of claim 1 , wherein the first supplemental gesture recognizer is a drag add gesture recognizer, and wherein the drag add gesture recognizer includes, in order for a drag add gesture to be recognized, a requirement that the user input include two concurrent contacts, at locations that correspond to a respective user interface element in the user interface, and liftoff of the two concurrent contacts within a predefined period of time.

15. The method of claim 1 , including:
in response to detecting the user input:
in accordance with the determination that the user input corresponds to th

Assignees

• Apple Inc

Inventors

• Nilo Bruce D
• Thomas Christopher K
• Wagner Dominik
• Turner Michael T

Classifications

• G06F3/0488 Primary

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/0486

  Drag-and-drop · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06F3/0481 Primary

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title