Three-dimensional gestures

Patent metadata

Field	Value
Publication number	US-9535596-B2
Application number	US-201213557868-A
Country	US
Kind code	B2
Filing date	Jul 25, 2012
Priority date	Jul 25, 2012
Publication date	Jan 3, 2017
Grant date	Jan 3, 2017

Abstract

In one embodiment, a method includes identifying a three-dimensional gesture made by a user of a computing device with respect to one or more surfaces of the computing device, the three-dimensional gesture comprising a trajectory in three dimensions, a first portion of the trajectory comprising a touch of one or more of the surfaces, a second portion of the trajectory comprising a series of points in space distant from the surfaces; determining a user input based on the three-dimensional gesture; and executing one or more actions based on the user input.

First claim

What is claimed is:

1. A method comprising:
identifying, by a computing device, a gesture made by a user of the computing device with respect to one or more surfaces of the computing device, the gesture being independent of any object displayed by the computing device, and the gesture comprising a single trajectory in three dimensions including:
an earlier portion of the single trajectory in a first direction along at least one of the surfaces, the earlier portion comprising a first series of points touching the at least one of the surfaces, wherein the first series of points was detected using a first sensor of the computing device; and
immediately following the earlier portion of the single trajectory, a later portion of the single trajectory in a second direction, the later portion comprising a second series of points increasingly distant from the surfaces, wherein the second direction comprises a deflection from the first direction that follows through on the earlier portion of the single trajectory, and wherein the second series of points was detected using a second sensor of the computing device;
determining, by the computing device, a user input based at least in part on a speed of the gesture along the earlier portion of the single trajectory and a speed of the gesture along the later portion of the single trajectory, the user input being determined independent of a location corresponding to the series of points touching the surfaces; and
executing, by the computing device, one or more actions based on the user input.

2. The method of claim 1 , wherein the gesture is identified using a proximity sensor, camera, or touch sensor of the computing device.

3. The method of claim 1 , wherein:
the gesture comprises a pulling gesture on and then away from one of the surfaces at a first location of the one of the surfaces; and
the actions comprise:
selecting a user interface (UI) object within a display of the computing device at a first point within the display corresponding to the first location; and
adjusting a user-controllable parameter of an application on the computing device indicated by the UI object based on a distance of an end point of the pulling gesture away from the one of the surfaces.

4. The method of claim 3 , wherein the user-controllable parameter is a speaker volume or a display brightness.

5. The method of claim 1 , wherein:
the gesture is a fly-away gesture; and
the actions comprise:
selecting a scrollable user interface (UI) object at or near a starting point of the fly-away gesture; and
scrolling the scrollable UI object at a speed based at least in part on a velocity of the fly-away gesture.

6. The method of claim 1 , wherein the computing device is a mobile computing device.

7. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:
identify a gesture made by a user of a computing device with respect to one or more surfaces of the computing device, the gesture being independent of any object displayed by the computing device, and the gesture comprising a single trajectory in three dimensions including:
an earlier portion of the single trajectory in a first direction along at least one of the surfaces, the earlier portion comprising a first series of points touching the at least one of the surfaces, wherein the first series of points was detected using a first sensor of the computing device; and
immediately following the earlier portion of the single trajectory, a later portion of the single trajectory in a second direction, the later portion comprising a second series of points increasingly distant from the surfaces, wherein the second direction comprises a deflection from the first direction that follows through on the earlier portion of the single trajectory, and wherein the second series of points was detected using a second sensor of the computing device;
determine a user input based at least in part on a speed of the gesture along the earlier portion of the single trajectory and a speed of the gesture along the later portion of the single trajectory, the user input being determined independent of a location corresponding to the series of points touching the surfaces; and
execute one or more actions based on the user input.

8. The media of claim 7 , wherein the gesture is identified using a proximity sensor, camera, or touch sensor of the computing device.

9. The media of claim 7 , wherein:
the gesture comprises a pulling gesture on and then away from one of the surfaces at a first location of the one of the surfaces; and
the actions comprise:
selecting a user interface (UI) object within a display of the computing device at a first point within the display corresponding to the first location; and
adjusting a user-controllable parameter of an application on the computing device indicated by the UI object based on a distance of an end point of the pulling gesture away from the one of the surfaces.

10. The media of claim 9 , wherein the user-controllable parameter is a speaker volume or a display brightness.

11. The media of claim 7 , wherein:
the gesture is a fly-away gesture; and
the actions comprise:
selecting a scrollable user interface (UI) object at or near a starting point of the fly-away gesture; and
scrolling the scrollable UI object at a speed based at least in part on a velocity of the fly-away gesture.

12. The media of claim 7 , wherein the computing device is a mobile computing device.

13. A device comprising:
one or more processors; and
one or more computer-readable non-transitory storage media coupled to the processors and embodying software that is operable when executed by the processors to:
identify a gesture made by a user of the device with respect to one or more surfaces of the device, the gesture being independent of any object displayed by the computing device, and the gesture comprising a single trajectory in three dimensions including:
an earlier portion of the single trajectory in a first direction along at least one of the surfaces, the earlier portion comprising a first series of points touching the at least one of the surfaces, wherein the first series of points was detected using a first sensor of the computing device; and
immediately following the earlier portion of the single trajectory, a later portion of the single trajectory in a second direction, the later portion comprising a second series of points increasingly distant from the surfaces, wherein the second direction comprises a deflection from the first direction that follows through on the earlier portion of the single trajectory, and wherein the second series of points was detected using a second sensor of the computing device;
determine a user input based at least in part on a speed of the gesture along the earlier portion of the single trajectory and a speed of the gesture along the later portion of the single trajectory, the user input being determined independent of a location corresponding to the series of points touching the surfaces; and
execute one or more actions based on the user input.

14. The device of claim 13 , wherein the gesture is identified using a proximity sensor, camera, or touch sensor of the device.

15. The device of claim 13 , wherein:
the gesture comprises a pulling gesture on and then away from one of the surfaces at a first location of the one of the surfaces; and
the actions comprise:
selecting a user interface (UI) object within a display of the computing device at a first point within the display corresponding to the first location; and
adjusting a user-controllable

Assignees

• St Clair Luke
• Facebook Inc

Inventors

• St Clair Luke

Classifications

• G06F3/04883 Primary

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/0488 Primary

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F2203/04808

  Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen · CPC title

• G06F2203/04101

  2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup · CPC title

• G06F3/04847

  Interaction techniques to control parameter settings, e.g. interaction with sliders or dials · CPC title