Visual feedback for level of gesture completion

Patent metadata

Field	Value
Publication number	US-9383894-B2
Application number	US-201414150669-A
Country	US
Kind code	B2
Filing date	Jan 8, 2014
Priority date	Jan 8, 2014
Publication date	Jul 5, 2016
Grant date	Jul 5, 2016

Abstract

Embodiments are disclosed that relate to providing feedback for a level of completion of a user gesture via a cursor displayed on a user interface. One disclosed embodiment provides a method comprising displaying a cursor having a visual property and moving a screen-space position of the cursor responsive to the user gesture. The method further comprises changing the visual property of the cursor in proportion to a level of completion of the user gesture. In this way, the level of completion of the user gesture may be presented to the user in a location to which the attention of the user is directed during performance of the gesture.

First claim

The invention claimed is:

1. A method of providing visual feedback for a user gesture, the method comprising:
displaying a cursor having one or more visual properties;
moving a screen-space position of the cursor responsive to movement of a hand of a user in three-dimensional space, relative to a body of the user;
selecting a visual property of the one or more visual properties based at least on a determined type of a user gesture performed with the hand, wherein the user gesture is at least one of a selection gesture for selecting an item in a user interface or a gripping gesture for performing a function in the user interface, the selection gesture including movement of the hand of the user away from the body of the user, and the gripping gesture including closing of the hand of the user, and wherein the selected visual property comprises at least one of a closed state of a hand-shaped cursor and an amount of fill of the hand-shaped cursor; and
changing the selected visual property of the one or more visual properties of the cursor in proportion to a level of completion of the user gesture, wherein changing the selected visual property comprises at least one of closing the hand-shaped cursor, increasing the amount of fill of the hand-shaped cursor from a perimeter inwards, and increasing the amount of fill of the hand-shaped cursor from an edge toward a different edge.

2. The method of claim 1 , wherein the visual property is a percentage of the cursor that is filled with a fill color.

3. The method of claim 2 , wherein the fill color is selected based at least on a type of user gesture being performed.

4. The method of claim 1 , wherein the cursor is a hand-shaped cursor having a palm and a plurality of fingers.

5. The method of claim 4 , wherein changing the visual property of the cursor comprises changing a fill percentage of the hand-shaped cursor in proportion to a level of completion of the user gesture, the fill percentage of the palm increasing from a perimeter of the palm inward and the fill percentage of the plurality of fingers increasing from tips of the fingers towards the palm.

6. The method of claim 4 , wherein the hand-shaped cursor represents one of a right hand and a left hand selected to match the hand used to perform the user gesture.

7. The method of claim 1 , wherein the visual property that is changed is user-selected.

8. The method of claim 1 , wherein, for a gripping gesture, the selected visual property that is changed comprises a closed state of a hand-shaped cursor, and for a selection gesture, the selected visual property that is changed comprises an amount of fill of a hand-shaped cursor.

9. The method of claim 1 , wherein the cursor is a first hand-shaped cursor, the method further comprising displaying a second hand-shaped cursor, each hand-shaped cursor mapped to a different hand of a user.

10. The method of claim 1 , wherein the cursor is a first hand-shaped cursor, the method further comprising displaying a second hand-shaped cursor, each hand-shaped cursor mapped to a hand of a different user.

11. A hardware storage machine holding instructions executable by a logic machine, the instructions comprising:
instructions to display a cursor having one or more visual properties;
instructions to move a screen-space position of the cursor responsive to movement of a hand of a user in three-dimensional space, relative to a body of the user;
instructions to detect a user gesture performed by the hand of the user, wherein the user gesture is at least one of a selection gesture for selecting an item in a user interface and a gripping gesture for performing a function in the user interface, the selection gesture including movement of the hand of the user away from the body of the user, and the gripping gesture including closing of the hand of the user;
instructions to select a visual property of the one or more visual properties based at least on a determined type of the user gesture performed with the hand, wherein the selected visual property comprises at least one of a closed state of the hand-shaped cursor and an amount of fill of the hand-shaped cursor; and
instructions to change the selected visual property of the one or more visual properties of the cursor in proportion to a level of completion of the user gesture, wherein a type of change of the selected visual property is selected based at least on the determined type of the user gesture, and wherein changing the selected visual property comprises at least one of closing the hand-shaped cursor, increasing an amount of fill of the hand-shaped cursor from a perimeter inwards, and increasing an amount of fill of the hand-shaped cursor from an edge towards a different edge.

12. The hardware storage machine of claim 11 , the instructions further executable to determine a state of a hand, the state indicating a level of closure of the hand.

13. The hardware storage machine of claim 12 , the instructions further executable to provide feedback via the cursor indicating a gesture associated with the state of the hand.

14. The hardware storage machine of claim 13 , wherein the feedback comprises an icon displayed in a location that is spaced from the cursor.

15. The hardware storage machine of claim 11 , wherein the cursor is a hand-shaped cursor having a palm and a plurality of fingers, and wherein changing the fill percentage of the hand-shaped cursor in proportion to a level of completion of the user gesture comprises increasing the fill percentage of the palm from a perimeter of the palm inward and increasing the fill percentage of the plurality of fingers from tips of the fingers towards the palm.

16. A method of providing visual feedback for a user gesture, the method comprising:
displaying a hand-shaped cursor having one or more visual properties including a palm and a plurality of fingers;
moving a screen-space position of the hand-shaped cursor responsive to movement of a hand of a user in three-dimensional space, relative to a body of the user;
detecting a user gesture performed by the hand of the user, wherein the user gesture is at least one of a selection gesture for selecting an item in a user interface and a gripping gesture for performing a function in the user interface, the selection gesture including movement of the hand of the user away from the body of the user, and the gripping gesture including closing of the hand of the user;
selecting a visual property of the one or more visual properties based at least on a determined type of the user gesture performed with the hand, wherein the selected visual property comprises at least one of a closed state of the hand-shaped cursor and an amount of fill of the hand-shaped cursor; and
changing the selected visual property of the one or more visual properties in proportion to a level of completion of the user gesture, wherein a type of change of the selected visual property is selected based at least on the determined type of the user gesture, and wherein changing the selected visual property comprises increasing the fill percentage of the palm from a perimeter of the palm inward and increasing the fill percentage of the plurality of fingers from tips of the fingers towards the palm.

17. The method of claim 16 , wherein the hand-shaped cursor is rotatable in 3 dimensions to match an orientation of a hand of a user in real-time.

18. The method of claim 16 , wherein the fill percentage comprises a percentage of the cursor that is filled with a first color, the fill percentage ranging from zero percent of the cursor being fi

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Schwesinger Mark
• Yang Emily
• Kapur Jay
• Klein Christian
• Murillo Oscar
• Paolantonio Sergio

Classifications

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/04812 Primary

  Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects · CPC title