Mechanism to provide visual feedback regarding computing system command gestures

Patent metadata

Field	Value
Publication number	US-10345911-B2
Application number	US-201113997640-A
Country	US
Kind code	B2
Filing date	Dec 23, 2011
Priority date	Dec 23, 2011
Publication date	Jul 9, 2019
Grant date	Jul 9, 2019

Abstract

A mechanism to provide visual feedback regarding computing system command gestures. An embodiment of an apparatus includes a sensing element to sense a presence or movement of a user of the apparatus, a processor, wherein operation of the processor includes interpretation of command gestures of a user to provide input to the apparatus; and a display screen, the apparatus to display one or more icons on the display screen, the one or more icons being related to the operation of the apparatus. The apparatus is to display visual feedback for a user of the apparatus, visual feedback including a representation of one or both hands of the user while the one or both hands are within a sensing area for the sensing element.

First claim

What is claimed is:

1. An apparatus comprising:
a sensing element to sense a presence or movement of a user of the apparatus;
a processor, wherein the processor to perform interpretation of user intent relating to the movement of the user, wherein the user movement includes moving of a body part of the user, wherein the body part includes one or more hands of the user, wherein the movement represents a gesture and the interpretation of the user intent to determine a user input intended by the gesture being communicated to the apparatus, the user input seeking a desired result; and
a display screen to display visual feedback of the movement based on the user intent, wherein the visual feedback provides a visual representation of the body part or the movement such that the visual feedback is presented by light points of multiple levels of brightness offering one or more icons representing the one or more hands of the user,
wherein the visual feedback of the one or both hands of the user includes a visual feedback of one or more tips of one or more fingers of the one or more hands of the user, the one or more tips represented by light points changing in levels of brightness based on changes of user intent, and wherein the multiple levels of brightness are based on orientation of the one or more hands in relation to the display screen.

2. The apparatus of claim 1 , wherein the visual feedback provides an illustration of a position of the one or more hands of the user in relation to one or more symbols on the display screen.

3. The apparatus of claim 2 , wherein the visual feedback of the one or more hands of the user includes a trail following the one or more tips of the one or more fingers when the one or more hands of the user move in space.

4. The apparatus of claim 3 , wherein the visual feedback includes a representation of tips of a thumb and another finger or fingers of a hand to provide for zooming in or out from an image.

5. The apparatus of claim 3 , wherein the visual feedback of the one or more hands of the user includes a “C” shape representing a gesture of a first hand of the user including a thumb in a curved posture and one or more other fingers in a curved posture, where tips of the thumb and the one or more other fingers are not in contact with each other.

6. The apparatus of claim 5 , wherein the “C” shape is to surround at least a part of an icon when the first hand of the user is in a position for selecting the icon.

7. The apparatus of claim 3 , wherein the visual feedback of the one or more hands of the user includes a shape representing a loop gesture of a first hand of the user to obtain information, wherein the loop gesture includes a thumb in a curved posture and one or more other fingers in a curved posture, where tips of the thumb and the one or more other fingers are in contact with each other.

8. The apparatus of claim 7 , wherein the representation is a loop or magnifying glass.

9. The apparatus of claim 7 , wherein the visual feedback is to surround at least in part of an icon, and the apparatus is to display information connected with an element represented by the icon.

10. The apparatus of claim 9 , wherein the visual feedback further includes an indication to choose an option regarding the displayed information connected with the element represented by the icon.

11. A method comprising:
sensing a presence or movement of a user of the apparatus;
performing interpretation of user intent relating to the movement of the user,
wherein the user movement includes moving of a body part of the user, wherein the body part includes one or more hands of the user, wherein the movement represents a gesture and the interpretation of the user intent to determine a user input intended by the gesture being communicated to the apparatus, the user input seeking a desired result; and

displaying visual feedback of the movement based on the user intent, wherein the visual feedback provides a visual representation of the body part or the movement such that the visual feedback is presented by light points of multiple levels of brightness offering one or more icons representing the one or more hands of the user,
wherein the visual feedback of the one or both hands of the user includes a visual feedback of one or more tips of one or more fingers of the one or more hands of the user, the one or more tips represented by light points changing in levels of brightness based on changes of user intent, and wherein the multiple levels of brightness are based on orientation of the one or more hands in relation to the display screen.

12. The method of claim 11 , wherein the visual feedback provides an illustration of a position of the one or more hands of the user in relation to one or more symbols on the display screen.

13. The method of claim 12 , wherein the visual feedback of the one or more hands of the user includes a trail following the one or more tips of the one or more fingers when the one or more hands of the user move in space.

14. The method of claim 13 , wherein the visual feedback includes a representation of tips of a thumb and another finger or fingers of a hand to provide for zooming in or out from an image.

15. The method of claim 13 , wherein the visual feedback of the one or more hands of the user includes a “C” shape representing a gesture of a first hand of the user including a thumb in a curved posture and one or more other fingers in a curved posture, where tips of the thumb and the one or more other fingers are not in contact with each other.

16. The method of claim 15 , wherein the “C” shape is to surround at least a part of an icon when the first hand of the user is in a position for selecting the icon.

17. The method of claim 13 , wherein the visual feedback of the one or more hands of the user includes a shape representing a loop gesture of a first hand of the user to obtain information, wherein the loop gesture includes a thumb in a curved posture and one or more other fingers in a curved posture, where tips of the thumb and the one or more other fingers are in contact with each other.

18. The method of claim 17 , wherein the representation is a loop or magnifying glass.

19. The method of claim 17 , wherein the visual feedback is to surround at least in part of an icon, and the apparatus is to display information connected with an element represented by the icon.

20. The method of claim 19 , wherein the visual feedback further includes an indication to choose an option regarding the displayed information connected with the element represented by the icon.

21. A non-transitory computer-readable storage medium having stored thereon data representing sequences of instructions that, when executed by a processor, cause the processor to perform operations comprising:
sensing a presence or movement of a user of the apparatus;
performing interpretation of user intent relating to the movement of the user,
wherein the user movement includes moving of a body part of the user, wherein the body part includes one or more hands of the user, wherein the movement represents a gesture and the interpretation of the user intent to determine a user input intended by the gesture being communicated to the apparatus, the user input seeking a desired result; and

displaying visual feedback of the movement based on the user intent, wherein the visual feedback provides a visual representation of the body part or the movement such that the visual feedback is presented by light points of multiple lev

Assignees

• Mongia Rajiv
• Bhowmik Achintya
• Yahiro Mark
• Krieger Dana
• Mangum Ed
• Povieng Diana
• Intel Corp

Inventors

• Mongia Rajiv
• Bhowmik Achintya
• Yahiro Mark
• Krieger Dana
• Mangum Ed
• Povieng Diana

Classifications

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• G06F3/04895

  Guidance during keyboard input operation, e.g. prompting · CPC title

• G06F3/04812

  Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects · CPC title

• G06F2203/04806

  Zoom, i.e. interaction techniques or interactors for controlling the zooming operation · CPC title