Gesture recognition techniques

Patent metadata

Field	Value
Publication number	US-9372544-B2
Application number	US-201414280140-A
Country	US
Kind code	B2
Filing date	May 16, 2014
Priority date	May 31, 2011
Publication date	Jun 21, 2016
Grant date	Jun 21, 2016

Abstract

In one or more implementations, a static geometry model is generated, from one or more images of a physical environment captured using a camera, using one or more static objects to model corresponding one or more objects in the physical environment. Interaction of a dynamic object with at least one of the static objects is identified by analyzing at least one image and a gesture is recognized from the identified interaction of the dynamic object with the at least one of the static objects to initiate an operation of the computing device.

First claim

What is claimed is:

1. A method implemented by a computing device, the method comprising:
identifying interaction of a dynamic object with at least one static object by analyzing depth data describing a physical environment captured using a sensor, the at least one static object modeling one or more physical objects in the physical environment using a static geometry model generated from the depth data; and
recognizing a gesture from the identified interaction of the dynamic object with the at least one static object to initiate an operation of the computing device.

2. A method as described in claim 1 , wherein the identified interaction includes identifying contact between the dynamic object and the at least one of the static objects by analyzing the data.

3. A method as described in claim 1 , wherein the at least one image is captured subsequent to the one or more images that were used to generate the static geometry model.

4. A method as described in claim 1 , wherein at least one of the static objects is a body part of a user.

5. A method as described in claim 4 , wherein the at least one static object is a hand of the user and the dynamic object is another hand of the user.

6. A method as described in claim 1 , wherein the sensor is a camera and the data includes images captured by the camera.

7. A method as described in claim 1 , wherein the operation is to form a communication that identifies the gesture for communicating to another computing device to initiate another operation of the other computing device.

8. A method implemented by a computing device, the method comprising:
identifying contact between a dynamic object and at least one static object by analyzing data captured using a sensor that describes a physical environment, the at least one static object modeling one or more objects in the physical environment; and
recognizing a gesture from the identified contact of the dynamic object with the at least one static object to initiate an operation of the computing device.

9. A method as described in claim 8 , wherein the at least one image is captured subsequent to the one or more images that were used to generate the static geometry model.

10. A method as described in claim 8 , wherein at least one of the static objects is a body part of a user.

11. A method as described in claim 10 , wherein the at least one static object is a hand of the user and the dynamic object is another hand of the user.

12. A method as described in claim 8 , wherein the sensor is a camera and the data includes images captured by the camera.

13. A method as described in claim 8 , wherein the operation is to form a communication that identifies the gesture for communicating to another computing device to initiate another operation of the other computing device.

14. An apparatus comprising:
a camera configured to capture depth data of a physical environment of the camera and included within a housing that is configured to be held by a user; and
one or more modules communicatively coupled to the camera and implemented at least partially in hardware, the one or more modules configured to perform operations comprising:
identifying interaction of a dynamic object with at least one static object by analyzing the depth data describing the physical environment, the at least one static object modeling one or more physical objects in the physical environment using a static geometry model generated from the depth data; and
recognizing a gesture from the identified interaction of the dynamic object with the at least one static object to initiate an operation of the computing device.

15. An apparatus as described in claim 14 , wherein the identified interaction includes identifying contact between the dynamic object and the at least one of the static objects by analyzing the data.

16. An apparatus as described in claim 14 , wherein the at least one image is captured subsequent to the one or more images that were used to generate the static geometry model.

17. An apparatus as described in claim 14 , wherein at least one of the static objects is a body part of a user.

18. An apparatus as described in claim 17 , wherein the at least one static object is a hand of the user and the dynamic object is another hand of the user.

19. An apparatus as described in claim 14 , wherein the depth data includes images captured by the camera.

20. An apparatus as described in claim 14 , wherein the operation is to form a communication that identifies the gesture for communicating to another computing device to initiate another operation of the other computing device.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Kim David
• Hilliges Otmar D
• Izadi Shahram
• Olivier Patrick L
• Shotton Jamie Daniel Joseph
• Kohli Pushmeet
• Molyneaux David G
• Hodges Stephen E
• Fitzgibbon Andrew W

Classifications

• G06T2207/30196

  Human being; Person · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title