Method to control perspective for a camera-controlled computer

Patent metadata

Field	Value
Publication number	US-9910509-B2
Application number	US-201615352080-A
Country	US
Kind code	B2
Filing date	Nov 15, 2016
Priority date	May 1, 2009
Publication date	Mar 6, 2018
Grant date	Mar 6, 2018

Abstract

Systems, methods and computer readable media are disclosed for controlling perspective of a camera-controlled computer. A capture device captures user gestures and sends corresponding data to a recognizer engine. The recognizer engine analyzes the data with a plurality of filters, each filter corresponding to a gesture. Based on the output of those filters, a perspective control is determined, and a display device displays a new perspective corresponding to the perspective control.

First claim

What is claimed:

1. A method for changing a perspective of a virtual scene displayed on a display device, comprising:
receiving data captured by a capture device, the capture device capturing movement or position of at least part of a first user relative to a display device and movement or position of at least part of an object controlled by the first user relative to the display device;
analyzing the data to determine that the at least part of the first user or the object moved in a direction relative to the display device and to determine a location formed based at least upon a combination of a position of the first user relative to the display device and a position of the object relative to the display device; and
based at least upon determining that the at least part of the first user or the object moved in the direction relative to the display device and determining the location formed based at least upon the combination of the position of the first user relative to the display device and the position of the object relative to the display device, modifying the perspective of the virtual scene displayed on the display device by moving the perspective of the virtual scene to the location formed based at least upon the combination of the position of the first user relative to the display device and the position of the object relative to the display device and in the direction that the at least part of the first user or the object moved.

2. The method of claim 1 , wherein analyzing the data to determine that the at least part of the first user or the object moved in the direction relative to the display device comprises determining that the at least part of the first user or the object moved to the first user's left; and
wherein modifying the perspective of the virtual scene comprises moving the perspective of the virtual scene to the first user's left.

3. The method of claim 1 , further comprising:
magnifying a text displayed on the display device in response to determining that the at least part of the first user has moved away from the display device.

4. The method of claim 3 , further comprising:
maintaining a size of at least a portion of the virtual scene while magnifying the text.

5. The method of claim 3 , further comprising:
maintaining a size of a second text while magnifying the text.

6. The method of claim 1 , further comprising:
shrinking a text displayed on the display device in response to determining that the at least part of the first user has moved closer to the display device.

7. The method of claim 1 , wherein determining the location formed based at least upon a combination of the position of the first user relative to the display device and the position of the object relative to the display device comprises determining a mid-point between the position of the first user relative to the display device and the position of the second user relative to the display device.

8. A system for changing a perspective of a virtual scene displayed on a display device, comprising:
a processor; and
a memory communicatively coupled to the processor when the system is operational, the memory bearing processor-executable instructions that, based at least on the processor, cause the system at least to:
receive data captured by a capture device, the capture device capturing movement or position of at least part of a first user relative to a display device and movement or position of at least part of an object controlled by the first user relative to the display device;
analyze the data to determine that the at least part of the first user or the object moved in a direction relative to the display device and to determine a location formed based at least upon a combination of a position of the first user relative to the display device and a position of the object relative to the display device; and
based at least upon determining that the at least part of the first user or the object moved in the direction relative to the display device and determining the location formed based at least upon the combination of the position of the first user relative to the display device and the position of the object relative to the display device, modify the perspective of the virtual scene displayed on the display device by moving the perspective of the virtual scene to the location formed based at least upon the combination of the position of the first user relative to the display device and the position of the object relative to the display device and in the direction that the at least part of the user or the object moved.

9. The system of claim 8 , wherein determining the location formed based at least upon the combination of the position of the first user relative to the display device and the position of the object relative to the display device comprises determining an average location based at least upon the position of the first user relative to the display device and the position of the object relative to the display device.

10. The system of claim 8 , wherein determining the location formed based at least upon the combination of the position of the first user relative to the display device and the position of the object relative to the display device comprises determining a mid-point between the position of the first user relative to the display device and the position of the object relative to the display device.

11. The system of claim 9 , wherein the instructions that, when executed on the processor, cause the system at least to determine a location formed based at least upon a combination of a position of the first user relative to the display device and a position of the object relative to the display device further cause the system at least to:
display a perspective based on the position of the at least part of the first user overlaid with a perspective based on the position of the object.

12. The system of claim 11 , wherein the perspective based on the position of the at least part of the first user and the perspective based on the position of the object are each tinted with a unique color.

13. The system of claim 11 , wherein one of the perspective based on the position of the at least part of the first user and the perspective based on the position of the object are each tinted comprises an infrared image and the other comprises a color image.

14. The system of claim 8 , wherein the data captured by the capture device indicates a position of a second user, and the memory further bears processor-executable instructions that, when executed on the processor, cause the system at least to:
magnify a text displayed on the display device in response to determining that the at least part of the first user has moved away from the display device.

15. A computer-readable storage device that is not a propagating signal, the computer-readable storage device bearing computer-executable instructions that, when executed on the computer, cause the computer to perform operations comprising:
receiving data captured by a capture device, the capture device capturing movement or position of at least part of a first user or an object controlled by the first user relative to a display device and movement or position of at least part of an object controlled by the first user relative to the display device;
analyzing the data to determine that the at least part of the user or the object moved in a direction relative to the display device and to determine a location formed based at least upon a combination of a position of the first user relative to the display device and a position of the object relative to the display device;

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Markovic Relja
• Snook Gregory N
• Latta Stephen
• Geisner Kevin
• Lee Johnny
• Langridge Adam Jethro

Classifications

• G06T3/40

  Scaling of whole images or parts thereof, e.g. expanding or contracting · CPC title

• A63F13/213

  comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence) · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title