Adjusting motion capture based on the distance between tracked objects

Patent metadata

Field	Value
Publication number	US-9762792-B2
Application number	US-201615385580-A
Country	US
Kind code	B2
Filing date	Dec 20, 2016
Priority date	Feb 22, 2013
Publication date	Sep 12, 2017
Grant date	Sep 12, 2017

Abstract

The technology disclosed relates to adjusting the monitored field of view of a camera and/or a view of a virtual scene from a point of view of a virtual camera based on the distance between tracked objects. For example, if the user's hand is being tracked for gestures, the closer the hand gets to another object, the tighter the frame can become—i.e., the more the camera can zoom in so that the hand and the other object occupy most of the frame. The camera can also be reoriented so that the hand and the other object remain in the center of the field of view. The distance between two objects in a camera's field of view can be determined and a parameter of a motion-capture system adjusted based thereon. In particular, the pan and/or zoom levels of the camera may be adjusted in accordance with the distance.

First claim

What is claimed is:

1. A method of controlling a camera using a distance of two objects in a 3D monitored space, the method including:
identifying from images captured by the camera first and second objects present in the 3D monitored space, wherein the first and second objects are at least partially within a field of view of the camera;
repeatedly calculating spatial coordinates for the first and second objects present in the 3D monitored space based upon the images captured by the camera and calculating a calculated distance between the first and second objects in space from the spatial coordinates; and
responsive to the calculated distance, adjusting a camera parameter; whereby the camera is enabled to capture additional images of the first and second objects moving in space relative to the camera.

2. The method of claim 1 , further including:
establishing a threshold value to be set for the calculated distance;
detecting the threshold value is crossed by the calculated distance; and
responsive to detecting the threshold value is crossed, performing the adjusting on the camera parameter continuously, after the threshold value is reached.

3. The method of claim 1 , further including:
using a filter to eliminate spurious changes in the calculated distance detected in the images.

4. The method of claim 1 , wherein the adjusting includes:
adjusting a zoom of the camera based at least in part upon the calculated distance.

5. The method of claim 1 , wherein the adjusting includes:
adjusting a focal length of the camera based at least in part upon the calculated distance.

6. The method of claim 1 , wherein the adjusting includes:
moving the field of view of the camera responsive to the calculated distance.

7. The method of claim 1 , further including identifying first and second objects as objects to be tracked responsive to selection of the first and second objects by a touch gesture.

8. The method of claim 1 , further including identifying first and second objects as objects to be tracked responsive to changing distance between first and second objects.

9. The method of claim 1 , wherein the first object is a first finger of a hand of a user and the second object is another finger of the hand of the user.

10. The method of claim 1 , wherein the first object is a hand of a user and the second object is another hand of the user.

11. The method of claim 1 , wherein the first object is a hand of a user and the second object is a fixed object.

12. The method of claim 1 , wherein the first object is a hand of a user and the second object is a moving object.

13. The method of claim 1 , further including receiving a specification from a user for reference points on the objects dependent on which distance between the objects is calculated.

14. The method of claim 1 , further including:
determining a rate of change for the calculated distance; and
altering the camera parameter responsive to the rate of change of the calculated distance.

15. The method of claim 1 , further including:
calculating distance between the objects and the camera; and
responsive to the calculated distance between the objects and the camera, altering the camera parameter.

16. A non-transitory computer readable storage medium impressed with computer program instructions to control a virtual camera responsive to distance between two objects in a 3D monitored space, which computer program instructions, when executed on a processor, implement a method including:
identifying first and second objects physically present in a field of view of a real world camera from images captured by the real world camera of the 3D monitored space;
repeatedly calculating spatial coordinates for the first and second objects physically present in the 3D monitored space based upon the images captured by the real world camera and calculating a calculated distance between the first and second objects from the spatial coordinates; and
responsive to the calculated distance between the first and second objects physically present in a field of view of the real world camera, altering a view of a virtual scene from a point of view of the virtual camera.

17. The non-transitory computer readable storage medium of claim 16 , implementing the method further including moving the view of the virtual scene responsive to the calculated distance.

18. The non-transitory computer readable storage medium of claim 16 , implementing the method further including narrowing the view of the virtual scene responsive to reduction in the calculated distance.

19. The non-transitory computer readable storage medium of claim 16 , implementing the method further including widening the view of the virtual scene responsive to increase in the calculated distance.

20. The non-transitory computer readable storage medium of claim 16 , implementing the method further including adjusting size of virtual elements in the virtual scene responsive to the calculated distance.

21. The non-transitory computer readable storage medium of claim 16 , implementing the method further including adjusting shape of virtual elements in the virtual scene responsive to the calculated distance.

22. The non-transitory computer readable storage medium of claim 16 , implementing the method further including adjusting responsiveness of virtual elements in the virtual scene responsive to the calculated distance.

23. The non-transitory computer readable storage medium of claim 16 , implementing the method further including:
responsive to reduction in the calculated distance, altering responsiveness of one or more virtual elements to gestures by the first or second object such that the gestures more precisely control the virtual elements.

24. The non-transitory computer readable storage medium of claim 23 , implementing the method further including, responsive to increase in the calculated distance, altering responsiveness of one or more virtual elements to gestures by the first or second object; wherein the gestures by the first or second object more coarsely control the virtual elements.

25. The non-transitory computer readable storage medium of claim 23 , implementing the method further including increasing responsiveness of the virtual elements responsive to increase in the calculated distance.

26. The non-transitory computer readable storage medium of claim 23 , implementing the method further including decreasing responsiveness of the virtual elements responsive to reduction in the calculated distance.

Assignees

• Leap Motion Inc

Inventors

• Holz David S

Classifications

• H04N23/611 Primary

  where the recognised objects include parts of the human body · CPC title

• G06V40/28 Primary

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• G06T2207/30196

  Human being; Person · CPC title

• G06T7/50

  Depth or shape recovery · CPC title