Feedback for object pose tracker

Patent metadata

Field	Value
Publication number	US-10218882-B2
Application number	US-201514985854-A
Country	US
Kind code	B2
Filing date	Dec 31, 2015
Priority date	Dec 31, 2015
Publication date	Feb 26, 2019
Grant date	Feb 26, 2019

Abstract

A computing device has an input configured to receive data captured by at least one capture device where the data depicts at least part of an object moving in an environment. The computing device has a tracker configured to track a real-world position and orientation of the object using the captured data. A processor at the computing device is configured to compute and output feedback about performance of the tracker, where the feedback encourages a user to adjust movement of the object for improved tracking of the object by the tracker.

First claim

The invention claimed is:

1. A computing device comprising:
a processor; and
a storage device comprising instructions, which when executed by the processor, configure the processor to:
receive data captured by at least one capture device, the data depicting a first object in an environment;
track, using a tracker, a real-world position and orientation of the first object in a tracking volume using the captured data and wherein the tracker is configured to track a real-world position of a second object in the environment; and
compute and output feedback about performance of the tracker, where the feedback encourages a user to move the first object for improved tracking of the object by the tracker and wherein the feedback is computed by applying an offset or a non-linear mapping to pose parameters of the first object and the second object.

2. The computing device of claim 1 where the processor is configured to compute the tracking volume, wherein the tracking volume is a region of real-world space in the environment for which the tracker is able to track objects anywhere in the tracking volume.

3. The computing device of claim 2 where the processor is configured to compute the tracking volume on the basis a view frustum of the at least one capture device and view frusta of any other capture devices providing input to the tracker.

4. The computing device of claim 2 where the feedback comprises an indication of the tracking volume where the indication is output using any one or more of:
a loudspeaker, a visual display, a haptic output device.

5. The computing device of claim 4 where the indication is output when the tracked first object comes within a threshold distance of a boundary of the tracking volume.

6. The computing device of claim 1 which is a virtual reality computing device or an augmented-reality computing device and where the processor is configured to display the tracked first object as a virtual object at a display location.

7. The computing device of claim 6 where the processor is configured to compute pose parameters for the display location which do not correspond to the tracked real-world position.

8. The computing device of claim 6 where the processor is configured to compute pose parameters for the display location using a non-linear mapping of the real-world position.

9. The computing device of claim 6 where the processor is configured to compute pose parameters for the display location such that the display location appears closer to a boundary of the tracking volume than the real-world position is to the boundary of the tracking volume.

10. The computing device of claim 1 wherein the feedback is computed according to performance of the tracker in tracking both the first and second objects.

11. The computing device of claim 10 where the feedback is computed according to distance between the real-world positions of the first object and the second object.

12. The computing device of claim 11 where the feedback is computed such that the virtual objects appear closer together than the real-world positions of the first object and the second object.

13. The computing device of claim 1 where the tracker is configured to re-compute the real-world position using data captured by the at least one camera after the feedback has been output.

14. The computing device of claim 1 where the tracker is configured to track position and orientation of a plurality of joints of the first object.

15. The computing device of claim 1 where the tracker is configured to compute values of shape parameters of the first object.

16. A computer-implemented method comprising:
receiving data captured by at least one capture device, the data depicting a first object in an environment;
tracking, using a tracker, a real-world position of the first object in a tracking volume using the captured data and wherein the tracker is configured to track a real-world position of a second object in the environment; and
computing and outputting feedback about performance of the tracker, where the feedback encourages a user to move the object for improved tracking of the object by the tracker and wherein the feedback is computed by applying an offset or a non-linear mapping to pose parameters of the first object and the second object.

17. The method of claim 16 further comprising computing the feedback according to performance of the tracker in tracking both the first and second objects.

18. The method of claim 16 comprising re-computing the real-world position using data captured by the at least one capture device after the feedback has been output.

19. A computing device comprising:
a processor; and
a storage device comprising instructions, which when executed by the processor, configure the processor to:
receive data captured by at least one capture device, the data depicting an articulated object in an environment;
a tracker configured to track a real-world position and orientation of a plurality of joints of the articulated object in a tracking volume using the captured data and wherein the tracker is configured to track a real-world position of a second object in the environment; and
a processor configured to compute and output feedback about performance of the tracker, where the feedback encourages a user to move the articulated object for improved tracking of the articulated object by the tracker and wherein the feedback is computed by applying an offset or a non-linear mapping to pose parameters of the first object and the second object.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Shotton Jamie Daniel Joseph
• Fitzgibbon Andrew William
• Taylor Jonathan James
• Banks Richard Malcolm
• Sweeney David
• Corish Robert
• Sellen Abigail Jane
• SOTO Eduardo Alberto

Classifications

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06T2207/30196

  Human being; Person · CPC title