Opportunistic structured light

Patent metadata

Field	Value
Publication number	US-10132620-B2
Application number	US-201715640140-A
Country	US
Kind code	B2
Filing date	Jun 30, 2017
Priority date	May 13, 2013
Publication date	Nov 20, 2018
Grant date	Nov 20, 2018

Abstract

A method for using structured light in a handheld projection device is provided that includes projecting a structured light pattern in at least one portion of a frame being projected by the handheld projection device, wherein the at least one portion of the frame is a subset of the frame, capturing an image of the projected frame, computing scene depth information based on the structured light pattern in the captured image, and using the scene depth information in processing of a subsequent frame of the video stream.

First claim

What is claimed is:

1. A method for using structured light in a handheld projection device, the method comprising:
projecting a structured light pattern in at least one portion of a frame being projected by the handheld projection device, wherein the at least one portion of the frame is a subset of the frame;
capturing an image of the projected frame;
computing scene depth information based on the structured light pattern in the captured image; and
using the scene depth information in processing of a subsequent frame of the video stream.

2. The method of claim 1 , wherein using the scene depth information comprises using the scene depth information to perform keystone correction on a next projected frame.

3. The method of claim 1 , wherein the at least one portion of a frame is a boundary of the frame.

4. The method of claim 2 , wherein the at least one portion of a frame comprises boundary pixels determined based on a location of keystone distortion in the frame.

5. The method of claim 1 , further comprising determining a location of the at least one portion of the frame based on distortion in the frame caused by encoding the frame in an encoded video stream.

6. The method of claim 5 , wherein determining a location comprises estimating distortion in one or more contiguous blocks of the frame based on quantization parameters of the blocks signaled in the encoded video stream.

7. The method of claim 5 , wherein determining a location comprises estimating distortion in one or more contiguous blocks of the frame based on boundary strength of a deblocking filter.

8. The method of claim 5 , wherein determining a location comprises estimating distortion in one or more contiguous blocks of the frame based on differences between motion vectors of neighboring blocks.

9. The method of claim 5 , wherein determining a location comprises decoding indicators of regions of high distortion signaled in the encoded video stream.

10. The method of claim 1 , wherein determining a location comprises determining a location of the at least one portion of the frame based on luminance.

11. A handheld projection device configured to used structured light, the device comprising:
a projector for projecting a structured light pattern in at least one portion of a frame being projected by the projector, wherein the at least one portion of the frame is a subset of the frame;
a camera for capturing an image of the projected frame;
means for computing scene depth information based on the structured light pattern in the captured image; and
means for using the scene depth information in processing of a subsequent frame of the video stream.

12. The handheld projection device of claim 11 , wherein the means for using the scene depth information uses the scene depth information to perform keystone correction on a next projected frame.

13. The handheld projection device of claim 11 , wherein the at least one portion of a frame is a boundary of the frame.

14. The handheld projection device of claim 13 , wherein the at least one portion of a frame comprises boundary pixels determined based on a location of keystone distortion in the frame.

15. The handheld projection device of claim 11 , further comprising means for determining a location of the at least one portion of the frame based on distortion in the frame caused by encoding the frame in an encoded video stream.

16. The handheld projection device of claim 15 , wherein the means for determining a location estimates distortion in one or more contiguous blocks of the frame based on quantization parameters of the blocks signaled in the encoded video stream.

17. The handheld projection device of claim 15 , wherein the means for determining a location comprises estimates distortion in one or more contiguous blocks of the frame based on boundary strength of a deblocking filter.

18. The handheld projection device of claim 15 , wherein the means for determining a location estimates distortion in one or more contiguous blocks of the frame based on differences between motion vectors of neighboring blocks.

19. The handheld projection device of claim 15 , wherein the means for determining a location decodes indicators of regions of high distortion signaled in the encoded video stream.

20. The handheld projection device of claim 11 , wherein the means for determining a location determines a location of the at least one portion of the frame based on luminance.

Assignees

• Texas Instruments Inc

Inventors

• Sze Vivienne
• Dedeoglu Goksel
• Sharma Vinay

Classifications

• G01B11/25 Primary

  by projecting a pattern, e.g. {one or more lines,} moiré fringes on the object (G01B11/255 takes precedence {; image analysis for depth or shape recovery G06T7/50}) · CPC title