Automatic projection focusing

Patent metadata

Field	Value
Publication number	US-9759994-B1
Application number	US-201514949276-A
Country	US
Kind code	B1
Filing date	Nov 23, 2015
Priority date	Sep 12, 2012
Publication date	Sep 12, 2017
Grant date	Sep 12, 2017

Abstract

Techniques are described for performing automatic focusing of a projected image on a mobile projection surface. Specific regions of the projected image are identified that are likely to be desired to stay in optimal focus, and attributes of those specific regions, such as sharpness and contrast, can be used to determine the need to refocus the image. Advanced knowledge of the image data being projected can be utilized to determine the specific regions of the projected image that require monitoring for optimal focusing.

First claim

What is claimed is:

1. A system comprising:
one or more processors;
a camera;
a projector; and
one or more non-transitory computer-readable storage media storing computer-executable instructions that are executable by the one or more processors to cause the one or more processors to:
cause the projector to project an image on a surface;
capture image information of the image, the image information representative of one or more objects within the image;
determine motion information associated with the image based at least in part on the image information;
determine, based at least in part upon the motion information, a region in the image for monitoring;
detect that a change in an image attribute associated with the region meets or exceeds a first threshold; and
adjust a focus parameter of the projector and project the image on the surface using the focus parameter, the focus parameter including at least one of a position setting or a motor setting of the projector.

2. The system of claim 1 , wherein the instructions are further executable to:
determine the region in the image based at least in part upon review of data captured by one or more sensors and associated with the surface.

3. The system of claim 2 , wherein the instructions are further executable to:
determine estimated motion for an object of the one or more objects depicted in the image based upon image data associated with the image; and
determine the region based at least in part upon the estimated motion.

4. The system of claim 1 , wherein the instructions are further executable to:
project a plurality of images on the surface, the plurality of images including the image;
determine motion of an object of the one or more objects within the region of each of the plurality of images;
determine that an amount of the motion is less than a second threshold; and
determine the region, based at least in part upon the amount of the motion being less than the second threshold.

5. The system of claim 1 , wherein the instructions are further executable to, after adjusting the focus parameter:
change the first threshold to a third threshold for the region.

6. The system of claim 1 , wherein the instructions are further executable to, after adjusting the focus parameter:
change a frequency of monitoring the region.

7. The system of claim 1 , wherein the instructions are further executable to:
determine that the image is distorted by the surface;
establish a baseline distortion of the image;
establish a second threshold based at least in part on the baseline distortion; and
detect that a second change in the image attribute associated with the region meets or exceeds the second threshold.

8. A method comprising:
under control of one or more computer systems configured with executable instructions;
projecting an image on a surface;
capturing data associated with the image;
selecting a region associated with the image to be monitored;
detecting a change in an image attribute of the image within the region, the change greater than a threshold associated with the image attribute; and
adjusting a focus of a projector based at least in part on the threshold being met or exceeded.

9. The method of claim 8 , further comprising:
adjusting the threshold based at least in part on the adjusting of the focus of the projector.

10. The method of claim 8 , further comprising:
monitoring the region at periodic time intervals.

11. The method of claim 8 , further comprising:
determining that the projected image is distorted by an amount; and
adjusting the threshold based at least in part on the amount.

12. The method of claim 8 , further comprising:
changing a time interval associated with periodic monitoring of the region.

13. The system of claim 8 , further comprising:
projecting a light pattern on the surface; and
determining the region based at least in part on data captured by one or more sensors associated with the light pattern projected on the surface.

14. A computing device comprising:
one or more processors;
a sensor to capture image data;
a projector to project an image onto a surface; and
one or more non-transitory computer-readable storage media storing computer-executable instructions that are executable by the one or more processors to cause the one or more processors to:
determine, from the image data, a region in the image that is to be monitored; and
adjust an attribute of the image based at least in part on detecting a reduction in image quality greater than or equal to the threshold.

15. The computing device of claim 14 , wherein the surface is a portable display medium and the instructions are further executable to:
track a movement of the portable display medium; and
cause the projector to continually project the image on the portable display medium.

16. The computing device of claim 15 , further comprising adjust a focus parameter of the projector to adjust the attribute, the focus parameter including at least one of a position setting or a motor setting of the projector.

17. The computing device of claim 16 , wherein the instructions are further executable to:
cause the sensor to capture the image data at periodic intervals.

18. The computing device of claim 14 , wherein the instructions are further executable to:
cause the projector to project a light pattern on the surface; and
determine the region based at least in part upon analyzing image data associated with the light pattern.

19. The computing device of claim 14 , wherein the sensor includes at least one of:
one or more image sensors;
one or more cameras;
one or more microphones;
one or more ultrasound transducers;
one or more heat sensors;
one or more motion detectors; or
one or more depth sensing cameras.

20. The computing device of claim 14 , wherein the instructions are further executable to:
adjust the threshold based at least in part on the adjusting the attribute.

Assignees

• Amazon Tech Inc

Inventors

• Soyannwo Olusanya Temitope
• Yan Renwei
• Crump Edward Dietz
• Wang Weijian
• Chang Samuel Henry
• Yao Ning

Classifications

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• H04N9/3194

  including sensor feedback · CPC title

• G02B27/0101

  characterised by optical features (G02B27/0172 takes precedence) · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title