Self stabilizing projector

Patent metadata

Field	Value
Publication number	US-9843689-B1
Application number	US-201313957191-A
Country	US
Kind code	B1
Filing date	Aug 1, 2013
Priority date	Aug 1, 2013
Publication date	Dec 12, 2017
Grant date	Dec 12, 2017

Abstract

A mobile device for projecting images on a surface and for maintaining a position of the image on the surface. The device including an image rendering module to scan the surface and to modify the image based on data obtained about a three dimensional nature of the surface. The device further including an optical image stabilization to adjust an alignment of the projector based on orientation data of the device, an electronic image stabilization module to shift the image within a projection area based on the orientation data and an image-tracking module to shift the image within the projection area based on changes in a relative positions of the image and a target.

First claim

What is claimed is:

1. A mobile device comprising:
at least one camera;
an inertial sensor;
a projector;
one or more actuators coupled to the projector to adjust an alignment of the projector;
a surface selection module configured to identify a projection surface using first data captured by the at least one camera, the first data providing three-dimensional information about points on the projection surface, wherein the three-dimensional information for an individual point on the projection surface provides a depth, an orientation and a contour for the individual point;
an image rendering module configured to receive an image and modify the image based at least in part on the first data, the modifying causing the image to appear undistorted when projected by the projector on the projection surface;
an image stabilization module configured to receive motion data from the inertial sensor and to stabilize the image on the projection surface by compensating for movement of the mobile device; and
an image-tracking module configured to
receive second data captured by the at least one camera,
detect a change in position of the image on the projection surface based, at least in part, on the second data, and
shift the image within a window of the projector, the shifting to maintain the image on the projection surface.

2. The mobile device as recited in claim 1 , wherein the one or more actuators comprise voice coils.

3. The mobile device as recited in claim 1 , wherein the one or more actuators are coupled to a lens of the projector, and the one or more actuators adjust an alignment of the lens.

4. The mobile device as recited in claim 1 , wherein the image rendering module is implemented in software.

5. The mobile device as recited in claim 1 , wherein the image stabilization module is an optical image stabilization module.

6. A method comprising:
under control of a mobile device configured with executable instructions,
obtaining three-dimensional data for points on a surface of a scene, wherein the three-dimensional data for an individual point provides a depth, an orientation and a contour for the individual point;
selecting a portion of a projection surface using the three-dimensional data of the scene;
modifying an image using the three-dimensional data to cause the image to appear undistorted on the portion of the projection surface; and
projecting the image onto the portion of the projection surface.

7. The method as recited in claim 6 , further comprising:
receiving data related to movement of the mobile device from an inertial sensor; and
adjusting a position of the image using an electronic image stabilization module.

8. The method as recited in claim 6 , further comprising:
receiving data related to a movement of the mobile device from an inertial sensor;
adjusting a position of the image using an optical image stabilization module, wherein the optical image stabilization module causes one or more actuators to adjust a position of a projector of the mobile device.

9. The method as recited in claim 8 , wherein the one or more actuators adjust a position of a lens of the projector.

10. The method as recited in claim 6 , further comprising:
identifying a target in the scene; and
wherein the image includes information about the target.

11. The method as recited in claim 10 , wherein the target is a physical object within the scene.

12. The method as recited in claim 10 , wherein the target is a bar code.

13. The method as recited in claim 10 , wherein the information is descriptive textual information about the target.

14. The method as recited in claim 6 , wherein obtaining three-dimensional data of a scene comprises: projecting a pattern onto the projection surface; and
capturing visual information related to the projection surface, the visual information including a distortion of the pattern caused by projecting the pattern onto the projection surface.

15. The method as recited in claim 6 , further comprising:
tracking a relative position of the image on the projection surface;
detecting a change in the position; and
adjusting the image to maintain the position of the image on the projection surface.

16. One or more non-transitory computer-readable media having computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
obtaining three-dimensional data for points on a surface of a scene, wherein the three-dimensional data for an individual point provides a depth of the individual point;
selecting a portion of a projection surface using the three-dimensional data of the scene;
modifying an image using the three-dimensional data to cause the image to appear undistorted on the portion of the projection surface; and
projecting the image onto the portion of the projection surface.

17. The one or more computer-readable media as recited in claim 16 , further comprising:
capturing data related to a movement of a projector projecting the image;
determining an adjustment to apply to the image based on the data related to the movement; and
modulating the image based on the adjustment to maintain a location of the image on the projection surface, the modulating including adjusting a position of the image within a virtual projection window.

18. The one or more computer-readable media as recited in claim 16 , further comprising:
capturing data related to a movement of a projector projecting the image;
determining an adjustment to apply to a lens of the projector based on the data related to the movement; and
causing one or more actuators to apply the adjustment to the lens.

19. The one or more computer-readable media as recited in claim 16 , further comprising:
tracking a position of the image on the projection surface;
detecting a change in the position; and
includes adjusting the position of the image within the virtual projection window in a substantially opposite direction of the change to maintain the location of the image on the projection surface.

20. The one or more computer-readable media as recited in claim 16 , further comprising:
identifying an object on the surface; and
wherein the image includes information related to the object.

Assignees

• Amazon Tech Inc

Inventors

• Heller Geoffrey Scott
• Yuan Chang

Classifications

• H04N1/00267 Primary

  with a viewing or projecting apparatus, e.g. for reading image information from a film (H04N1/00262 takes precedence) · CPC title

• G01B11/2513

  with several lines being projected in more than one direction, e.g. grids, patterns · CPC title

• G01B11/24

  for measuring contours or curvatures · CPC title

• H04N9/3185

  Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14) · CPC title

• H04M2250/52

  including functional features of a camera · CPC title