Using micro mirrors to improve the field of view of a 3D depth map

Patent metadata

Field	Value
Publication number	US-10495735-B2
Application number	US-201715432674-A
Country	US
Kind code	B2
Filing date	Feb 14, 2017
Priority date	Feb 14, 2017
Publication date	Dec 3, 2019
Grant date	Dec 3, 2019

Abstract

A micro mirror assembly widens the field of view (FOV) of a 3D depth map sensor, alleviating the limitation of limited laser illumination power and limitations on the resolution of the available imaging device.

First claim

What is claimed is:

1. A device comprising:
at least one computer medium that is not a transitory signal and that comprises instructions executable by at least one processor to:
activate a laser on a first mobile apparatus to emit light;
move a micro mirror assembly to a first configuration to reflect the light onto a first area of an object distanced from the device and disposed on a surface on which the device is also disposed, the object comprising a second mobile apparatus and comprising a laser emitter configured to illuminate the first mobile apparatus to generate at least one image thereof;
receive, from at least one detector, a signal representing a reflection of the light from the first area;
determine a distance to the first area based at least in part on a time of receipt of the signal representing the reflection of the light from the first area;
move the micro mirror assembly to a second configuration to reflect the light onto a second area of the object;
receive from the detector a signal representing a reflection of the light from the second area;
determine a distance to the second area based at least in part on a time of receipt of the signal representing the reflection of the light from the second area; and
generate a three dimensional (3D) depth map of the object at least in part using the distances to the first and second areas.

2. The device of claim 1 , comprising the at least one processor.

3. The device of claim 1 , wherein the micro mirror assembly includes a laser bar code scanner-like mechanism to widen a field of view (FOV) of the detector.

4. The device of claim 1 , wherein the instructions are executable to determine the distance to the first area at least in part by determining a time of flight (TOF) between a time of light transmission and a time of reflection reception.

5. The device of claim 1 , wherein the micro mirror assembly includes a Digital Light Processing (DLP) array-like mechanism.

6. The device of claim 1 , wherein the detector has a field of view (FOV) and the instructions are executable to move the micro mirror assembly to shift the FOV of the detector by one-half line height of the FOV of the detector.

7. The device of claim 6 , wherein the instructions are executable to use a lateral shift of the detector to double a horizontal resolution of the detector.

8. A method comprising:
illuminating an object on a surface using a laser on a first device on the surface and spaced from the object;
moving a micro mirror assembly to deflect the light from a first area of the object to a second area of the object;
receiving by at least a first detector reflections from the object of light deflected by the micro mirror assembly;
based at least in part of time of receipt of the reflections, generating an image of the object; and
vibrate/oscillate the micro mirror assembly to shift a field of view (FOV) of the first detector by one-half line height.

9. The method of claim 8 , wherein the image includes a three dimensional (3D) depth map.

10. The method of claim 8 , wherein the micro mirror assembly includes a laser bar code scanner-like mechanism.

11. The method of claim 8 , comprising determining a time of flight (TOF) between a time of light transmission and a time of reflection reception.

12. The method of claim 8 , wherein the micro mirror assembly includes a Digital Light Processing (DLP) array-like mechanism.

13. The method of claim 12 , comprising moving the micro mirror assembly to shift a field of view (FOV) of a detector of the reflections by one-half line height of the FOV of the detector.

14. The method of claim 13 , comprising using a lateral shift of the detector to double a horizontal resolution of the detector.

15. An assembly comprising:
plural devices;
each of the plural devices comprising at least one laser range finder configured to output signals useful for generating images of other of the plural devices on a surface, wherein at least a first one of the plural devices is within a field of view (FOV) of the laser range finder of at least a second one of the plural devices, and at least one micro mirror assembly for reflecting light from the laser range finder onto an object to be mapped, and at least one light detector for receiving reflections of the light from the laser finder deflected by micro mirror assembly and reflected by the object; and
at least one processor configured with instructions for generating a 3D depth map of the object based on one or more aspects of the reflections of the light.

16. The assembly of claim 15 , wherein the laser range finder comprises at least one laser and the instructions are executable to:
activate the laser to emit light;
move the micro mirror assembly to a first configuration to reflect the light onto a first area of the object;
receive, from the detector, a signal representing a reflection of the light from the first area;
determine a distance to the first area based at least in part on a time of receipt of the signal representing the reflection of the light from the first area;
move the micro mirror assembly to a second configuration to reflect the light onto a second area;
receive from the detector a signal representing a reflection of the light from the second area;
determine a distance to the second area based at least in part on a time of receipt of the signal representing the reflection of the light from the second area; and
generate the 3D depth map at least in part using the distances to the first and second areas.

17. The assembly of claim 16 , wherein the micro mirror assembly includes a laser bar code scanner-like mechanism.

18. The assembly of claim 16 , wherein the micro mirror assembly includes a Digital Light Processing (DLP) array-like mechanism.

19. The assembly of claim 16 , wherein the detector has a field of view (FOV) and the instructions are executable to move the micro mirror assembly to shift the FOV of the detector by one-half line height of the FOV of the detector.

20. The assembly of claim 19 , wherein the instructions are executable to use a lateral shift of the detector to double a horizontal resolution of the detector.

Assignees

• Sony Corp
• Sony Interactive Entertainment Inc

Inventors

• Shintani Peter
• Gonzalez Hernandez Jose Omar
• Clay William
• Espinosa Pablo Antonio
• Ansfield Fred
• Mohapatra Bibhudendu
• Resch Keith
• Usami Morio

Classifications

• G01S17/89

  for mapping or imaging · CPC title

• G01S7/4817 Primary

  relating to scanning · CPC title

• G01S17/08

  for measuring distance only (indirect measurement G01S17/46; active triangulation systems G01S17/48) · CPC title

• G01S7/4816

  of receivers alone · CPC title

• G01S17/10

  using transmission of interrupted, pulse-modulated waves (determination of distance by phase measurements G01S17/32) · CPC title