Method and camera module for acquiring depth information

Patent metadata

Field	Value
Publication number	US-11875525-B2
Application number	US-201917279412-A
Country	US
Kind code	B2
Filing date	Oct 7, 2019
Priority date	Oct 5, 2018
Publication date	Jan 16, 2024
Grant date	Jan 16, 2024

Abstract

According to one embodiment, disclosed is a method by which a camera module capable of acquiring depth information controls the output time point and the reception time point of light. By controlling both the output time point and the reception time point of light, the camera module can acquire the light of phases in which adjacent reception pixels differ from one another despite controlling light sources or reception pixels in line units.

First claim

The invention claimed is:

1. A camera module comprising:
a light source array including a plurality of light sources for outputting light to an object;
a receiver for receiving light reflected from the object through reception pixels;
at least one phase retarder located at the receiver; and
a processor for obtaining depth information on the object by using a phase difference between the light outputted from the light source array and the light received by the receiver,
wherein the light source array includes light sources on a first output line and light sources on a second output line,
wherein the phase difference between the light outputted from the light sources on the first output line and the light outputted from the light sources on the second output line is a first value,
wherein the reception pixels include pixels on a first reception line and pixels on a second reception line,
wherein the phase difference between a time point when the light is received at the pixels on the first reception line and a time point when the light is received at the pixels on the second reception line is a second value due to the phase retarder being located at one of the first reception line or the second reception line, and
wherein the first value and the second value are different values.

2. The camera module according to claim 1 , wherein the difference between the first value and the second value is 90 degrees.

3. The camera module according to claim 1 , wherein the first output line and the second output line are adjacent to each other, and the first reception line and the second reception line are adjacent to each other.

4. The camera module according to claim 1 , wherein the first output line and the second output line are parallel to each other, the first reception line and the second reception line are parallel to each other, and the first output line and the first reception line are orthogonal to each other.

5. The camera module according to claim 1 , wherein a first pixel that is a pixel on the first reception line for receiving light outputted from light sources on the first output line, a second pixel that is a pixel on the second reception line for receiving light outputted from light sources on the first output line, a third pixel that is a pixel on the first reception line for receiving light outputted from light sources on the second output line, and a fourth pixel that is a pixel on the second reception line for receiving light outputted from light sources on the second output line are adjacent to each other.

6. The camera module according to claim 5 , wherein a reception time point of light received by the receiver is different in all of the first pixel to the fourth pixel.

7. The camera module according to claim 5 , wherein a reception time point of light received by the receiver is different by a time corresponding to a 90-degree phase in the first pixel to the fourth pixel.

8. The camera module according to claim 1 , wherein the receiver includes a first block and a second block obtained by partitioning the reception pixels, and
wherein the processor obtains the depth information using both light received through the first block and light received through the second block.

9. The camera module according to claim 1 , wherein the processor increases resolution by applying a super resolution technique.

10. The camera module according to claim 8 , wherein two pixels among four pixels included in the first block and four pixels included in the second block overlap.

11. The camera module according to claim 1 , wherein the first value is 180 degrees, and the second value is 90 degrees.

12. The camera module according to claim 1 , wherein the first value is 90 degrees, and the second value is 180 degrees.

13. The camera module according to claim 1 , wherein the light source array outputs light by performing amplitude modulation or phase modulation according to a control signal received form the processor.

14. The camera module according to claim 1 , wherein each of the plurality of light sources output light independently.

15. The camera module according to claim 14 , wherein the plurality of light sources output light of different intensities, different frequencies, different phases, and different delay times from each other.

16. A camera module comprising:
a light source array including a plurality of light sources for outputting light to an object;
an image sensor for receiving light reflected from the object through reception pixels and disposed on the printed circuit board;
at least one phase retarder located at the image sensor;
a printed circuit board including a processor; and
a lens assembly including a lens and coupled to the printed circuit board,
wherein the processor obtains depth information on the object by using a phase difference between the light outputted from the light source array and the light received by the image sensor,
wherein the light source array includes light sources on a first output line and light sources on a second output line,
wherein the phase difference between the light outputted from the light sources on the first output line and the light outputted from the light sources on the second output line is a first value,
wherein the reception pixels include pixels on a first reception line and pixels on a second reception line,
wherein the phase difference between a time point when the light is received at the pixels on the first reception line and a time point when the light is received at the pixels on the second reception line is a second value due to the phase retarder being located at one of the first reception line or the second reception line, and
wherein the first value and the second value are different values.

17. A method for obtaining depth information comprising the steps of:
outputting light to an object through light sources on a first output line and light sources on a second output line;
receiving light reflected from the object through pixels on a first reception line and pixels on a second reception line; and
obtaining depth information on the object by using a phase difference between the outputted light and the received light,
wherein the phase difference between the light outputted from the light sources on the first output line and the light outputted from the light sources on the second output line is a first value,
wherein the phase difference between the time point when the light is received at the pixels on the first reception line and the time point when the light is received at the pixels on the second reception line is a second value, and
wherein the first value and the second value are different values.

18. The method for obtaining depth information according to claim 17 , wherein the difference between the first value and the second value is 90 degrees.

19. The method for obtaining depth information according to claim 17 , wherein the first output line and the second output line are adjacent to each other, and the first reception line and the second reception line are adjacent to each other.

20. The method for obtaining depth information according to claim 17 , wherein the first output line and the second output line are parallel to each other, the first reception line and the second reception line are parallel to each other, and the first output line and the first reception line are orthogonal to each other.

Assignees

• Lg Innotek Co Ltd

Inventors

• Joo Yang Hyun
• Lee Chang Hyuck
• Kim Hyeong Jin

Classifications

• G06T7/70 Primary

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• H04N23/00

  Cameras or camera modules comprising electronic image sensors; Control thereof · CPC title

• H04N13/111

  Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation · CPC title

• H04N13/128

  Adjusting depth or disparity · CPC title

• G06T7/50 Primary

  Depth or shape recovery · CPC title