Camera device having shiftable optical path

Patent metadata

Field	Value
Publication number	US-11528416-B2
Application number	US-201917278041-A
Country	US
Kind code	B2
Filing date	Sep 27, 2019
Priority date	Sep 28, 2018
Publication date	Dec 13, 2022
Grant date	Dec 13, 2022

Abstract

A camera device according to an embodiment of the present invention includes a light output unit that outputs an output light signal to be irradiated to an object, a lens unit that condenses an input light signal reflected from the object, an image sensor that generates an electric signal from the input light signal condensed by the lens unit and an image processing unit that extracts a depth map of the object using at least one of a time difference and a phase difference between the output light signal and the input light signal received by the image sensor, the lens unit including IR (InfraRed) filter, a plurality of solid lenses disposed on the IR filter and a liquid lens disposed on the plurality of solid lenses, or disposed between the plurality of solid lenses, the camera device further including a first driving unit that controls shifting of the IR filter or the image sensor and a second driving unit that controls a curvature of the liquid lens, an optical path of the input light signal being repeatedly shifted according to a predetermined rule by one of the first driving unit and the second driving unit, and the optical path of the input light signal being shifted according to predetermined control information by the other one of the first driving unit and the second driving unit.

First claim

The invention claimed is:

1. A camera device comprising:
a light output unit that outputs an output light signal to be irradiated to an object;
a lens unit that condenses an input light signal reflected from the object;
an image sensor that generates an electric signal from the input light signal condensed by the lens unit; and
an image processing unit that extracts a depth information of the object using at least one of a time difference and a phase difference between the output light signal and the input light signal received by the image sensor,
wherein the lens unit comprises:
an IR (InfraRed) filter;
a plurality of solid lenses disposed on the IR filter; and
a variable lens disposed on the plurality of solid lenses, or disposed between the plurality of solid lenses,

wherein the camera device further comprises:
a first driving unit that controls shifting of the IR filter or the image sensor; and
a second driving unit that controls a shape of the variable lens,

wherein an optical path of the input light signal is repeatedly shifted according to a predetermined rule by one of the first driving unit and the second driving unit, and
wherein the optical path of the input light signal is shifted according to predetermined control information by the other one of the first driving unit and the second driving unit.

2. The camera device of claim 1 , wherein according to the predetermined rule, the optical path of the input light signal is shifted by a subpixel unit that is greater than 0 pixels and less than 1 pixel of the image sensor in a first direction for a first period, is shifted by the subpixel unit in a second direction perpendicular to the first direction for a second period, is shifted by the subpixel unit in a third direction perpendicular to the second direction for a third period, and is shifted by the subpixel unit in a fourth direction perpendicular to the third direction for a fourth period, and
wherein the predetermined control information has control information for OIS (Optical Image Stabilization).

3. The camera device of claim 2 , wherein the optical path of the input light signal is further shifted according to control information for AF (autofocusing) by the second driving unit.

4. The camera device of claim 2 , wherein the control information for OIS is extracted from at least one of motion information and posture information of the camera device.

5. The camera device of claim 2 , wherein the optical path of the input light signal is shifted according to the predetermined rule by the first driving unit, and
the optical path of the input light signal is shifted according to the control information for OIS by the second driving unit.

6. The camera device of claim 5 , wherein the first driving unit controls the IR filter or the image sensor to be regularly tilted at a predetermined angle with respect to a plane perpendicular to an optical axis.

7. The camera device of claim 2 , wherein the optical path of the input light signal is shifted according to the control information for OIS by the first driving unit, and
the optical path of the input light signal is shifted according to the predetermined rule by the second driving unit.

8. The camera device of claim 7 , wherein the first driving unit controls the IR filter or the image sensor to be shifted in a direction perpendicular to an optical axis.

9. An image processing method of a camera device, comprising the steps of:
outputting an output light signal to irradiate an object;
shifting an optical path of an input light signal that is reflected from the object and condensed by a lens unit to reach an image sensor; and
extracting a depth information of the object using at least one of a time difference and a phase difference between the output light signal and the input light signal received by the image sensor,
wherein the lens unit includes an IR (Infrared) filter and a variable lens, and
wherein the step of shifting comprises the steps of:
repeatedly shifting the optical path of the input light signal according to a predetermined rule via one of moving the IR filter or the image sensor, or controlling a shape of the variable lens; and
shifting the optical path of the input light signal according to predetermined control information via the other one of moving the IR filter or the image sensor, or controlling the shape of the variable lens.

10. The method of claim 9 , wherein the predetermined control information includes control information for OIS (Optical Image Stabilization) extracted from at least one of motion information and posture information of the camera device.

11. The camera device of claim 1 , wherein the image processing unit extracts the depth information of the object using a super resolution (SR) technique.

12. The camera device of claim 11 , wherein the image processing unit generates a plurality of first resolution subframes, extracts a plurality of first resolution depth information using the plurality of first resolution subframes, and extracts a second resolution depth information which has a higher resolution than the plurality of first resolution depth information using the plurality of first resolution depth.

13. The camera device of claim 12 , wherein the optical path of the input light signal corresponding each of the plurality of the first resolution depth information is different from each other.

14. The camera device of claim 1 , wherein the image processing unit generates a plurality of first resolution subframes, extracts a plurality of second resolution subframes which have a higher resolution than the plurality of first resolution subframes using the plurality of first resolution subframes, and extracts a second resolution depth information using the plurality of second resolution subframes.

15. The camera device of claim 11 , wherein one of the first driving unit and the second driving unit operates for the SR technique, and the other one of the first driving unit and the second driving unit operates for at least one of OIS (optical image stabilization) function and AF (autofocusing) function.

16. The camera device of claim 15 , wherein the first driving unit comprises an actuator directly or indirectly connected to at least one of the IR filter and the image sensor.

17. The camera device of claim 16 , wherein the actuator comprises at least one of MEMS (Micro Electro Mechanical Systems), VCM (Voice Coil Motor) and a piezoelectric element.

18. The camera device of claim 1 , wherein the second driving unit is directly or indirectly connected to the variable lens, and the second driving unit directly applies a voltage to the variable lens or controls a voltage applied to the variable lens.

19. The camera device of claim 1 , wherein the light output unit outputs the output light signal by a pulse wave or a continuous wave.

20. The camera device of claim 1 , wherein the light output unit comprises a VCSEL (vertical cavity surface emitting laser).

Assignees

• Lg Innotek Co Ltd

Inventors

• Jang Seong Ha
• Park Ju Un
• Joo Yang Hyun

Classifications

• H04N23/68 Primary

  for stable pick-up of the scene, e.g. compensating for camera body vibrations · CPC title

• H04N23/54

  Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils · CPC title

• H04N23/55

  Optical parts specially adapted for electronic image sensors; Mounting thereof · CPC title

• H04N23/687

  by shifting the lens or sensor position · CPC title

• G02B27/646 Primary

  compensating for small deviations, e.g. due to vibration or shake (movement of one or more optical elements for control of motion blur in cameras, projectors or printers G03B2205/0007; image stabilisation in cameras peculiar to the presence or use of an electronic image sensor H04N23/68) · CPC title