Imaging method and device for autofocusing

Patent metadata

Field	Value
Publication number	US-12386244-B2
Application number	US-202318121323-A
Country	US
Kind code	B2
Filing date	Mar 14, 2023
Priority date	Sep 30, 2022
Publication date	Aug 12, 2025
Grant date	Aug 12, 2025

Abstract

An imaging device includes an imaging lens array including a plurality of imaging lenses each with a same focal length, the plurality of imaging lenses being configured to capture a scene; a sensing array comprising a plurality of sensors configured to receive light passing through the plurality of imaging lenses; a processor configured to determine a scene depth plane corresponding to the scene based on a comparison, for each of a plurality of candidate depths, between reference pixel values based on first sensors of the plurality of sensors corresponding to a reference imaging lens of the plurality of imaging lenses and target pixel values that are based on second sensors of the plurality of sensors corresponding to a target imaging lens of the plurality of image lenses; and a lens driver configured to position the imaging lens array to be disposed at a point corresponding to the scene depth plane.

First claim

What is claimed is:

1. An imaging device comprising:
an imaging lens array comprising a plurality of imaging lenses each with a same focal length, the plurality of imaging lenses being configured to capture a scene;
a sensing array comprising a plurality of sensors configured to receive light passing through the plurality of imaging lenses;
a processor configured to determine a scene depth plane corresponding to the scene based on a comparison, for each of a plurality of candidate depths, between reference pixel values that are based on first sensors of the plurality of sensors corresponding to a reference imaging lens of the plurality of imaging lenses and target pixel values that are based on second sensors of the plurality of sensors corresponding to a target imaging lens of the plurality of image lenses; and
a lens driver configured to position the imaging lens array to be disposed at a point corresponding to the determined scene depth plane.

2. The imaging device of claim 1 , wherein the processor being configured to determine the scene depth plane includes being configured to:
project the reference pixel values and the target pixel values onto a plane with a same depth; and
calculate an intensity difference between pixel values in pixel coordinates of the plane with the same depth.

3. The imaging device of claim 1 , wherein the processor being configured to determine the scene depth plane includes being configured to:
project pixel values corresponding to one of the reference imaging lens or the target imaging lens onto an image plane corresponding to another of the reference imaging lens or the target imaging lens; and
calculate an intensity difference between pixel values for each pixel coordinate of the image plane.

4. The imaging device of claim 1 , wherein the processor being configured to determine the scene depth plane includes being configured to:
project first pixel values corresponding to one of the reference imaging lens or the target imaging lens onto a plane of each of the plurality of candidate depths;
re-project the first pixel values, projected onto the plane of the corresponding candidate depth of the plurality of candidate depths, onto an image plane corresponding to another of the reference imaging lens or the target imaging lens; and
calculate an intensity difference, in the image plane, between the re-projected first pixel values and second pixel values corresponding to the other of the reference imaging lens or the target imaging lens.

5. The imaging device of claim 1 , wherein the processor being configured to determine the scene depth plane includes being configured to:
calculate an intensity difference between the reference pixel values and the target pixel values for each of the plurality of candidate depths; and
determine the scene depth plane based on the intensity difference calculated for each of the plurality of candidate depths.

6. The imaging device of claim 1 ,
wherein the plurality of imaging lens includes one or more additional target imaging lenses;
wherein the processor being configured to determine the scene depth plane includes being configured to:
determine a target depth plane corresponding to each of the target imaging lens and the one or more additional target imaging lenses, each of the target depth planes being based on a result obtained by (i) comparing the reference pixel values and the target pixel values, or (ii) comparing the reference pixel values and additional target pixel values that are based on the corresponding additional target imaging lens of the one or more additional target imaging lenses; and
determine the scene depth plane based on the determined target depth planes.

7. The imaging device of claim 1 , wherein the processor is further configured to perform a comparison between the reference pixel values and target pixel values that are based on a target imaging lens spaced farthest along one axis from the reference imaging lens among a plurality of target imaging lenses.

8. The imaging device of claim 1 ,
wherein the target imaging lens is a first target imaging lens,
wherein the target pixel values are first target pixel values, and
wherein the processor is further configured to perform a comparison between the first target pixel values and second target pixel values that are based on a second target imaging lens.

9. The imaging device of claim 8 , wherein the processor being configured to determine the scene depth plane includes being configured to:
project the first target pixel values and the second target pixel values onto an image plane corresponding to the reference imaging lens for a comparison with the reference pixel values; and
calculate an intensity difference between the first target pixel values and the second target pixel values in the image plane.

10. The imaging device of claim 1 ,
wherein the target imaging lens is a first target imaging lens spaced farthest along a first axis from the reference imaging lens among a plurality of target imaging lenses,
wherein the target pixel values are first target pixel values, and
wherein the processor being configured to determine the scene depth plane includes being configured to:
determine a target depth plane based on a comparison result between the reference pixel values and first target pixel values; and
determine the scene depth plane by adjusting the target depth plane based on a comparison result between the reference pixel values and second target pixel values that are based on a second target imaging lens among the plurality of target imaging lenses spaced farthest along a second axis from the first target imaging lens.

11. The imaging device of claim 10 , wherein the processor is further configured to:
perform a comparison between the second target pixel values and the reference pixel values for candidate depths of the plurality of candidate depths adjacent to the target depth plane based on the determined target depth plane; and
update a plane corresponding to a candidate depth with a smallest intensity difference between the second target pixel values and the reference pixel values among the candidate depths adjacent to the target depth plane to the scene depth plane.

12. The imaging device of claim 1 , wherein the plurality of candidate depths is set such that a depth of field based on an object distance corresponding to one of the plurality of candidate depths at least partially overlaps a depth of field corresponding to another candidate depth.

13. The imaging device of claim 12 , wherein
a near point distance determined based on a focal length of the imaging lens array and a permissible circle of confusion with respect to an object distance corresponding to at least one of the plurality of candidate depths is within a range of the depth of field corresponding to the other candidate depth, and
a far point distance determined based on the object distance corresponding to the one candidate depth and the imaging lens array is an infinite distance.

14. The imaging device of claim 1 , wherein the processor is further configured to:
set a region of interest (ROI) in response to a user input; and
determine the scene depth plane based on a result obtained by comparing pixel values corresponding to the set ROI among pixel values for each of the plurality of imaging lenses.

15. The imaging device of claim 1 , wherein the processor is further configured to:
determine the reference pixel values by grouping values sensed by the sensors corresponding to the reference imaging lens in a first predesignated block unit; and
determine the target

Assignees

• Samsung Electronics Co Ltd

Inventors

• Cho Yang Ho
• Park Juyong
• Heo Jingu
• Nam Dong Kyung

Classifications

• G03B3/10

  Power-operated focusing · CPC title

• G02B3/0075

  characterized by non-optical structures, e.g. having integrated holding or alignment means · CPC title

• G06T7/80

  Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration · CPC title

• G03B13/36 Primary

  Autofocus systems · CPC title

• H04N23/632

  for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters · CPC title