Method and system for robust contrast based auto focus in low light

Patent metadata

Field	Value
Publication number	US-11082606-B1
Application number	US-201816127436-A
Country	US
Kind code	B1
Filing date	Sep 11, 2018
Priority date	Sep 11, 2018
Publication date	Aug 3, 2021
Grant date	Aug 3, 2021

Abstract

Determining a focus setting includes determining a plurality of regions of interest in a view of a scene, and, for each of the plurality of regions of interest, obtaining a set of image data for each of multiple focal positions, and then applying focus filters to the set of image data for each of the plurality of focal positions for each of the regions of interest to obtain a set of focus scores, i.e., a focus score for each focus filter applied to the set of image data for each of the focal positions. Further, determining a confidence value associated with each of the sets of focus scores, selecting a subset of the sets of focus scores based on the confidence values associated with each of the sets of focus scores, and determining a focus setting for the scene based on the selected subset of the focus scores.

First claim

The invention claimed is:

1. A computer readable storage medium comprising computer readable code executable by one or more processors to:
determine a plurality of regions of interest in a view of a scene;
obtain, for each of the plurality of regions of interest, a set of image data for each of a plurality of focus settings;
apply a plurality of focus filters to the set of image data for each of the plurality of focus settings for each of the plurality of regions of interest to obtain a plurality of sets of focus scores;
determine, for each of the plurality of sets of focus scores, a focus curve, wherein the focus curve is derived from a particular set of focus scores across the plurality of focus settings for a particular focus filter of the plurality of focus filters applied to a particular region of the plurality of regions;
determine a confidence value associated with each of the plurality of sets of focus scores, wherein the confidence value indicates a relative performance of a particular focus filter among the plurality of focus filters in identifying relative sharpness for particular image data across the plurality of focus settings based on the focus curve for a particular region;
select a subset of the plurality of sets of focus scores based on the associated confidence values; and
determine a final focus setting for the scene based on the selected subset of the plurality of sets of focus scores.

2. The computer readable storage medium of claim 1 , wherein one or more of the plurality of focus filters are adapted based on characteristics of the scene.

3. The computer readable storage medium of claim 1 , wherein the subset of the plurality of sets of focus scores are selected by comparing confidence values associated with each of the plurality of sets of focus scores to a threshold confidence value.

4. The computer readable storage medium of claim 1 , wherein the subset of the plurality of sets of focus scores are selected by based on a predetermined percentile of highest confidence values among the confidence values associated with each of the plurality of sets of focus scores.

5. The computer readable storage medium of claim 1 , wherein the plurality of focus setting comprises a plurality of autofocus positions, and wherein the final focus setting comprises a focus position that is not included in the plurality of autofocus positions.

6. The computer readable storage medium of claim 1 , wherein the computer readable code to select the subset of the plurality of sets of focus scores further comprises computer readable code to:
select, for each region of interest, from among the plurality of sets of focus scores associated with the region of interest, one or more sets of focus scores based on the confidence values associated with each of the one or more sets of focus scores, to obtain one or more sets of focus scores for each of one or more regions of interest.

7. The computer readable storage medium of claim 6 , wherein the computer readable code to determine a final focus setting comprises computer readable code to:
determine a regional focus setting for one or more of the regions of interest based on the one or more sets of focus scores for each of one or more regions of interest; and
determine the focus setting based on the regional focus setting for the one or more of the regions of interest.

8. An image capture system, comprising:
a camera;
one or more processors; and
memory coupled to the one or more processors and comprising computer readable code executable by the one or more processors to:
determine a plurality of regions of interest in a view of a scene;
obtain, for each of the plurality of regions of interest, a set of image data for each of a plurality of focus settings;
apply a plurality of focus filters to the set of image data for each of the plurality of focus settings for each of the plurality of regions of interest to obtain a plurality of sets of focus scores;
determine, for each of the plurality of sets of focus scores, a focus curve, wherein the focus curve is derived from a particular set of focus scores across the plurality of focus settings for a particular focus filter of the plurality of focus filters applied to a particular region of the plurality of regions;
determine a confidence value associated with each of the plurality of sets of focus scores, wherein the confidence value indicates a relative performance of a particular focus filter among the plurality of focus filters in identifying relative sharpness for particular image data across the plurality of focus settings based on the focus curve for a particular region;
select a subset of the plurality of sets of focus scores based on the associated confidence values; and
determine a final focus setting for the scene based on the selected subset of the plurality of sets of focus scores.

9. The system of claim 8 , wherein one or more of the plurality of focus filters are adapted based on characteristics of the scene.

10. The system of claim 8 , wherein the subset of the plurality of sets of focus scores are selected by comparing confidence values associated with each of the plurality of sets of focus scores to a threshold confidence value.

11. The system of claim 8 , wherein the subset of the plurality of sets of focus scores are selected by based on a predetermined percentile of highest confidence values among the confidence values associated with each of the plurality of sets of focus scores.

12. The system of claim 8 , wherein the plurality of focus setting comprises a plurality of autofocus positions, and wherein the final focus setting comprises a focus position that is not included in the plurality of autofocus positions.

13. The system of claim 12 , wherein the computer readable code to select the subset of the plurality of sets of focus scores further comprises computer readable code to:
select, for each region of interest, from among the plurality of sets of focus scores associated with the region of interest, one or more sets of focus scores based on the confidence values associated with each of the one or more sets of focus scores, to obtain one or more sets of focus scores for each of one or more regions of interest.

14. The system of claim 13 , wherein the computer readable code to determine a final focus setting comprises computer readable code to:
determine a regional focus setting for one or more of the regions of interest based on the one or more sets of focus scores for each of one or more regions of interest; and
determine the focus setting based on the regional focus setting for the one or more of the regions of interest.

15. A method for determining a focus setting, comprising:
determining a plurality of regions of interest in a view of a scene;
obtaining, for each of the plurality of regions of interest, a set of image data for each of a plurality of focus settings;
applying a plurality of focus filters to the set of image data for each of the plurality of focus settings for each of the plurality of regions of interest to obtain a plurality of sets of focus scores;
determining, for each of the plurality of sets of focus scores, a focus curve, wherein the focus curve is derived from a particular set of focus scores across the plurality of focus settings for a particular focus filter of the plurality of focus filters applied to a particular region of the plurality of regions;
determining a confidence value associated with each of the plurality of sets of focus scores, wherein the confidence value indicates a relative performance of a particular focus filter among the plurality of f

Assignees

• Apple Inc

Inventors

• Gamadia Mark N
• Bai Yingjun
• Wang Muge

Classifications

• H04N23/673

  based on contrast or high frequency components of image signals, e.g. hill climbing method · CPC title

• G06V10/25 Primary

  Determination of region of interest [ROI] or a volume of interest [VOI] · CPC title

• H04N23/62

  Control of parameters via user interfaces · CPC title

• H04N23/675

  comprising setting of focusing regions · CPC title

• H04N23/631

  Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters · CPC title