Image capturing device and auto-focus method thereof

Patent metadata

Field	Value
Publication number	US-2017017136-A1
Application number	US-201615187802-A
Country	US
Kind code	A1
Filing date	Jun 21, 2016
Priority date	Jul 13, 2015
Publication date	Jan 19, 2017
Grant date	—

Abstract

The disclosure proposes an auto-focus method and an image capturing device including a distance sensor and an image sensor having a lens and a sensing array. The method includes the following steps. First, distance sensor data and phase detection data are respectively obtained from the distance sensor and the sensing array. The lens is controlled to perform a course search within a focusing range by switching between a distance sensor auto-focus mode and a phase detection auto-focus mode based on the distance sensor data and the phase detection data so as to determine a fine-search range. The lens is further controlled to perform a fine search within the fine-search range in a contrast detection auto-focus mode so as to determine an optimal focusing lens position. Next, the lens is controlled to move to the optimal focusing lens position.

First claim

What is claimed is:

1 . An auto-focus method, adapted to an image capturing device comprising a distance sensor and an image sensor having a lens and a sensing array, comprising the following steps:
obtaining distance sensor data (DS data) and phase detection data (PD data) respectively from the distance sensor and the sensing array; controlling the lens to perform a course search in a focusing range by switching the image sensor between a distance sensor auto-focus (DSAF) mode and a phase detection auto-focus (PDAF) mode based on the DS data and the PD data so as to determine a fine-search range; controlling the lens to perform a fine search within the fine-search range in a contrast detection auto-focus (CDAF) mode so as to determine an optimal focusing lens position; and controlling the lens to move to the optimal focusing lens position.

2 . The auto-focus method according to claim 1 , wherein after the step of obtaining the DS data and the PD data respectively from the distance sensor and the sensing array, the auto-focus method further comprises the following steps:
determining whether an auto-focus window is located at a center of a target scene comprising a target object; if no, switching the image sensor to the PDAF mode; and if yes, switching the image sensor to the DSAF mode.

3 . The auto-focus method according to claim 2 , wherein when the image sensor is switched to the DSAF mode and before the fine-search range is determined, the step of controlling the lens to perform the course search in the focusing range by switching the image sensor between the DSAF mode and the PDAF mode based on the DS data and the PD data comprises:
determining whether the DS data satisfies a DASF condition, wherein the DASF condition is associated with an object reflection and an object distance of the target object; if no, switching the image sensor to the PDAF mode; and if yes, performing a DSAF process by controlling the lens to move to the coarse-search focusing position based on a distance-digital-to-analog-converter (distance-DAC) relationship and switching the image sensor to the PDAF mode.

4 . The auto-focus method according to claim 2 , wherein when the image sensor is switched to the PDAF mode and before the fine-search range is determined, the step of controlling the lens to perform the course search in the focusing range by switching the image sensor between the DSAF mode and the PDAF mode based on the DS data and the PD data comprises:
determining whether the PD data satisfies a PDAF condition, wherein the PDAF condition is associated with a PD value and a confidence level of the PD data; if no, switching the image sensor to the CDAF mode; and if yes, performing a PDAF process by obtaining a predicted digital-to-analog-converter (DAC) value based on a PD value-DAC relationship and controlling the lens to move to the coarse-search focusing position based on the predicted DAC value and a current DAC value.

5 . The auto-focus method according to claim 4 , wherein before the fine-search range is determined, the step of controlling the lens to perform the course search in the focusing range by switching the image sensor between the DSAF mode and the PDAF mode based on the DS data and the PD data, the auto-focus method further comprises the following steps:
obtaining updated PD data from the sensing array; verifying an auto-focus accuracy based on the updated PD data; and if the auto-focus accuracy is verified as accurate, setting switching the image sensor to the CDAF mode to determine the fine-search range.

6 . The auto-focus method according to claim 5 , wherein when the auto-focus accuracy is verified as inaccurate, the auto-focus method further comprises the following steps:
determining whether a current PD count is less than a PD count threshold, wherein the current PD count is the number of times that the PDAF process has been performed; if yes, incrementing the current PD count by one and re-performing the PDAF process; if no, switching the image sensor to the CDAF mode.

7 . The auto-focus method according to claim 1 , wherein when a coarse-search focusing position exists in the focusing range, the step of determining the fine-search range comprises:
setting the fine search range with respect to the coarse-search focusing position.

8 . The auto-focus method according to claim 7 , wherein the step of determining the fine-search range further comprises the following steps:
determining whether an ISO/gain value is less than or equal to an ISO threshold; if yes, decrementing the fine-search range; and if no, incrementing the fine-search range.

9 . The auto-focus method according to claim 1 , wherein when a coarse-search focusing position does not exist in the focusing range, the step of determining the fine-search range comprises:
setting the focusing range as the fine-search range.

10 . The auto-focus method according to claim 7 , wherein while the image capturing device is capturing a video stream, after the fine-search range is set, the auto-focus method further comprises the following steps:
obtaining updated PD data from the sensing array and determining whether the updated PD data is greater than zero; if yes, controlling the lens to move forward; and if no, controlling the lens to move backward.

11 . An image capturing device comprising:
a distance sensor, configured for distance detection; an image sensor, comprising a lens and a sensing array, wherein the sensing array comprises a plurality of pixels, and wherein a part of the pixels are configured as partially-shielded phase detection pixels for phase detection; a memory; and a processor, coupled to the distance sensor, the image sensor, and the memory, and configured for obtaining distance sensor data (DS data) and phase detection data (PD data) respectively from the distance sensor and the sensing array, controlling the lens to perform a coarse search a focusing range by switching the image sensor between a distance sensor auto-focus (DSAF) mode and a phase detection auto-focus(PDAF) mode based on the DS data and the PD data so as to determine a fine-search range, controlling the lens to perform a fine search within the fine-search range in a contrast detection auto-focus (CDAF) mode so as to determine an optimal focusing lens position, and controlling the lens to move to the optimal focusing lens position.

12 . The image capturing device according to claim 11 , wherein after the processor obtains the DS data and the PD data respectively form the distance sensor and the sensing array, the processor is further configured for:
determining whether an auto-focus window is located at a center of a target scene comprising a target object; if no, switching the image sensor to the PDAF mode; and if yes, switching the image sensor to the DSAF mode.

13 . The image capturing device according to claim 12 , wherein the memory stores a distance-digital-to-analog-converter (distance-DAC) relationship, and wherein when the image sensor is switched to the DSAF mode and before the fine-search range is determined, the processor is configured for:
determining whether the DS data satisfies a DASF condition, wherein the DASF condition is associated with an object reflection and an object distance of the target object; if no, switching the image sensor to the PDAF mode; and if yes, performing a DSAF process by controlling the lens to move to the coarse-search focusing position based on the distance-DAC relationship and switching the image sensor to the PDAF mode.

14 . The image capturing device according to claim 12

Assignees

• Htc Corp

Inventors

• Kao Yu-Kai
• Lin Chi-Kuan

Classifications

• H04N23/673

  based on contrast or high frequency components of image signals, e.g. hill climbing method · CPC title

• H04N23/672 Primary

  based on the phase difference signals · CPC title

• H04N23/667

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title

• G03B13/20 Primary

  Rangefinders coupled with focusing arrangements, e.g. adjustment of rangefinder automatically focusing camera · CPC title

• H04N13/271

  wherein the generated image signals comprise depth maps or disparity maps · CPC title