Systems and methods for continuous auto focus (CAF)

Patent metadata

Field	Value
Publication number	US-9686463-B2
Application number	US-201514643876-A
Country	US
Kind code	B2
Filing date	Mar 10, 2015
Priority date	Mar 10, 2015
Publication date	Jun 20, 2017
Grant date	Jun 20, 2017

Abstract

Systems and methods for continuous automatic focus are disclosed. In some aspects, an object to focus on is selected from a field of view of a camera. At least one region of the field of view that includes the object is monitored for change. Regions of the field of view that do not include the object may not be monitored, thus improving efficiency and speed. If a change in the image content of the monitored region(s) occurs, the method may trigger a focus event. If the object moves to different region(s) of the field of view, the method detects the movement and adjusts the regions of the image being monitored to maintain focus on the object. In some aspects, the size of the object is also monitored. If the size of the object changes, a focus event may be triggered, depending on whether the amount of change exceeds predetermined parameters.

First claim

What is claimed is:

1. A method of focusing a camera, comprising:
selecting an object in an image;
determining, using a processor, regions in the image for monitoring the object;
sequentially capturing with the camera, using the processor, a first image and a second image of a scene that includes the object;
determining, in the first image and the second image, a location of the object, which of one or more regions the object is in, and a size of the object, using the processor, wherein determining the size of the object comprises
determining a first bounding region that contains the object in the first image; and
determining a second bounding region that contains the object in the second image;

monitoring, using the processor, the first image and the second image for each of the following conditions:
a change in image content in the one or more regions of the first and the second images that exceeds a threshold;
the location of the object moves from the one or more regions to another region;
the difference between the size of the object in the first image and the size of the object in the second image exceeds a size increase threshold or a size decrease threshold, wherein determining whether the difference exceeds the size increase threshold or the size decrease threshold comprises
determining a ratio between an area of the second bounding region and an area of the first bounding region; and
using the ratio to determine if the difference in the size of the object in the first image compared to the size of the object in the second image exceeds the size increase threshold or the size decrease threshold; and

focusing the camera, using the processor, when one or more of the conditions occur.

2. The method of claim 1 , further comprising determining an area of the first bounding region and an area of the second bounding region, and determining if the difference in the size of the object in the first image compared to the size of the object in the second image based on the difference in the area of the first bounding region and the area of the second bounding region.

3. The method of claim 1 , further comprising:
segmenting, using the processor, the first and second image into a plurality of corresponding regions;
determining, using the processor, a first region in the first image includes the object, and determining a second region in the second image corresponding to the first region;
determining, using the processor, a first difference between image content in the first region and the second region; and
determining, using the processor, if a change of image content in the first and second regions exceeds a threshold using the first difference.

4. The method of claim 3 , further comprising:
determining, using the processor, a third region in the second image includes the first object;
capturing with the camera a third image of the object at a third time, the third time after the second time;
determining, using the processor, a fourth region in the third image corresponding to the third region;
determining, using the processor, a second difference between image content in the third region and the fourth region; and
determining, using the processor, if a change in image content in the first and second images of regions that depict the object exceeds a threshold using the second difference.

5. The method of claim 1 , further comprising excluding from consideration when focusing the camera, regions of the plurality of regions that are determined to not include the first object.

6. An imaging apparatus comprising:
a camera; a processor, in communication with the camera, the processor configured to
select an object in an image;
determine regions in the image for monitoring the object;
sequentially capture, with the camera, a first image and a second image of a scene that includes the object;
determine a first bounding region containing the first object in the first image;
determine a second bounding region containing the first object in the second image;
determine, in the first image and the second image, a location of the object, which of one or more regions the object is in, and a size of the object;
monitor the first image and the second image for each of the following conditions:
a change in image content in the one or more regions of the first and the second images that exceeds a threshold;
the location of the object moves from the one or more regions to another region;
the difference between the size of the object in the first image and the size of the object in the second image exceeds a size increase threshold or a size decrease threshold, wherein determining whether the difference exceeds the size increase threshold or the size decrease threshold comprises
determining a ratio between an area of the second bounding region and an area of the first bounding region; and
using the ratio to determine if the difference in the size of the object in the first image compared to the size of the object in the second image exceeds the size increase threshold or is less than the size decrease threshold; and

a camera controller, comprising the processor, configured to focus the camera on the object when one or more of the conditions occur.

7. The imaging apparatus of claim 6 , wherein the processor is further configured to determine the size of the object in the first image based on the first bounding region and determines the size of the object in the second image based on the second bounding region.

8. The imaging apparatus of claim 6 , wherein the processor is further configured to determine an area of the first bounding region and an area of the second bounding region, and to determine the difference between the size of the object in the first image and the size of the object in the second image based on a difference between the area of the first bounding region and the area of the second bounding region.

9. The imaging apparatus of claim 6 , wherein the processor, to determine a change in the image content in the first and the second images of regions of regions that depict the object exceeds the threshold, is further configured to:
segment the first and second image into a plurality of corresponding regions,
determine a first region in the first image includes the object, and determine a second region in the second image corresponding to the first region,
determine a first difference between image content in the first region and the second region, and
use the first difference to determine if a change in image content in the first and second images of the one or more regions exceeds the threshold.

10. The apparatus of claim 9 , wherein the processor is further configured to exclude from consideration, when focusing the camera, regions that are determined to not include the first object.

11. The apparatus of claim 9 , wherein the processor is further configured to:
determine a third region in the second image includes the first object,
capture a third image of the object after capturing the second image;
determine a fourth region in the third image corresponding to the third region;
determine a second difference between image content in the third region and the fourth region; and
use the second difference to determine if a change in image content in the third and fourth regions exceeds the threshold.

12. An imaging apparatus comprising:
means for selecting an object in an image;
means for determining regions in the image for monitoring the object;
means for capturing a first image and a second image of a scene that includes the object;
means for determining, in the first image and the second image, a location of

Assignees

• Qualcomm Inc

Inventors

• Deng Fan
• Ma Lei
• Chan Leung Chun

Classifications

• G06T7/571

  from focus · CPC title

• G06T7/187

  involving region growing; involving region merging; involving connected component labelling · CPC title

• G06T7/80

  Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration · CPC title

• G06T7/38

  Registration of image sequences · CPC title

• G06T7/11

  Region-based segmentation · CPC title