Method and device for setting a focus of a camera

Patent metadata

Field	Value
Publication number	US-9906724-B2
Application number	US-201615251271-A
Country	US
Kind code	B2
Filing date	Aug 30, 2016
Priority date	Sep 7, 2015
Publication date	Feb 27, 2018
Grant date	Feb 27, 2018

Abstract

The present invention relates generally to auto focus algorithms for setting a focus of a camera. More specifically, the present invention relates to a method ( 600 ) and device for setting a focus of a camera wherein a camera motion level of the camera is continuously measured (S 604 ) during the read-out of pixel data by a rolling shutter image sensor and wherein the auto focus algorithm uses weighted focus measures which are calculated (S 612 ) using the continuously measured camera motion levels.

First claim

The invention claimed is:

1. An auto focus method for setting a focus of a camera comprising a rolling shutter image sensor and a focus lens arrangement, the auto focus method comprising the steps of:
capturing one or more image frames by the rolling shutter image sensor, wherein the rolling shutter image sensor comprises a plurality of pixel regions, wherein the rolling shutter image sensor during capture of an image frame reads out pixel data from one pixel region at a time,
continuously measuring a camera motion level of the camera during the read-out of pixel data, for producing motion data associated with the pixel data and indicating a plurality of camera motion levels measured during read-out of pixel data from the plurality of pixel regions, wherein each pixel region of the plurality of pixel regions is associated with zero or one camera motion level,
setting the focus of the camera using an auto focus algorithm, the auto focus algorithm dividing each of the one or more image frames into a plurality of focus windows, wherein each focus window comprises pixel data of one or more of the plurality of pixel regions,
wherein the auto focus algorithm comprises, for each focus window of the plurality of focus windows,
calculating a focus measure for the focus window based on the pixel data comprised in the focus window,
calculating a level of motion for the focus window based on the motion data associated with the pixel data comprised in the focus window,
calculating a weighted focus measure for the focus window by weighting the focus measure for the focus window by at least the level of motion for the focus window such that a focus measure of a focus window with a high level of motion will be weighted with a lower weight than a focus measure of a focus window with a low level of motion.

2. A method according to claim 1 ,
wherein the step of capturing one or more image frames comprises capturing only one image frame,
wherein the step of calculating a focus measure comprises calculating a phase-based focus measure from the pixel data comprised in the focus window.

3. The method according to claim 2 , wherein the step of setting the focus of the camera comprises calculating an average value of the weighted focus measure of each of the plurality of focus windows of the only one image frame.

4. The method of claim 1 ,
wherein the step of capturing one or more image frames comprises capturing a plurality of image frames, each image frame captured by the camera using a different focus setting of the focus lens arrangement,
wherein the auto focus algorithm divides each of the plurality of image frames into a plurality of focus windows,
wherein the step of calculating a focus measure comprises calculating a contrast-based focus measure,
wherein the step of calculating a weighted focus measure comprises calculating a fusion level of motion using the level of motion of the focus window and the level of motion of a corresponding focus window in each of remaining image frames of the plurality of the image frames and weighting the focus measure by the fusion motion level of motion such that a focus measure of a focus window with a high fusion level of motion will be weighted with lower weight than a focus measure of a focus window with a low fusion level of motion.

5. The method of claim 4 , wherein the calculating a fusion level of motion comprises calculating a sum of the level of motion of the focus window and the level of motion of the corresponding focus window in each of a remaining image frames of the plurality of the image frames.

6. The method of claim 4 , wherein the calculating a fusion level of motion comprises calculating a max level motion of the level of motion of the focus window and the level of motion of the corresponding focus window in each of the remaining image frames of the plurality of the image frames.

7. The method of claim 1 , wherein the camera motion level is measured for each read-out of each pixel region of the image sensor, such that the motion data associated with the pixel data comprises a separate camera motion level for each read-out of each pixel region.

8. The method of claim 1 , further comprising the step of:
when the camera motion level is below a predetermined camera motion level, setting the motion data to a first value, and
when the camera motion level is on or above the predetermined camera motion level, setting the motion data to a second value.

9. The method of claim 8 , wherein the second value of the motion data results in that the focus measure for a focus window comprising pixel data associated with the motion data is weighted by a weight of zero.

10. The method of claim 1 , further comprising the step of:
when the camera motion level is below a first predetermined camera motion level, setting the motion data to a first value,
when the camera motion level is above a second predetermined camera motion level, setting the motion data to a second value, and
when the camera motion level is between the first and second predetermined camera motion level, setting the motion data to a further value between the first and the second value, wherein the further value is related to the camera motion level.

11. The method of claim 4 , wherein:
when the fusion level of motion is below a first predetermined level of motion, the step of weighting the focus measure by the fusion level of motion comprises weighting the focus measure with a first weight,
when the fusion level of motion is above a second predetermined level of motion, the step of weighting the focus measure by the fusion level of motion comprises weighting the focus measure with a second weight, and when the fusion level of motion is between the first and second predetermined level of motion, the step of weighting the focus measure by the fusion level of motion comprises weighting the focus measure with a further weight between the first and the second weight, wherein the further weight is related to the fusion level of motion.

12. The method of claim 1 , wherein continuously measuring the camera motion level comprises the step of:
receiving input from a motion sensor of the camera, the input pertaining to camera motion sensed by the motion sensor.

13. The method of claim 1 , wherein continuously measuring the camera motion level comprises the step of:
receiving input from a pan/tilt, PT, motor of the camera, the input pertaining to camera motion induced by the PT motor.

14. A computer program product comprising a non-transitory computer-readable storage medium with instructions adapted to carry out at least parts of the method of claim 1 when executed by a device having processing capability.

15. A device for setting a focus of a camera comprising a rolling shutter image sensor and a focus lens arrangement, the device being arranged to:
receive pixel data relating to one or more image frames captured by the rolling shutter image sensor, wherein the rolling shutter image sensor comprises a plurality of pixel regions, wherein the rolling shutter image sensor during capture of an image frame reads out pixel data from one pixel region at a time,
receive motion data associated with the pixel data and indicating a plurality of camera motion levels measured during read-out of pixel data from the plurality of pixel regions, wherein the camera motion level of the camera is continuously measured during the read-out of pixel data, wherein each pixel region of the plurality of pixel regions is associated with zero or one camera motion level,
set the focus of the camera using an auto focus algorithm, the auto focus al

Assignees

• Axis Ab

Inventors

• Nilsson Dennis
• Nystrom Johan
• Benderius Bjorn

Classifications

• H04N23/673

  based on contrast or high frequency components of image signals, e.g. hill climbing method · CPC title

• H04N23/672 Primary

  based on the phase difference signals · CPC title

• H04N23/6812

  based on additional sensors, e.g. acceleration sensors · CPC title

• H04N23/6811 Primary

  based on the image signal · CPC title

• H04N23/69

  Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming · CPC title