Image processing apparatus and method calculates distance information in a depth direction of an object in an image using two images whose blur is different

Patent metadata

Field	Value
Publication number	US-10070038-B2
Application number	US-201414161771-A
Country	US
Kind code	B2
Filing date	Jan 23, 2014
Priority date	Jan 30, 2013
Publication date	Sep 4, 2018
Grant date	Sep 4, 2018

Abstract

An image processing apparatus calculates the distance in a depth direction of an object in an image by using a plurality of images whose blur amount is different. The image processing apparatus has: an acquisition unit configured to acquire distance range information for designating a range of a distance to be calculated; a determination unit configured to determine a photographing condition of each of images photographed, on the basis of the distance range information; and a calculation unit configured to calculate the distance by using a plurality of images photographed in the respective photographing conditions determined by the determination unit.

First claim

What is claimed is:

1. An image processing apparatus for calculating distance information in a depth direction of an object in an image by using two images whose blur amounts are different, the image processing apparatus comprising:
a memory storing a program; and
a processor operating according to the program, the processor functioning as units comprising:
(1) an acquisition unit that acquires distance range information for designating a range of distance to be calculated;
(2) a determination unit that determines a same F-number and respective focusing positions of the two images to be photographed, on the basis of the distance range information; and
(3) a calculation unit that calculates the distance information in the depth direction of the object in the range of distance to be calculated, on the basis of the difference in the blur amounts of the two images photographed with the F-number and the respective focusing positions determined by the determination unit,
wherein the determination unit determines the F-number such that the F-number satisfies the following formula:

F
≥

r

(

15
-
k

)

×
λ

where F is the F-number, r is the range of distance to be calculated, k is a predetermined coefficient, and λ is a wavelength of light.

2. The image processing apparatus according to claim 1 , wherein the calculation unit changes the range of a distance calculable from the two images in accordance with the F-number, and
wherein the determination unit determines the F-number such that a range designated by the distance range information is within the range of the distance that is calculable from the two images.

3. The image processing apparatus according to claim 1 , wherein the calculation unit calculates the distance information on the basis of a ratio of PSF peak values of the two images.

4. The image processing apparatus according to claim 1 , wherein the calculation unit calculates the distance information on the basis of a correlation amount of the two images.

5. The image processing apparatus according to claim 2 , wherein the determination unit divides the range designated by the distance range information into a plurality of small ranges, each of which is smaller than the maximum range of the distance that is calculable from the two images, and determines the F-number of each image used in the distance calculation of each small range when the range designated by the distance range information exceeds a maximum range of the distance that is calculable from the two images.

6. The image processing apparatus according to claim 2 , wherein the determination unit outputs a result indicating that there is no F-number enabling a distance calculation in the range designated by the distance range information when the range designated by the distance range information exceeds a maximum range of the distance calculable from the two images.

7. The image processing apparatus according to claim 2 , wherein the determination unit decreases the F-number at the times of photographing of the two images as the range designated by the distance range information decreases.

8. The image processing apparatus according to claim 2 , wherein the determination unit increases a focus bracket amount that is the difference between focusing positions of the two images, as the range designated by the distance range information decreases when the F-number is unable to be changed.

9. An image pickup apparatus comprising:
an imaging unit; and
the image processing apparatus according to claim 1 ,
wherein the imaging unit photographs a plurality of images in accordance with the F-number and the focusing positions determined by the image processing apparatus, and
wherein the image processing apparatus calculates a distance in a depth direction of an object in the images, by using the plurality of images that are photographed by the imaging unit.

10. The image pickup apparatus according to claim 9 , wherein the processor further functions as a designation unit that instructs a user to designate a range of a distance to be calculated.

11. The image pickup apparatus according to claim 10 , wherein the processor further functions as the designation unit that has:
a unit that displays an image acquired from the imaging unit on a display unit, and instructs the user to designate two points in the displayed image;
a unit that acquires distances in the depth direction of the two points by performing automatic focusing for the designated two points; and
a unit that sets, as the range of the distance to be calculated, a range in which the shorter one and the longer one of the distances of the two points are defined as a lower limit and an upper limit, respectively.

12. The image pickup apparatus according to claim 10 , wherein the processor further functions as the designation unit that has:
a unit that acquires distances in the depth direction of two points by making the user perform an operation of automatic focusing twice; and
a unit that sets, as the range of the distance to be calculated, a range in which the shorter one and the longer one of the distances of the two points are defined as a lower limit and an upper limit, respectively.

13. The image pickup apparatus according to claim 10 , wherein the designation unit has a unit that instructs the user to input a lower limit and an upper limit of the range of the distance to be calculated.

14. The image pickup apparatus according to claim 10 , wherein the designation unit has a unit that designates the range of the distance to be calculated by a relative distance to a reference position.

15. The image processing apparatus according to claim 1 , wherein the determination unit obtains the F-number corresponding to the range of distance to be calculated, designated by the distance range information, from a table in which each range of distance is associated with an F-number.

16. An image processing method of calculating distance information in a depth direction of an object in an image by using two images whose blur amounts are different, the image processing method comprising:
acquiring distance range information for designating a range of a distance to be calculated;
determining a same F-number and respective focusing positions of the two images to be photographed, on the basis of the distance range information; and
calculating the distance information in the depth direction of the object in the range of distance to be calculated, on the basis of the difference in the blur amounts of the two images photographed with the F-number and have respective focusing positions that have been determined,
wherein the F-number is determined such that the F-number satisfies the following formula:

F
≥

r

(

15
-
k

)

Assignees

• Canon Kk

Inventors

• Komatsu Satoru

Classifications

• G06T2207/10148

  Varying focus · CPC title

• G06T7/571 Primary

  from focus · CPC title

• H04N5/23212 Primary

  Electricity · mapped topic