Image processing apparatus and image processing method

Patent metadata

Field	Value
Publication number	US-9706121-B2
Application number	US-201414524234-A
Country	US
Kind code	B2
Filing date	Oct 27, 2014
Priority date	Oct 29, 2013
Publication date	Jul 11, 2017
Grant date	Jul 11, 2017

Abstract

An image processing apparatus calculates correlation values between a plurality of images with respect to relative positions, and detects a motion vector between the plurality of images based on the calculated correlation values. The image processing apparatus then determines the reliability of the motion vector based on a value indicating the highest correlation among the correlation values and a correlation value obtained at a position that is distant by a predetermined distance or longer from a position at which the value indicating the highest correlation is obtained. In this way, the reliability of the motion vector can be determined with high accuracy.

First claim

What is claimed is:

1. An image processing apparatus comprising:
a processor; and
a memory including instructions that, when executed by the processor, cause the processor to:
obtain a plurality of images;
calculate correlation values between the plurality of images with respect to relative positions;
detect a motion vector between the plurality of images based on the correlation values;
determine reliability of the motion vector; and
perform at least one of an anti-shake process and a moving object tracking process with the motion vector, wherein
the processor determines the reliability based on a value indicating the highest correlation among the correlation values and a correlation value, among the correlation values, obtained at a position that is distant by a predetermined distance or longer from a position at which the value indicating the highest correlation is obtained.

2. The image processing apparatus according to claim 1 , wherein
the processor determines the reliability based on the number of correlation values, among the correlation values, which are obtained at positions that are distant by the predetermined distance or longer from the position at which the value indicating the highest correlation among the correlation values is obtained, and which are different from the value indicating the highest correlation by a predetermined threshold or less.

3. The image processing apparatus according to claim 1 , wherein
the processor determines that the reliability of the motion vector is low if the number of correlation values, among the correlation values, which obtained at positions that are distant by the predetermined distance or longer from the position at which the value indicating the highest correlation among the correlation values is obtained, and which are different from the value indicating the highest correlation by a predetermined threshold or less, is equal to or larger than a predetermined number.

4. The image processing apparatus according to claim 1 , wherein
the processor decides on the predetermined distance in accordance with at least one of a shooting parameter of one of the plurality of images and a result of analysis on one of the plurality of images.

5. The image processing apparatus according to claim 4 , wherein
the shooting parameter is one or more of a shutter speed, an f-number, and apparatus motion information.

6. The image processing apparatus according to claim 5 , wherein
the processor makes the predetermined distance longer for a slower shutter speed.

7. The image processing apparatus according to claim 5 , wherein
the decision-unit processor makes the predetermined distance longer for a smaller f-number.

8. The image processing apparatus according to claim 5 , wherein
the processor makes the predetermined distance longer for a larger moving amount shown by the apparatus motion information.

9. The image processing apparatus according to claim 4 , wherein the result of analysis is an in-focus degree of an image or sharpness of an image.

10. The image processing apparatus according to claim 9 , wherein the result of analysis is a result of analysis with respect to a template block set in one of the plurality of images, and the decision unit makes the predetermined distance shorter when the template block is set in an in-focus area than when the template block is set in an out-of-focus area.

11. The image processing apparatus according to claim 9 , wherein the result of analysis is a result of analysis with respect to a template block set in one of the plurality of images, and the decision unit makes the predetermined distance shorter for higher sharpness of the template block.

12. An image processing apparatus comprising:
a processor; and
a memory including instructions that, when executed by the processor, cause the processor to:
obtain a first image and a second image;
calculate, for a plurality of positions in the first image, correlation values with respect to a reference area set in the first image;
detect a motion vector between the first image and the second image; and
perform at least one of an anti-shake process and a moving object tracking process with the motion vector, wherein
the processor sets an area from which the motion vector is detected based on a correlation value obtained at a position that is distant by a predetermined distance or longer from the reference area.

13. An image capture apparatus comprising:
the image processing apparatus according to claim 1 ; and
an image sensor which captures the plurality of images.

14. An image processing method executed by an image processing apparatus, the image processing method comprising:
an obtaining step of obtaining a plurality of images;
a calculation step of calculating correlation values between the plurality of images with respect to relative positions;
a detection step of detecting a motion vector between the plurality of images based on the correlation values;
a determination step of determining reliability of the motion vector; and
a performing step of performing at least one of an anti-shake process and a moving object tracking process with the motion vector, wherein
in the determination step, the reliability is determined based on a value indicating the highest correlation among the correlation values and a correlation value, among the correlation values, obtained at a position that is distant by a predetermined distance or longer from a position at which the value indicating the highest correlation is obtained.

15. An image processing method executed by an image processing apparatus, the image processing method comprising:
an obtaining step of obtaining a first image and a second image;
a calculation step of calculating, for a plurality of positions in the first image, correlation values with respect to a reference area set in the first image;
a detection step of detecting a motion vector between the first image and the second image; and
a performing step of performing at least one of an anti-shake process and a moving object tracking process with the motion vector, wherein
in the detection step, an area from which the motion vector is detected is set based on a correlation value obtained at a position that is distant by a predetermined distance or longer from the reference area.

16. A non-transitory computer-readable storage medium storing a program for causing a computer to function as the an image processing apparatus comprising:
an obtaining unit configured to obtain a plurality of images;
a calculation unit configured to calculate correlation values between the plurality of images with respect to relative positions;
a detection unit configured to detect a motion vector between the plurality of images based on the correlation values; and
a determination unit configured to determine reliability of the motion vector; and
an anti-shake unit configured to perform at least one of an anti-shake process and a moving object tracking process with the motion vector,
wherein the determination unit determines the reliability based on a value indicating the highest correlation among the correlation values and a correlation value, among the correlation values, obtained at a position that is distant by a predetermined distance or longer from a position at which the value indicating the highest correlation is obtained.

17. A non-transitory computer-readable storage medium storing a program for causing a computer to function as the an image processing apparatus comprising:
an obtaining unit configured to obtain a fir

Assignees

• Canon Kk

Inventors

• Saito Mitsuhiro

Classifications

• H04N23/681

  Motion detection · CPC title

• H04N23/6811 Primary

  based on the image signal · CPC title

• G06T7/33 Primary

  using feature-based methods · CPC title

• G06T2207/20021

  Dividing image into blocks, subimages or windows · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title