Apparatus and method for stabilizing image

Patent metadata

Field	Value
Publication number	US-9716832-B2
Application number	US-201314075768-A
Country	US
Kind code	B2
Filing date	Nov 8, 2013
Priority date	Jul 12, 2013
Publication date	Jul 25, 2017
Grant date	Jul 25, 2017

Abstract

Provided are an apparatus and method for outputting a stabilized image even when a camera sways. The method includes: applying a first compensated motion to the image to acquire a first stabilized image, wherein an accumulation result of first motions, each of which is estimated between adjacent images from a reference image to an arbitrary image, is inversely transformed into the first compensated motion; and acquiring a second motion estimated between the reference image and the first stabilized image and applying the accumulation result of the first motions and a second compensated motion to the image to acquire a second stabilized image. An accumulation result of the second motion is inversely transformed into the second compensated motion.

First claim

What is claimed is:

1. A method of stabilizing a target image, the method comprising:
applying a first compensated motion to the target image to acquire a first stabilized image, wherein an accumulation result of first motions, each of which is estimated between adjacent images from a reference image to the target image, in a plurality of images sequentially obtained by a camera, is inversely transformed into the first compensated motion; and
acquiring a second motion estimated between the reference image and the first stabilized image and applying a second compensated motion to the target image to acquire a second stabilized image, wherein the accumulation result of first motions and the second motion are inversely transformed into the second compensated motion.

2. The method of claim 1 , wherein the first stabilized image comprises drift errors with respect to the first motions.

3. The method of claim 2 , wherein the second stabilized image is an image from which the drift errors have been removed by the second compensated motion.

4. The method of claim 1 , wherein the acquiring of the first stabilized image comprises:
acquiring the first compensated motion into which the accumulation result of the first motions, each of which is estimated between adjacent images from the reference image to the target image, is inversely transformed; and
inversely applying the first compensated motion to the target image to acquire the first stabilized image.

5. The method of claim 4 , wherein the acquiring of the first compensated motion comprises:
extracting characteristic points from a first image of the adjacent images;
tracking the characteristic points within a second image of the adjacent images to acquire corresponding points corresponding to the characteristic points;
estimating a first motion of the first motions as a motion of the second image with respect to the first image by using the corresponding points; and
acquiring the first compensated motion into which an accumulation result of the first motion and other first motions of the first motions, each of which is estimated between the adjacent images from the reference image to the first image, is inversely transformed.

6. The method of claim 5 , wherein the extracting of the characteristic points comprises:
reducing the first image and acquiring an edge image; and
in response to the number of edges existing in an arbitrary block of the edge image exceeding a threshold value, extracting the arbitrary block as a characteristic point of the characteristic points.

7. The method of claim 5 , wherein the estimating of the first motions comprises estimating of the first motions comprising movements, rotations, and size changes of the corresponding points.

8. The method of claim 1 , wherein the acquiring of the second stabilized image comprises:
acquiring the second motion estimated between the reference image and the first stabilized image;
acquiring the second compensated motion into which the accumulation result of the first motions and the second motion are inversely transformed; and
applying the second compensated motion to the target image to acquire the second stabilized image.

9. The method of claim 8 , wherein the acquiring of the second motion comprises:
extracting characteristic points from the reference image;
tracking the characteristic points within the first stabilized image to acquire corresponding points corresponding to the characteristic points; and
estimating the second motion as a motion of the first stabilized image with respect to the reference image by using the corresponding points.

10. The method of claim 9 , wherein the extracting of the characteristic points comprises:
reducing the reference image and acquiring an edge image; and
in response to the number of edges existing within an arbitrary block of the edge image exceeds a threshold value, extracting the arbitrary block as a characteristic point of the characteristic points.

11. The method of claim 9 , wherein the acquiring of the second motion comprises acquiring the second motion comprising movements, rotations, and size changes of the corresponding points.

12. An apparatus for stabilizing a target image, the apparatus comprising:
at least one processor which implements:
a first stabilized image acquirer configured to accumulate first motions, each of which is estimated between adjacent images from a reference image to the target image, in a plurality of images sequentially obtained by a camera, and inversely apply the accumulation result as a first compensated motion to the target image to acquire a first stabilized image; and
a second stabilized image acquirer configured to acquire a second motion, estimated between the reference image and the first stabilized image, and apply a second compensated motion, into which the accumulation result of the first motions and the second motion are inversely transformed, to the target image to acquire a second stabilized image.

13. The apparatus of claim 12 , wherein the first stabilized image comprises drift errors with respect to the first motions, and the second stabilized image is an image from which the drift errors have been removed by the second compensated motion.

14. The apparatus of claim 12 , wherein the first stabilized image acquirer comprises:
a first compensated motion acquirer configured to acquire the first compensated motion into which the accumulation result of the first motions, each of which is estimated between adjacent images from the reference image to the target image, is inversely transformed; and
a first stabilized image outputter configured to apply the first compensated motion to the target image to output the first stabilized image.

15. The apparatus of claim 14 , wherein the first compensated motion acquirer is further configured to extract characteristic points from a first image of the adjacent images, track the characteristic points within a second image of the adjacent images to acquire corresponding points corresponding to the characteristic points, estimate a first motion of the first motions as a motion of the second image with respect to the first image by using the corresponding points, and acquire the first compensated motion into which the first motion and other first motions of the first motions, each of which is estimated between the adjacent images from the reference image to a previous image of the target image, are inversely transformed.

16. The apparatus of claim 12 , wherein the second stabilized image acquirer comprises:
a second motion acquirer configured to acquire the second motion estimated between the reference image and the first stabilized image;
a second compensated motion acquirer configured to acquire the second compensated motion into which the accumulation result of the first motion and the second motion are inversely transformed; and
a second stabilized image outputter configured to apply the second compensated motion to the target image to output the second stabilized image.

17. The apparatus of claim 16 , wherein the second motion acquirer is further configured to extract characteristic points from the reference image, track the characteristic points within the first stabilized image to acquire corresponding points corresponding to the characteristic points, and estimate the second motion as a motion of the first stabilized image with respect to the reference image by using the corresponding points.

18. The apparatus of claim 17 , wherein the second motion acquirer is further configured to reduce

Assignees

• Hanwha Techwin Co Ltd
• Hanwha Techwin Co Ltd

Inventors

• Ryu Yeon-Geol
• Lee Hwal-Suk
• Park Sang-Ji

Classifications

• H04N23/683

  performed by a processor, e.g. controlling the readout of an image memory · CPC title

• H04N23/6811 Primary

  based on the image signal · CPC title

• G06T7/20 Primary

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• H04N5/23254 Primary

  Electricity · mapped topic

• H04N5/23267

  Electricity · mapped topic