Apparatus for stabilizing digital image, operating method thereof, and electronic device having the same

Patent metadata

Field	Value
Publication number	US-11140330-B2
Application number	US-202017038952-A
Country	US
Kind code	B2
Filing date	Sep 30, 2020
Priority date	Feb 24, 2020
Publication date	Oct 5, 2021
Grant date	Oct 5, 2021

Abstract

A method of operating a digital image stabilization apparatus including acquiring motion information by a first camera for capturing an image of a first field of view, controlling a prism of a second camera using the motion information, acquiring a main image and a peripheral image by a second camera for capturing an image of a second field of view, the second field of view being narrower than the first field of view, and generating a stabilized frame image related to the main image using the motion information and the peripheral image may be provided.

First claim

What is claimed is:

1. A digital image stabilization apparatus comprising:
a first camera configured to acquire a first image of a first field of view;
a second camera configured to acquire a second image of a second field of view, the second field of view being narrower than the first field of view;
a first buffer memory configured to receive and store a main image of the second field of view for an object from the second camera;
a second buffer memory configured to receive and store a peripheral image for the main image from the second camera; and
a processor configured to control the first camera, the second camera, the first buffer memory, and the second buffer memory and perform a digital image stabilization function by synthesizing a frame image for the object using the main image and the peripheral image from the second camera,
wherein the processor is configured to control a prism of the second camera using motion information estimated from the first image, for acquiring the peripheral image from the second camera.

2. The digital image stabilization apparatus according to claim 1 , further comprising:
a gyro sensor configured to receive movement information of the object.

3. The digital image stabilization apparatus according to claim 1 , wherein the first camera is configured to operate in a low-resolution and low-power mode.

4. The digital image stabilization apparatus according to claim 3 , wherein the first camera includes a dynamic vision sensor (DVS).

5. The digital image stabilization apparatus according to claim 1 , wherein the second camera includes an RGB sensor.

6. The digital image stabilization apparatus according to claim 1 , wherein the processor is configured to:
extract motion information for the object using the first image and position information; and
control the prism of the second camera using the motion information for the object.

7. The digital image stabilization apparatus according to claim 6 , wherein the second camera is configured to store one frame corresponding to the peripheral image in the second buffer memory with regard to one frame corresponding to the main image.

8. The digital image stabilization apparatus according to claim 6 , wherein the second camera is configured to store a plurality of frames corresponding to the peripheral image in the second buffer memory with regard to one frame corresponding to the main image.

9. The digital image stabilization apparatus according to claim 6 , further comprising:
an illumination sensor configured to sense an illumination value,
wherein the processor is further configured to determine a number of frames corresponding to the peripheral image to be acquired from the second camera according to the illumination value.

10. A method of operating a digital image stabilization apparatus, comprising:
acquiring motion information by a first camera for capturing an image of a first field of view;
controlling a prism of a second camera using the motion information for acquiring a peripheral image from the second camera;
acquiring a main image and the peripheral image by the second camera for capturing an image of a second field of view, the second field of view being narrower than the first field of view; and
generating a stabilized frame image related to the main image using the motion information, the main image, and the peripheral image.

11. The method according to claim 10 , wherein the acquiring the motion information further comprises receiving position information from an acceleration sensor.

12. The method according to claim 10 , wherein the motion information comprises motion direction information according to a movement of an object.

13. The method according to claim 10 , wherein the controlling the prism comprises:
determining a driving direction of the prism; and
determining a priority of the prism for a movement direction.

14. The method according to claim 10 , further comprising:
driving the prism of the second camera to acquire images of an object in four directions including upward, downward, left, and right directions.

15. The method according to claim 14 , wherein the acquiring the motion information further comprises predicting shaking directions of the images using information of the images of the object in the four directions.

16. The method according to claim 15 , wherein the controlling the prism further comprises controlling position of the prism according to the shaking directions.

17. An electronic device comprising:
a camera module having a first camera and a second camera, the first camera configured to capture a first image of a first field of view, the second camera configured to capture a second image of a second field of view, the second camera configured to capture a main image for an object, and the second field of view being narrower than the first field of view;
a memory configured to store a code; and
at least one processor configured to,
execute the code to control a prism of the second camera using motion information acquired from the first image, for acquiring a peripheral image from the second camera, and
perform a digital image stabilization using the motion information, the main image, and the peripheral image.

18. The electronic device according to claim 17 , wherein the at least one processor is further configured to extract the motion information using position information acquired from a gyro sensor and an image acquired from the first camera.

19. The electronic device according to claim 17 , where
the camera module includes at least three cameras,
the first camera includes a wide-angle camera, and
the second camera includes a telephoto camera.

20. The electronic device according to claim 17 , where
the camera module includes at least three cameras,
the first camera includes an ultra wide-angle camera, and
the second camera includes a wide-angle camera.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Yi Eunjik
• JEONG Sooman
• Kim Heeshin
• Sung Hwansun
• Lee Suyoung
• Lee Jeongwook

Classifications

• H04N23/681 Primary

  Motion detection · CPC title

• H04N23/71 Primary

  Circuitry for evaluating the brightness variation · CPC title

• H04N23/10

  for generating image signals from different wavelengths · CPC title

• H04N23/75

  by influencing optical camera components · CPC title

• H04N23/687

  by shifting the lens or sensor position · CPC title