Apparatus of stabilizing shaking image and controlling method thereof

Patent metadata

Field	Value
Publication number	US-10491821-B2
Application number	US-201815890334-A
Country	US
Kind code	B2
Filing date	Feb 6, 2018
Priority date	Feb 6, 2017
Publication date	Nov 26, 2019
Grant date	Nov 26, 2019

Abstract

An electronic apparatus includes a camera module including an optical image stabilizer (OIS) module and an image sensor, and at least one processor. The at least one processor is configured to control the camera module to calculate an error based on an operation of the OIS module responsive to movement of the electronic apparatus during at least part of time of the first exposure, to interrupt the first exposure and obtain a first image corresponding to the first exposure, based on the fact that the calculated error exceeds a critical value, to obtain a second image corresponding to the second exposure, and to generate a third image, in which at least part of the movement is corrected, by using the first image and the second image.

First claim

What is claimed is:

1. An electronic apparatus comprising:
a camera module including an optical image stabilizer (OIS) module and an image sensor; and
at least one processor configured to:
control the camera module to initiate a first exposure for allowing light generated or reflected from an external object to enter the image sensor,
calculate an error based on an operation of the OIS module responsive to a movement of the electronic apparatus during at least part of time of the first exposure,
interrupt the first exposure and obtain a first image corresponding to the first exposure, based on a determination that the calculated error exceeds a critical value,
initiate a second exposure for allowing light generated or reflected from the external object to enter the image sensor, in response to interruption of the first exposure,
obtain a second image corresponding to the second exposure, and

generate a third image, in which at least part of the movement is corrected, by using the first image and the second image.

2. The electronic apparatus of claim 1 , wherein the at least one processor includes a first processor and a second processor, and
wherein the first processor is configured to:
obtain the first image and the second image; and
generate the third image by using the first image and the second image, and

wherein the second processor is configured to:
sense the movement of the electronic apparatus to transmit information about the movement of the electronic apparatus to the OIS module; and
calculate the error based on the operation of the OIS module.

3. The electronic apparatus of claim 1 , wherein the at least one processor is configured to:
interrupt the second exposure within a range in which a time when the first exposure and the second exposure are made does not exceed a specified time.

4. The electronic apparatus of claim 3 , wherein the specified time is an exposure time necessary for the camera module to capture the external object based on brightness of the external object.

5. The electronic apparatus of claim 1 , wherein the error occurring in the OIS module is a difference value between a calculated value necessary to arrange a lens or the image sensor of the OIS module and a value at which the lens or the image sensor adjusted by the OIS module is arranged, in response to the movement of the electronic apparatus.

6. The electronic apparatus of claim 1 , wherein the at least one processor is configured to:
determine a first composition area in the first image, based on the movement of the electronic apparatus sensed from a motion sensing module during the first exposure;
determine a second composition area in the second image, based on the movement of the electronic apparatus sensed from the motion sensing module during the second exposure; and
generate the third image by using the first composition area of the first image and the second composition area of the second image.

7. The electronic apparatus of claim 6 , wherein the first composition area of the first image and the second composition area of the second image include a pixel obtained by capturing a same area of the external object.

8. The electronic apparatus of claim 6 , wherein the movement of the electronic apparatus is defined as a movement angle calculated based on an initial posture of the electronic apparatus, when the at least one processor initiates the first exposure.

9. The electronic apparatus of claim 6 , wherein the at least one processor is configured to:
determine the first composition area of the first image and the second composition area of the second image, during the first exposure or the second exposure based on an average value of movement or an intermediate value between maximum movement and minimum movement, which is calculated based on an initial posture of the electronic apparatus upon initiating the first exposure.

10. The electronic apparatus of claim 1 , wherein the processor is configured to:
obtain the first image based on the movement of the electronic apparatus sensed from a motion sensing module during the first exposure; and
obtain the second image based on the movement of the electronic apparatus sensed from the motion sensing module during the second exposure.

11. The electronic apparatus of claim 10 , wherein the at least one processor is configured to:
during the first exposure, determine a first output area to be output in the image sensor based on the movement of the electronic apparatus sensed from the motion sensing module and obtain the first image from the first output area of the image sensor; and
during the second exposure, determine a second output area to be output in the image sensor based on the movement of the electronic apparatus sensed from the motion sensing module and obtain the second image from the second output area of the image sensor.

12. The electronic apparatus of claim 11 , wherein the first output area of the image sensor for obtaining the first image and the second output area of the image sensor for obtaining the second image include a pixel obtained by capturing a same area of the external object.

13. A controlling method of an electronic apparatus, the method comprising:
initiating a first exposure for allowing light generated or reflected from an external object to enter an image sensor, through a camera module;
calculating an error based on an operation of an OIS module responsive to a movement of the electronic apparatus sensed from a motion sensing module during at least part of time of the first exposure;
interrupting the first exposure based on a determination that the calculated error exceeds a critical value;
obtaining a first image corresponding to the first exposure;
initiating a second exposure for allowing light generated or reflected from the external object to enter the image sensor, in response to interruption of the first exposure;
obtaining a second image corresponding to the second exposure; and
generating a third image, in which at least part of the movement is corrected, by using the first image and the second image.

14. The method of claim 13 , further comprising:
interrupting the second exposure within a range in which a time when the first exposure and the second exposure are made does not exceed a specified time.

15. The method of claim 13 , wherein the generating of the third image includes:
determining a first composition area in the first image, based on the movement of the electronic apparatus sensed from the motion sensing module during the first exposure;
determining a second composition area in the second image, based on the movement of the electronic apparatus sensed from the motion sensing module during the second exposure; and
generating the third image by using the first composition area of the first image and the second composition area of the second image.

16. The method of claim 15 , wherein the first composition area of the first image and the second composition area of the second image include a pixel obtained by capturing a same area of the external object.

17. The method of claim 15 , wherein the determining the composition area in the first image includes:
determining the first composition area in the first image by using a movement angle calculated based on an initial posture of the electronic apparatus upon initiating the first exposure, during the first exposure, and
wherein the determining the second composition area in the second image includes:
determining the second composition area in the second image by using the movement angle

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kim Han Sung
• Yun Jae Mu
• Lee Jeong Won
• Moon Jae Joon
• Park Jae Hyoung

Classifications

• H04N23/6845 Primary

  by combination of a plurality of images sequentially taken · CPC title

• H04N23/73

  by influencing the exposure time · CPC title

• H04N23/6812 Primary

  based on additional sensors, e.g. acceleration sensors · CPC title

• H04N5/23258 Primary

  Electricity · mapped topic

• H04N5/23277

  Electricity · mapped topic