Method and electronic device for stabilizing video

Patent metadata

Field	Value
Publication number	US-9860448-B2
Application number	US-201514943354-A
Country	US
Kind code	B2
Filing date	Nov 17, 2015
Priority date	Jul 27, 2015
Publication date	Jan 2, 2018
Grant date	Jan 2, 2018

Abstract

A method of stabilizing a video in an electronic device is disclosed. The method includes determining shaking compensation areas corresponding to a respective plurality of frames acquired through an image sensor in entire areas of the respective plurality of frames based on shaking information of the plurality of frames and information on the magnification, generating output frames corresponding to the respective plurality of frames by enlarging the shaking compensation areas at the magnification, and providing a video including the output frames.

First claim

What is claimed is:

1. A method of stabilizing a video in an electronic device, comprising:
acquiring a plurality of input frames at constant magnification using an image signal input from an image sensor;
receiving an input requesting enlargement at a magnification in relation to the plurality of input frames;
acquiring shaking information of the plurality of input frames using at least one of: information on movement of a subject included in the plurality of frames, and movement of the electronic device;
determining shaking compensation areas in entire areas of each of the plurality of input frames for the respective plurality of input frames, after and based at least on receiving the input requesting enlargement, said determining of the shaking compensation areas being based on the shaking information of the plurality of input frames and information on the magnification from the input requesting enlargement;
generating output frames corresponding to the respective plurality of input frames by enlarging the shaking compensation areas at the magnification; and
providing a video including the output frames.

2. The method of claim 1 , wherein the acquiring of the plurality of input frames comprises acquiring frames having a maximum angle of view obtained by the electronic device.

3. The method of claim 1 , wherein the receiving of an input comprises:
receiving a pinch input through a touch screen on which a preview image is displayed; and
determining the magnification and an initial zoom area based on the pinch input.

4. The method of claim 1 , wherein the acquiring of the shaking information of the plurality of input frames comprises:
acquiring first movement information of the movement of the subject included in the plurality of input frames based on comparing the plurality of frames;
acquiring second movement information of the movement of the electronic device corresponding to a duration of acquisition of the plurality of input frames using at least one sensor included in the electronic device; and
acquiring the shaking information of the plurality of input frames using at least one of the first movement information and the second movement information.

5. The method of claim 1 , wherein the determining of the shaking compensation areas for the respective plurality of input frames comprises:
determining a stabilization path opposed to the movement of the electronic device or corresponding to the movement of the subject based on the shaking information; and
determining the shaking compensation areas corresponding to the respective plurality of frames based on the stabilization path.

6. The method of claim 5 , wherein the determining of the stabilization path comprises determining the stabilization path based at least in part on resolution information of the plurality of input frames.

7. The method of claim 1 , wherein the generating of the output frames comprises correcting rolling shutter distortion of at least one of the plurality of frames based on motion vectors of the plurality of frames.

8. The method of claim 1 , wherein the generating of the output frames corresponding to the respective plurality of input frames comprises compensating for rotation in at least one of the plurality of input frames based on rotational component information included in the shaking information.

9. The method of claim 8 , wherein the compensating for the rotation in the at least one input frame comprises:
translating a first shaking compensation area of a first frame among the plurality of frames to a central area of the first frame;
rotating the first shaking compensation area by an angle; and
translating the rotated first shaking compensation area to the central area of the first frame.

10. The method of claim 1 , further comprising:
providing a selection window configured to enable selection of a first stabilization method of determining a shaking compensation area in a cropping area of an input frame or a second stabilization method of determining a shaking compensation area in an entire area of an input frame; and
generating the video based on the method selected through the selection window.

11. The method of claim 10 , further comprising:
providing a graphical user interface (GUI) including a first play button corresponding to a first video generated by the first stabilization method and a second play button corresponding to a second video generated by the second stabilization method; and
playing one of the first video and the second video based on a selection of one of the first play button and the second play button.

12. An electronic device comprising:
a user interface (UI) configured to receive an input requesting enlargement at a magnification in relation to a plurality of frames at constant magnification acquired from an image sensor;
a controller configured to acquire shaking information of the plurality of frames using at least one of information on movement of a subject included in the plurality of frames and movement of the electronic device, to determine shaking compensation areas in entire areas of each of the plurality of frames for the respective plurality of frames based on the shaking information of the plurality of frames and information on the magnification from the input requesting enlargement, and to generate output frames corresponding to the respective plurality of frames by enlarging the shaking compensation areas at the magnification; and
an output configured to output a video including the output frames.

13. The electronic device of 12 , wherein angles of view of the respective plurality of frames are wider than angles of view of the output frames.

14. The electronic device of 12 , wherein the UI receives a pinch input through a touch screen on which a preview image is displayed, and
the controller is configured to determine the magnification and an initial zoom area based on the pinch input.

15. The electronic device of 12 , wherein the controller is configured to acquire first movement information of the movement of the subject included in the plurality of frames based on results of comparing the plurality of frames, to acquire second movement information of the movement of the electronic device corresponding to a duration of acquisition of the plurality of frames using at least one sensor included in the electronic device, and to acquire the shaking information of the plurality of frames using at least one of the first movement information and the second movement information.

16. The electronic device of 12 , wherein the controller is configured to determine a stabilization path opposed to the movement of the electronic device or corresponding to the movement of the subject based on the shaking information, and to determine the shaking compensation areas corresponding to the respective plurality of frames based on the stabilization path.

17. The electronic device of 16 , wherein the controller is configured to determine the stabilization path based at least in part on resolution information of the plurality of frames.

18. The electronic device of 12 , wherein the controller is configured to correct rolling shutter distortion of at least one of the plurality of frames based on motion vectors of the plurality of frames.

19. The electronic device of 12 , wherein the controller is configured to compensate for rotation in at least one of the plurality of frames based on rotational component information included in the shaking information.

20. A non-transitory computer-reada

Assignees

• Samsung Electronics Co Ltd

Inventors

• Yoo Hyung-Chul
• Kim Nak-Hoon
• Seo Duk-Chan

Classifications

• H04N23/6811

  based on the image signal · CPC title

• H04N23/62 Primary

  Control of parameters via user interfaces · CPC title

• H04N23/6812

  based on additional sensors, e.g. acceleration sensors · CPC title

• H04N23/683

  performed by a processor, e.g. controlling the readout of an image memory · CPC title

• H04N23/69

  Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming · CPC title