Removing unwanted objects from photographed image

Patent metadata

Field	Value
Publication number	US-9560271-B2
Application number	US-201414319667-A
Country	US
Kind code	B2
Filing date	Jun 30, 2014
Priority date	Jul 16, 2013
Publication date	Jan 31, 2017
Grant date	Jan 31, 2017

Abstract

A device and method for processing an image in a device having a camera is disclosed. A motion vector of an unwanted object in preview frames of the desired image is identified. A photographing interval in accordance with the motion vector may be set. Continuous frames of the desired image may be photographed in accordance with the photographing interval. The unwanted object is removed from the desired image.

First claim

What is claimed is:

1. A method comprising:
identifying a motion vector of an unwanted object in preview frames of a desired image obtained by a camera;
setting a photographing interval in accordance with the motion vector, wherein the motion vector comprises a size of the unwanted object and a speed of the unwanted object;
photographing continuous frames of the desired image in accordance with the photographing interval; and
removing the unwanted object from the desired image so as to restore a background behind the unwanted object using the continuous frames and the photographing interval,
wherein setting the photographing interval comprises:
identifying the size of the unwanted object as it moves; and
analyzing the size of the unwanted object and the speed of the unwanted object,
wherein setting the photographing interval further comprises:
dividing the size of each unwanted object with the motion vector of each unwanted object; and
identifying a maximum photographing frames per second based at least partially on a slowest unwanted object having a largest size.

2. The method of claim 1 , further comprising displaying the desired image by synthesizing frames of the desired image with the object removed.

3. The method of claim 2 , wherein removing the object comprises selecting a plurality of the continuous frames without any blur such that the selected frames render the background in an area from which the object is removed.

4. The method of claim 2 , wherein identifying the motion vector comprises:
identifying pixels having a similar brightness difference between the preview frames; and
defining a size and direction of the identified pixels as the motion vector.

5. The method of claim 1 , wherein setting the photographing interval comprises:
identifying a size of each unwanted object; and
analyzing the size and a speed of each unwanted object.

6. A method comprising:
identifying a motion vector of an unwanted object in preview frames of a desired image obtained by a camera;
setting a photographing interval in accordance with the motion vector;
photographing continuous frames of the desired image in accordance with the photographing interval; and
removing the unwanted object from the desired image so as to restore a background behind the unwanted object using the continuous frames and the photographing interval,
wherein setting the photographing interval comprises:
calculating an average motion vector of unwanted objects identified in a predetermined number of frames;
calculating a difference of a given motion vector detected in a given frame and the average motion vector;
setting a photographing time and the photographing interval based at least partially on the difference; and
applying the photographing time and the photographing interval against the continuous frames so as to remove the unwanted object.

7. An apparatus for processing an image in an electronic device, the apparatus comprising:
a camera;
a control unit to:
identify a motion vector of an unwanted object in preview frames of a desired image obtained by the camera;
set a photographing interval in accordance with the motion vector, wherein the motion vector comprises a size of the unwanted object and a speed of the unwanted object;
photograph continuous frames of the desired image with the camera in accordance with the photographing interval;
remove the unwanted object from the desired image so as to restore a background behind the unwanted object with the continuous frames and the photographing interval,
wherein the control unit to further:
identify the size of the unwanted object as it moves; and
analyzing the size of the unwanted object and the speed of the unwanted object to determine a photographing time and the photographing interval applied against the continuous frames so as to remove the unwanted object,
wherein to set the photographing interval the control unit to further:
divide the size of each unwanted object with the motion vector of each unwanted object: and
identify a maximum photographing frames per second based at least partially on a slowest unwanted object having a largest size.

8. The apparatus of claim 7 , wherein the control unit comprises:
an image processing unit to process the preview frames;
a buffer to buffer the preview frames;
an analyzer to identify motion vectors of unwanted objects in the preview frames;
a shooting time setting unit to identify the photographing interval in accordance with the motion vector; and
an image synthesizer to select a plurality of the continuous frames in the buffer in accordance with the photographing interval so as to replace the unwanted object with the background.

9. The apparatus of claim 8 , wherein the control unit to further:
store the continuous frames in the buffer;
generate the desired image by synthesizing continuous frames without the unwanted object;
display the desired image on a display unit; and
store the desired image in a storage unit.

10. The apparatus of claim 9 , wherein the control unit to further select a plurality of the continuous frames without any blur such that the selected frames render the background in an area from which the object is removed.

11. The apparatus of claim 9 , wherein the control unit to further:
identify pixels having a similar brightness difference between the preview frames; and
define a size and direction of the identified pixels as the motion vector.

12. The apparatus of claim 7 , wherein to set the photographing interval the control unit to further:
identify a size of each unwanted object; and
analyze the size and a speed of each unwanted object.

13. An apparatus for processing an image in an electronic device, the apparatus comprising:
a camera;
a control unit to:
identify a motion vector of an unwanted object in preview frames of a desired image obtained by the camera;
set a photographing interval in accordance with the motion vector;
photograph continuous frames of the desired image with the camera in accordance with the photographing interval;
remove the unwanted object from the desired image so as to restore a background behind the unwanted object with the continuous frames and the photographing interval
wherein to set the photographing interval the control unit to further:
calculate an average motion vector of unwanted objects identified in a predetermined number of frames;
calculate a difference of a given motion vector detected in a given frame and the average motion vector; and
set a photographing time and the photographing interval based at least partially on the difference.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Na Jinhee
• Lee Kihuk

Classifications

• G09G2320/106

  Determination of movement vectors or equivalent parameters within the image · CPC title

• H04N5/265

  Mixing · CPC title

• H04N5/2625

  for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect (sequence generated by event triggered capturing H04N7/188) · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• H04N23/6811

  based on the image signal · CPC title