Method and apparatus for fusing a first image and a second image

Patent metadata

Field	Value
Publication number	US-9870602-B2
Application number	US-201415101759-A
Country	US
Kind code	B2
Filing date	Dec 4, 2014
Priority date	Dec 6, 2013
Publication date	Jan 16, 2018
Grant date	Jan 16, 2018

Abstract

The present invention provides a method to resolve a technical problem of a “ghost”. The method is applied to a terminal that includes a first camera lens and a second camera lens, where the both lenses are located on a same side of the terminal. The method includes: obtaining a first image that is captured by the first camera lens and is about a first area, and a second image that is captured at a same moment by the second camera lens and is about a second area; performing translation compensation on the second image by using the first image as a reference image; and fusing the first image and the second image that is obtained after translation compensation is performed, to generate a third image, where a resolution of the third image is higher than a resolution of the first image and a resolution of the second image.

First claim

What is claimed is:

1. An image processing method for use with a terminal having a first camera lens and a second camera lens, wherein the first camera lens and the second camera lens are located on a same side of the terminal, the method comprising:
acquiring a first image captured by the first camera lens and is about a first area, and acquiring a second image captured at a same moment by the second camera lens and is about a second area;
performing translation compensation on the second image by using the first image as a reference image; and
fusing the first image and the second image that is obtained after translation compensation is performed, to generate a third image, wherein a resolution of the third image is higher than a resolution of the first image and a resolution of the second image;
wherein performing translation compensation on the second image by using the first image as a reference image comprises:
determining a translation vector between the first image and the second image, and
performing, according to the translation vector, translation compensation on the second image captured by the second camera lens;

wherein the translation vector is determined by using the following formula:
d=B*f/Z ; wherein:
d indicates a translation vector of an object in the second image relative to the first image, wherein a distance between the object and a plane on which the first camera lens and the second camera lens are located is Z,
B indicates a distance between the first camera lens and the second camera lens,
Z indicates a vertical distance between the object and the plane on which the first camera lens and the second camera lens are located, and
f indicates a focal length of the first camera lens or a focal length of the second camera lens.

2. The method according to claim 1 , wherein fusing the first image and the second image that is obtained after translation compensation is performed, to generate a third image comprises:
determining a common area of the first image and the second image according to a result of the translation compensation; and
fusing the common area of the first image and the second image to generate the third image.

3. An image processing apparatus, comprising:
an acquiring module, configured to acquire a first image captured by a first camera lens and is about a first area, and a second image captured at a same moment by a second camera lens and is about a second area, wherein the first camera lens and the second camera lens are located on a same plane of the image processing apparatus;
a translation compensating module, connected to the acquiring module and configured to:
after the acquiring module obtains the first image and the second image, perform translation compensation on the second image by using the first image as a reference image; and

an image fusion module, connected to the translation compensating module and configured to:
after the translation compensating module performs translation compensation on the second image, fuse the first image and the second image that is obtained after translation compensation is performed, to generate a third image, wherein a resolution of the third image is higher than a resolution of the first image and a resolution of the second image;

wherein the translation compensating module comprises:
a first determining unit, configured to determine a translation vector between the first image and the second image, and
a compensating unit, connected to the first determining unit and configured to: after the first determining unit determines the translation vector, perform, according to the translation vector, translation compensation on the second image captured by the second camera lens;

wherein the determining unit is configured to determine the translation vector by using the following formula:
d=B*f/Z ; wherein:
d indicates a translation vector of an object in the second image relative to the first image, wherein a distance between the object and a plane on which the first camera lens and the second camera lens are located is Z,
B indicates a distance between the first camera lens and the second camera lens,
Z indicates a vertical distance between the object and the plane on which the first camera lens and the second camera lens are located, and
f indicates a focal length of the first camera lens or a focal length of the second camera lens.

4. The apparatus according to claim 3 , wherein the image fusion module comprises:
a second determining unit, configured to determine a common area of the first image and the second image according to a result of the translation compensation; and
a fusing unit, connected to the second determining unit and configured to: after the second determining unit determines the common area, fuse the common area of the first image and the second image to generate the third image.

5. A terminal, comprising:
a first camera lens, configured to capture a first area to obtain a first image;
a second camera lens, configured to capture a second area at a same moment when the first camera lens captures the first image, to obtain a second image, wherein the first camera lens and the second camera lens are located on a same side of the ten final; and
a processor, connected to the first camera lens and the second camera lens, and configured to:
perform translation compensation on the second image by using the first image as a reference image,
fuse the first image and the second image that is obtained after translation compensation is performed, to generate a third image, wherein a resolution of the third image is higher than a resolution of the first image and a resolution of the second image,
determine a translation vector between the first image and the second image, and
perform, according to the translation vector, translation compensation on the second image captured by the second camera lens;

wherein the processor is configured to determine the translation vector by using the following formula:
d=B*f/Z ; wherein:
d indicates a translation vector of an object in the second image relative to the first image, wherein a distance between the object and a plane on which the first camera lens and the second camera lens are located is Z,
B indicates a distance between the first camera lens and the second camera lens,
Z indicates a vertical distance between the object and the plane on which the first camera lens and the second camera lens are located, and
f indicates a focal length of the first camera lens or a focal length of the second camera lens.

6. The terminal according to claim 5 , wherein:
an optical axis of the first camera lens is parallel to an optical axis of the second camera lens, and/or
the first camera lens and the second camera lens are disposed on the terminal in a fixed manner.

7. The terminal according to claim 5 , wherein the processor is further configured to:
determine a common area of the first image and the second image according to a result of the translation compensation; and
fuse the common area of the first image and the second image to generate the third image.

Assignees

• Huawei Device Co Ltd
• Huawei Device (Dongguan) Co Ltd

Inventors

• Chen Gang
• Zhang Jian
• Luo Wei

Classifications

• G06T3/4053 Primary

  based on super-resolution, i.e. the output image resolution being higher than the sensor resolution · CPC title

• H04N5/2621

  Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability · CPC title

• H04N23/68

  for stable pick-up of the scene, e.g. compensating for camera body vibrations · CPC title

• G06T2207/10004

  Still image; Photographic image · CPC title

• H04N5/211

  Ghost signal cancellation (H04N23/81 takes precedence) · CPC title