Image fusion method and electronic device

Patent metadata

Field	Value
Publication number	US-12136195-B2
Application number	US-202217915580-A
Country	US
Kind code	B2
Filing date	Mar 3, 2022
Priority date	May 10, 2021
Publication date	Nov 5, 2024
Grant date	Nov 5, 2024

Abstract

An image fusion method and an electronic device, which relate to the field of electronic device technologies, are provided, to simplify a process of capturing a plurality of images with different features. A specific solution includes: capturing, by the electronic device, a first image, a second image, and a third image. The electronic device can process the first image to obtain a fourth image. Then, the electronic device can perform image fusion on the second image and the fourth image to obtain a fifth image. The electronic device can process the third image to obtain a sixth image. Then, the electronic device can perform image fusion on the fifth image and the sixth image to obtain a seventh image.

First claim

What is claimed is:

1. An image fusion method, applicable to an electronic device, wherein the electronic device comprises a first camera, a second camera, and a third camera, a field of view of the first camera is greater than a field of view of the second camera, and a field of view of the third camera is greater than the field of view of the first camera, the method comprising:
detecting, by the electronic device, a first operation;
capturing, by the electronic device, a first image through the first camera, a second image through the second camera, and a third image through the third camera in response to the first operation, wherein a viewfinder coverage in which the first camera captures the first image is a first viewfinder coverage, a viewfinder coverage in which the second camera captures the second image is a second viewfinder coverage, a viewfinder coverage in which the third camera captures the third image is a third viewfinder coverage, the third viewfinder coverage is greater than the first viewfinder coverage, and the first viewfinder coverage is greater than the second viewfinder coverage;
processing, by the electronic device, the first image to obtain a fourth image, wherein the fourth image comprises a first region image, a resolution of the first region image in the fourth image is the same as a resolution of the second image, a viewfinder coverage of the first region image relative to the first camera is a fourth viewfinder coverage, the first viewfinder coverage comprises the fourth viewfinder coverage, and the fourth viewfinder coverage coincides with the second viewfinder coverage;
performing, by the electronic device, image fusion on the second image and the fourth image to obtain a fifth image;
processing, by the electronic device, the third image to obtain a sixth image, wherein the sixth image comprises a second region image, a resolution of the second region image in the sixth image is the same as a resolution of the fifth image, a viewfinder coverage of the second region image relative to the third camera is a fifth viewfinder coverage, the third viewfinder coverage comprises the fifth viewfinder coverage, and the fifth viewfinder coverage coincides with the first viewfinder coverage; and
performing, by the electronic device, image fusion on the fifth image and the sixth image to obtain a seventh image;
receiving, by the electronic device, a second operation, wherein the second operation is used for triggering the electronic device to display the seventh image; and
displaying, by the electronic device, a second interface in response to the second operation, wherein the second interface comprises the seventh image and a preset ratio option, and the preset ratio option is configured to set a zoom ratio of the seventh image; and
receiving, by the electronic device, a zoom ratio set by a user in the preset ratio option, and displaying the seventh image according to the zoom ratio set by the user.

2. The method according to claim 1 , wherein the processing, by the electronic device, the first image to obtain a fourth image comprises:
performing, by the electronic device, super-resolution reconstruction on the first image to obtain the fourth image.

3. The method according to claim 1 , wherein the processing, by the electronic device, the third image to obtain a sixth image comprises:
performing, by the electronic device, super-resolution reconstruction on the third image to obtain the sixth image.

4. The method according to claim 1 , wherein the second interface further comprises an automatic playback button, and the automatic playback button is configured to trigger the electronic device to display a first interface, wherein
the first interface is configured to play a dynamic screen in which the seventh image is centered on a third region image and is automatically zoomed, wherein the seventh image comprises the third region image, a viewfinder coverage of the third region image relative to the third camera is a sixth viewfinder coverage, the third viewfinder coverage comprises the sixth viewfinder coverage, and the sixth viewfinder coverage coincides with the second viewfinder coverage.

5. The method according to claim 1 , wherein the first camera is a main camera, the second camera is a telephoto camera, and the third camera is a wide-angle camera.

6. An image fusion method, applicable to an electronic device, wherein the electronic device comprises a first camera, a second camera, a third camera, and a fourth camera, a field of view of the first camera is greater than a field of view of the second camera, a field of view of the third camera is greater than the field of view of the first camera, and a field of view of the fourth camera is the same as the field of view of the first camera, the method comprising:
detecting, by the electronic device, a first operation;
capturing, by the electronic device, a first image through the first camera, a second image through the second camera, a third image through the third camera, and an eighth image through the fourth camera in response to the first operation, wherein a viewfinder coverage in which the first camera captures the first image is a first viewfinder coverage, a viewfinder coverage in which the second camera captures the second image is a second viewfinder coverage, a viewfinder coverage in which the third camera captures the third image is a third viewfinder coverage, the third viewfinder coverage is greater than the first viewfinder coverage, the first viewfinder coverage is greater than the second viewfinder coverage, and a viewfinder coverage in which the fourth camera captures the eighth image is the same as the first viewfinder coverage;
performing, by the electronic device, image fusion on the first image and the eighth image to obtain a ninth image;
processing, by the electronic device, the ninth image to obtain a fourth image, wherein the fourth image comprises a first region image, a resolution of the first region image in the fourth image is the same as a resolution of the second image, a viewfinder coverage of the first region image relative to the first camera is a fourth viewfinder coverage, the first viewfinder coverage comprises the fourth viewfinder coverage, and the fourth viewfinder coverage coincides with the second viewfinder coverage;
performing, by the electronic device, image fusion on the second image and the fourth image to obtain a fifth image;
processing, by the electronic device, the third image to obtain a sixth image, wherein the sixth image comprises a second region image, a resolution of the second region image in the sixth image is the same as a resolution of the fifth image, a viewfinder coverage of the second region image relative to the third camera is a fifth viewfinder coverage, the third viewfinder coverage comprises the fifth viewfinder coverage, and the fifth viewfinder coverage coincides with the first viewfinder coverage; and
performing, by the electronic device, image fusion on the fifth image and the sixth image to obtain a seventh image.

7. The method according to claim 6 , wherein the processing, by the electronic device, the ninth image to obtain a fourth image comprises:
performing, by the electronic device, super-resolution reconstruction on the ninth image to obtain the fourth image.

8. The method according to claim 6 , wherein the processing, by the electronic device, the third image to obtain a sixth image comprises:
performing, by the electronic device, super-resolution reconstruction on the third image to obtain the sixth image.

9. The method according to claim 6 , wherein after the performing, by the electronic device, image fusion on the fifth image and the sixth image to obtain a seven

Assignees

• Honor Device Co Ltd

Inventors

• Xiao Bin
• Ding Dajun
• Lu Yang
• Wang Yu
• Zhu Congchao

Classifications

• G06T2207/20221

  Image fusion; Image merging · CPC title

• H04N23/62 Primary

  Control of parameters via user interfaces · CPC title

• H04N23/632

  for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title