Photographing method for terminal and terminal

Patent metadata

Field	Value
Publication number	US-10827107-B2
Application number	US-201616345603-A
Country	US
Kind code	B2
Filing date	Dec 5, 2016
Priority date	Oct 28, 2016
Publication date	Nov 3, 2020
Grant date	Nov 3, 2020

Abstract

A method includes: obtaining a target zoom ratio; simultaneously photographing a monochrome image and a color image of a target scene based on the target zoom ratio, where resolution of the monochrome image is higher than that of the color image, and there is at least one monochrome image and at least one color image; correspondingly cropping the monochrome image and the color image based on the target zoom ratio, where a field of view corresponding to a monochrome image obtained through cropping is the same as a field of view corresponding to a color image obtained through cropping; and performing fusion on the monochrome image obtained through cropping and the color image obtained through cropping, to obtain a color zoom image.

First claim

What is claimed is:

1. A method, comprising:
obtaining, by a terminal, a target zoom ratio, wherein the terminal comprises a plurality of camera lenses, the plurality of camera lenses comprises a monochrome camera lens and a color camera lens, the monochrome camera lens is configured to photograph static or dynamic monochrome images, the color camera lens is configured to photograph static or dynamic color images, resolution of the monochrome camera lens is higher than resolution of the color camera lens, and an optical axis of the monochrome camera lens is parallel to that of the color camera lens;
simultaneously photographing, by the terminal, a first monochrome image and a first color image of a target scene based on the target zoom ratio, wherein a resolution of the first monochrome image is higher than a resolution of the first color image;
correspondingly cropping, by the terminal, the first monochrome image and the first color image based on the target zoom ratio to obtain a second monochrome image and a second color image, wherein a field of view corresponding to the second monochrome image is the same as a field of view corresponding to the second color image; and
performing fusion, by the terminal, on the second monochrome image and the second color image, to obtain a color zoom image.

2. The method according to claim 1 , wherein the field of view corresponding to the second monochrome image is the same as the field of view corresponding to the second color image, and resolution of the second monochrome image is at least 1.6 times resolution of the second color image.

3. The method according to claim 1 , wherein the target zoom ratio is 3×, and an equivalent focal length of the monochrome camera lens and the color camera lens is between 75 mm and 85 mm.

4. The method according to claim 1 , wherein after the color zoom image is obtained, the method further comprises:
identifying a region of interest (ROI) in the color zoom image; and
performing blurring processing on a second region in the color zoom image, wherein the second region is different than the ROI.

5. The method according to claim 4 , wherein performing blurring processing on the second region in the color zoom image comprises:
calculating scene depth information of the color zoom image according to a binocular stereoscopic vision principle; and
performing blurring processing on the second region in the color zoom image based on foreground information of the color zoom image, an aperture value FUM of each of the monochrome camera lens and the color camera lens, and the scene depth information.

6. The method according to claim 5 , wherein:
simultaneously photographing, by the terminal, the first monochrome image and the first color image of the target scene based on the target zoom ratio comprises:
simultaneously photographing, by the terminal, a plurality of first monochrome images and a plurality of first color images of the target scene based on the target zoom ratio; and

calculating the scene depth information of the color zoom image according to the binocular stereoscopic vision principle comprises:
selecting, from the plurality of first monochrome images and the plurality of first color images based on contrast information of the plurality of first monochrome images, contrast information of the plurality of first color images, and information collected by a gyroscope of the terminal, one first monochrome image and one first color image that have minimum jitter information or maximum contrast information, and calculating the scene depth information of the color zoom image based on the selected one first monochrome image, the selected one first color image, and the binocular stereoscopic vision principle.

7. A terminal, comprising:
a plurality of camera lenses, wherein the plurality of camera lenses comprises a monochrome camera lens and a color camera lens, the monochrome camera lens is configured to photograph static or dynamic monochrome images, the color camera lens is configured to photograph static or dynamic color images, resolution of the monochrome camera lens is higher than resolution of the color camera lens, and an optical axis of the monochrome camera lens is parallel to that of the color camera lens;
a processor; and
a non-transitory computer-readable storage medium storing a program to be executed by the processor, the program including instructions for:
obtaining a target zoom ratio;
simultaneously photographing, using the plurality of camera lenses, a first monochrome image and a first color image of a target scene based on the target zoom ratio, wherein a resolution of the first monochrome image is higher than a resolution of the first color image;
correspondingly cropping the first monochrome image and the first color image based on the target zoom ratio to obtain a second monochrome image and a second color image, wherein a field of view corresponding to the second monochrome image is the same as a field of view corresponding to the second color image; and
performing fusion on the second monochrome image and the second color image, to obtain a color zoom image.

8. The terminal according to claim 7 , wherein the program further includes instructions for:
identifying a region of interest (ROI) in the color zoom image; and
performing blurring processing on a second region in the color zoom image, wherein the second region is different than the ROI.

9. The terminal according to claim 8 , wherein performing blurring processing on the second region in the color zoom image comprises:
calculating scene depth information of the color zoom image according to a binocular stereoscopic vision principle; and
performing blurring processing on the second region in the color zoom image based on foreground information of the color zoom image, an aperture value FUM of each of the monochrome camera lens and the color camera lens, and the scene depth information.

10. The terminal according to claim 9 , wherein:
simultaneously photographing, by the terminal, the first monochrome image and the first color image of a target scene based on the target zoom ratio comprises:
simultaneously photographing, by the terminal, a plurality of first monochrome images and a plurality of first color images of the target scene based on the target zoom ratio; and

calculating the scene depth information of the color zoom image according to the binocular stereoscopic vision principle comprises:
selecting, from the plurality of first monochrome images and the plurality of first color images based on contrast information of the plurality of first monochrome images, contrast information of the plurality of first color images, and information collected by a gyroscope of the terminal, one first monochrome image and one first color image that have minimum jitter information or maximum contrast information, and calculating the scene depth information of the color zoom image based on the selected one first monochrome image, the selected one first color image, and the binocular stereoscopic vision principle.

11. The terminal according to claim 7 , wherein the field of view corresponding to the second monochrome image is the same as the field of view corresponding to the second color image, and resolution of the second monochrome image is at least 1.6 times resolution of the second color image.

12. The terminal according to claim 7 , wherein the target zoom ratio is 3×, and an equivalent focal length of the monochrome camera lens and the color camera lens is between 75 mm and 85 mm.

13. A non-transitory computer-readable storage medium storing a program to be executed by a processor

Assignees

• Huawei Tech Co Ltd

Inventors

• Li Jiangwei

Classifications

• G06T3/4053 Primary

  based on super-resolution, i.e. the output image resolution being higher than the sensor resolution · CPC title

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title

• H04N23/10

  for generating image signals from different wavelengths · CPC title

• H04N23/69

  Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming · CPC title

• H04N23/951

  by using two or more images to influence resolution, frame rate or aspect ratio · CPC title