Photographing method and apparatus, medium and chip

Patent metadata

Field	Value
Publication number	US-12499559-B2
Application number	US-202217977423-A
Country	US
Kind code	B2
Filing date	Oct 31, 2022
Priority date	Jul 4, 2022
Publication date	Dec 16, 2025
Grant date	Dec 16, 2025

Abstract

A photographing method, including: obtaining a preview stream; detecting a movement speed of a photographed subject according to the preview stream; obtaining a first exposure time by shortening, according to the movement speed, an initial exposure time for preview frames in the preview stream, in response to determining that the movement speed is higher than a preset speed threshold; and capturing a picture based on the first exposure time.

First claim

What is claimed is:

1 . A photographing method, comprising:
obtaining a preview stream; detecting a movement speed of a photographed subject according to the preview stream; obtaining a first exposure time by shortening, according to the movement speed, an initial exposure time for preview frames in the preview stream, in response to determining that the movement speed is higher than a preset speed threshold; and capturing a picture based on the first exposure time, wherein detecting the movement speed of the photographed subject according to the preview stream comprises:
determining a change between the preview frames, and determining the movement speed of the photographed subject based on the change; or
evaluating a movement state of the photographed subject in the preview frames through a deep learning method, and determining the movement speed of the photographed subject based on an evaluation result, and
wherein before determining the change between the preview frames, the method further comprises:
determining area brightnesses corresponding to different areas of the preview frames, and
performing a self-adaptive brightening operation on an area having an area brightness lower than a second brightness, the second brightness being a threshold brightness tending to cause false detection of the movement speed.

2 . The method according to claim 1 , wherein shortening, according to the movement speed, the initial exposure time for the preview frames in the preview stream comprises:
shortening the initial exposure time according to a preset corresponding relationship between the movement speed and the first exposure time.

3 . A chip, comprising a one or more processors and an interface, wherein the one or more processors is are collectively configured to read an instruction, to execute the method according to claim 1 .

4 . The method according to claim 1 , wherein determining the movement speed of the photographed subject based on the change comprises:
determining the movement speed of the photographed subject based on changes and weights corresponding to different areas of the preview frames, wherein a weight corresponding to areas, having the photographed subject, of the preview frames is larger than a weight corresponding to areas, having no photographed subject, of the preview frames.

5 . The method according to claim 4 , further comprising:
obtaining a final movement speed by smoothing the movement speed determined based on N consecutive preview frames.

6 . The method according to claim 1 , wherein capturing the picture based on the first exposure time comprises:
obtaining raw images by using the first exposure time; and obtaining a captured picture by processing the raw images based on a brightness range in which a current ambient brightness falls and whether a current scene is an abnormal scene that causes differences between the raw images, wherein the captured picture is the picture.

7 . The method according to claim 6 , wherein processing the raw images based on the brightness range in which the current ambient brightness falls and whether the current scene is the abnormal scene that causes differences between the raw images comprises:
determining the brightness range in which the current ambient brightness falls, and determining whether the current scene is the abnormal scene that causes differences between the raw images, wherein
the brightness range comprises a first brightness range and a second brightness range,
an ambient brightness within the first brightness range is greater than an ambient brightness within the second brightness range,
the first brightness range refers to a brightness range in which enough details can be restored from one raw image obtained under a condition that the current ambient brightness is in the first brightness range, and
the second brightness range refers to a brightness range in which enough details cannot be restored from one raw image obtained under a condition that the current ambient brightness is in the second brightness range;
processing the raw images by using a single-frame processing operation in response to determining that the current scene is the abnormal scene, where the single-frame processing operation refers to operation of selecting one frame from the raw images for processing; processing the raw images by using the single-frame processing operation in response to determining that the current scene is not the abnormal scene and the current ambient brightness is in the first brightness range; and processing the raw images by using a multi-frame processing operation in response to determining that the current scene is not the abnormal scene and the current ambient brightness is in the second brightness range, where the multi-frame processing operation refers to operation of selecting more than one frame from the raw images for processing.

8 . The method according to claim 7 , wherein the single-frame processing operation comprises:
adjusting brightnesses of the raw images to an equivalent degree by using a photometric parameter of a terminal; determining a blur of the raw images after brightness adjustment; selecting a clearest raw image from the raw images according to the blur; and obtaining the captured picture by performing denoising processing on the clearest raw image.

9 . The method according to claim 8 , wherein before determining the blur, the method further comprises: filtering out useless images by using focus information.

10 . The method according to claim 7 , wherein the abnormal scene comprises at least one of a brightness sudden-change scene or a jitter scene, the brightness sudden-change scene referring to a scene at which a brightness difference between the raw images is greater than a preset brightness difference, and the jitter scene referring to a scene at which a terminal jitters.

11 . The method according to claim 10 , further comprising:
determining a mean brightness of a middle area of each raw image, and taking the mean brightness as a brightness of each raw image.

12 . The method according to claim 10 , further comprising:
obtaining angular speed information of a movement sensor of the terminal; and determining whether the terminal jitters based on the angular speed information.

13 . The method according to claim 7 , wherein the multi-frame processing operation comprises:
adjusting brightnesses of the raw images to an equivalent degree by using a photometric parameter of a terminal; determining a blur of the raw images after brightness adjustment; selecting M clearest raw images from the raw images according to the blur, where M is a positive integer greater than or equal to 2; taking a clearest raw image from the M clearest raw images as a base frame; aligning the M clearest raw images, by performing mapping transformation on frames except the base frame in the M clearest raw images toward the base frame through an alignment method, to create aligned M raw images; detecting movement areas of the aligned M raw images, and filling detected movement areas of the frames, except the base frame, with information of the detected movement areas in the base frame; and obtaining the captured picture by performing denoising processing on the filled frames and the base frame.

14 . The method according to claim 13 , wherein the alignment method is a method combining global alignment and optical flow alignment, or a deep learning-based alignment method.

15 . The method according to claim 13 , wherein before alignment, the method further comprises:
determin

Assignees

• Beijing Xiaomi Mobile Software Co Ltd

Inventors

• Zhang Yuqian
• Feng Chaoyu
• Liang Yu
• Wang Yiwei
• Ye Pan
• Lei Lei

Classifications

• H04N23/71

  Circuitry for evaluating the brightness variation · CPC title

• H04N23/73 Primary

  by influencing the exposure time · CPC title

• H04N23/6811

  based on the image signal · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• G06T7/215 Primary

  Motion-based segmentation · CPC title