Dynamic image capture device configuration for improved image stabilization

Patent metadata

Field	Value
Publication number	US-12375806-B2
Application number	US-202218051727-A
Country	US
Kind code	B2
Filing date	Nov 1, 2022
Priority date	Jun 21, 2022
Publication date	Jul 29, 2025
Grant date	Jul 29, 2025

Abstract

This disclosure provides systems, methods, and devices for image processing that support improved image quality from reduced artifacts and wobbles. In a first aspect, a method of image processing includes receiving motion data regarding movement of a mobile device; determining a first image sensor configuration based on the motion data; and configuring an image sensor with the first image sensor configuration. Other aspects and features are also claimed and described.

First claim

What is claimed is:

1. A method, comprising:
receiving motion data regarding movement of a mobile device;
selecting, as a selected configuration, between a first image sensor configuration and a second image sensor configuration based on whether the motion data indicates that movement of the mobile device satisfies a first criteria; and
configuring an image sensor arrangement with the selected configuration, wherein the first image sensor configuration and the second image sensor configuration differ from each other with respect to a number of pixels activated in an image sensor of the image sensor arrangement or processed by a processor of the image sensor arrangement to generate an image of a scene, the image being of a predefined size, and wherein the first image sensor configuration and the second image sensor configuration also differ from each other with respect to an aspect ratio of the number of pixels activated in the image sensor.

2. The method of claim 1 , wherein:
the duration of the period in which the predetermined number of frames are scanned is longer in the second image sensor configuration than in the first image sensor configuration; and
the first criteria is that a magnitude is greater than a threshold, the selecting (a) being of the first image sensor configuration when the first criteria is satisfied, and (b) being of the second image sensor configuration when the first criteria is not satisfied.

3. The method of claim 1 , wherein receiving motion data comprises receiving at least one of gyroscope data, accelerometer data, OIS data, and motion vectors, wherein the method further comprises determining a motion class for future image data based on the motion data, and wherein the selecting is performed based on the motion class determined for the future image data.

4. The method of claim 1 , wherein the first image sensor configuration and the second image sensor configuration differ from each other with respect to the number of pixels that are activated in the image sensor to generate the image of the scene, the image being of the predefined size.

5. The method of claim 1 , wherein the selecting is performed such that the number of pixels is greater when the motion data indicates movement above a threshold than when the motion data indicates movement that is not above the threshold.

6. The method of claim 1 , the first image sensor configuration and the second image sensor configuration differ from each other with respect to which of (a) a first image sensor that has a first field of view and (b) a second image sensor that has a second field of view, which is larger than the first field of view, is used to obtain image data for generating the image, the second image sensor being used based on the motion data indicating movement above a threshold.

7. The method of claim 1 , further comprising:
receiving image data from the image sensor while configured with the first image sensor configuration;
determining a plurality of output image frames based on the image data by applying image stabilization (IS) to the image data by using at least a portion of a margin of the image data; and
displaying the plurality of output image frames as a preview image of the scene in a field of view of the image sensor.

8. An apparatus, comprising:
a memory storing processor-readable code; and
at least one processor coupled to the memory, the at least one processor configured to execute the processor-readable code to cause the at least one processor to perform operations including:
receiving motion data regarding movement of a mobile device;
selecting, as a selected configuration, between a first image sensor configuration and a second image sensor configuration based on whether the motion data indicates that movement of the mobile device satisfies a first criteria; and
implementing the selected configuration, wherein the first image sensor configuration and the second image sensor configuration differ from each other with respect to a number of pixels activated in an image sensor or processed by one of the at least one processor to generate an image of a scene, the image being of a predefined size, and wherein the first image sensor configuration and the second image sensor configuration also differ from each other with respect to an aspect ratio of the number of pixels activated in the image sensor.

9. The apparatus of claim 8 , wherein:
the duration of the period in which the predetermined number of frames are scanned is longer in the second image sensor configuration than in the first image sensor configuration; and
the first criteria is that a magnitude is greater than a threshold, the selecting (a) being of the first image sensor configuration when the first criteria is satisfied, and (b) being of the second image sensor configuration when the first criteria is not satisfied.

10. The apparatus of claim 8 , wherein receiving motion data comprises receiving at least one of gyroscope data, accelerometer data, OIS data, and or motion vectors, wherein the at least one processor is further configured to perform operations including determining a motion class for future image data based on the motion data, and wherein the selecting is performed based on the motion class determined for the future image data.

11. The apparatus of claim 8 , wherein the first image sensor configuration and the second image sensor configuration differ from each other with respect to the number of pixels that are activated in the image sensor to generate the image of the scene, the image being of the predefined size.

12. The apparatus of claim 8 , wherein the selecting is performed such that the number of pixels is greater when the motion data indicates movement above a threshold than when the motion data indicates movement that is not above the threshold.

13. The apparatus of claim 8 , the first image sensor configuration and the second image sensor configuration differ from each other with respect to which of (a) a first image sensor that has a first field of view and (b) a second image sensor that has a second field of view, which is larger than the first field of view, is used to obtain image data for generating the image, the second image sensor being used based on the motion data indicating movement above a threshold.

14. The apparatus of claim 8 , wherein the at least one processor is further configured to perform operations including receiving image data from the image sensor, wherein the selecting is performed also based on the image data.

15. The apparatus of claim 8 , wherein the at least one processor is further configured to perform operations including:
receiving image data from the image sensor while configured with the first image sensor configuration;
determining a plurality of output image frames based on the image data by applying image stabilization (IS) to the image data by using at least a portion of a margin of the image data, and
displaying the plurality of output image frames as a preview image of the scene in a field of view of the image sensor.

16. A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:
receiving motion data regarding movement of a mobile device;
selecting, as a selected configuration, between a first image sensor configuration and a second image sensor configuration based on whether the motion data indicates that movement of the mobile device satisfies a first criteria; and
implementing the selected configuration, wherein the first image sensor

Assignees

• Qualcomm Inc

Inventors

• Tsairi Eliad
• Gaizman Ron

Classifications

• H04N23/684

  performed by controlling the image sensor readout, e.g. by controlling the integration time · CPC title

• H04N23/632

  for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters · CPC title

• H04N23/665

  involving internal camera communication with the image sensor, e.g. synchronising or multiplexing SSIS control signals · CPC title

• H04N23/6812 Primary

  based on additional sensors, e.g. acceleration sensors · CPC title