Real-time glare detection inside a dynamic region of an image

Patent metadata

Field	Value
Publication number	US-12136266-B2
Application number	US-202217657876-A
Country	US
Kind code	B2
Filing date	Apr 4, 2022
Priority date	Aug 20, 2018
Publication date	Nov 5, 2024
Grant date	Nov 5, 2024

Abstract

A user device may capture a plurality of preview images that each include image data. The user device may process, in substantially real-time, a preview image to identify an object in the preview image, including determining an outline of the object. The user device may create a mask that hides a portion of the image data associated with an area outside of the outline of the object in one or more of the preview images. Based on determining that a parameter associated with glare of the object in the preview images does not satisfy a threshold, the user device may provide, in substantially real-time, feedback to a user, including an instruction to the user to perform an action with respect to the user device or to the object, and, based on determining that the parameter satisfies the threshold, the user device may automatically capture an image of the object.

First claim

What is claimed is:

1. A method, comprising:
capturing, by a device and in a first capture mode, a first subset of preview images of at least a portion of an object;
processing, by the device and while capturing the first subset of preview images, first image data of the first subset of preview images;
determining, by the device, while capturing the first subset of preview images, and based on processing the first image data, that a parameter, associated with a glare on the at least the portion of the object in at least one preview image of the first subset of preview images, does not satisfy a threshold;
providing, by the device and based on determining that the parameter does not satisfy the threshold, feedback to a user of the device to reduce the glare on the portion of the object;
capturing, by the device, in the first capture mode, and based on providing the feedback to the user, a second subset of preview images of the at least the portion of the object;
processing, by the device and while capturing the second subset of preview images, second image data of the second subset of preview images;
determining, by the device, while capturing the second subset of preview images, and based on processing the second image data, that the parameter satisfies the threshold; and
automatically capturing, by the device and based on determining that the parameter satisfies the threshold, a subsequent image, different from the first subset of preview images and the second subset of preview images, of the at least the portion of the object in a second capture mode providing greater resolution than the first capture mode.

2. The method of claim 1 , wherein determining that the parameter satisfies the threshold comprises:
determining that a percentage of the second image data, that is associated with the glare, satisfies the threshold.

3. The method of claim 1 , wherein the object is a document.

4. The method of claim 1 , wherein the parameter is associated with one or more of:
a pixel intensity value,
a pixel brightness value, or
a pixel luminance value.

5. The method of claim 1 , further comprising:
determining, based on processing the first image data, a plurality of glare values associated with the first image data;
calculating an average glare value based on the plurality of glare values; and
assigning the average glare value to the parameter,
wherein determining that the parameter does not satisfy the threshold is based on assigning the glare value to the parameter.

6. The method of claim 1 , wherein determining that the parameter does not satisfy the threshold comprises:
creating, based on processing the first image data, a histogram of a luminance channel associated with the first image data; and
determining, based on creating the histogram, that the parameter does not satisfy the threshold.

7. The method of claim 1 , wherein each of the first subset of preview images includes an entirety of the object, and wherein the glare is on only the portion of the object.

8. The method of claim 1 , further comprising:
identifying, based on processing the first image data, the object in the first subset of preview images; and
determining, based on identifying the object in the first subset of preview images, an outline or a boundary of the object in the first subset of preview images,
wherein determining the parameter does not satisfy the threshold is based on determining the outline or the boundary of the object in the first subset of preview images.

9. The method of claim 1 , further comprising:
creating, based on processing the first image data, a mask that hides a portion of the image data not associated with the object,
wherein determining the parameter does not satisfy the threshold is based on creating the mask.

10. The method of claim 1 , further comprising:
altering a function of a camera of the device,
wherein automatically capturing the subsequent image is based on altering the function of the camera of the device.

11. A device, comprising:
one or more memories; and
one or more processors coupled to the one or more memories, configured to:
capture, in a first capture mode, a first subset of preview images of at least a portion of an object;
process first image data of the first subset of preview images while capturing the first subset of preview images;
determine, while capturing the first subset of preview images and based on processing the first image data, that a parameter, associated with a glare on the at least the portion of the object in at least one preview image of the first subset of preview images, does not satisfy a threshold;
provide, based on determining that the parameter does not satisfy the threshold, feedback to a user of the device to reduce the glare on the portion of the object;
capture, in the first capture mode and based on providing the feedback to the user, a second subset of preview images of the at least the portion of the object;
process, while capturing the first subset of preview images, second image data of the second subset of preview images;
determine, while capturing the second subset of preview images and based on processing the second image data, that the parameter satisfies the threshold; and
automatically capture, based on determining that the parameter satisfies the threshold, a subsequent image, different from the first subset of preview images and the second subset of preview images, of the at least the portion of the object in a second capture mode providing greater resolution than the first capture mode.

12. The device of claim 11 , wherein the one or more processors are further configured to:
identify, based on processing the first image data, the object in the first subset of preview images; and
determine, based on identifying the object in the first subset of preview images, an outline or a boundary of the object in the first subset of preview images,
wherein determining the parameter does not satisfy the threshold is based on determining the outline or the boundary of the object in the first subset of preview images.

13. The device of claim 11 , wherein each of the first subset of preview images includes an entirety of the object, and wherein the glare is on only the portion of the object.

14. The device of claim 11 , wherein the one or more processors are further configured to:
alter a function of a camera of the device,
wherein automatically capturing the subsequent image is based on altering the function of the camera of the device.

15. A non-transitory computer-readable medium storing instructions, the instructions comprising:
one or more instructions that, when executed by one or more processors of a device, cause the one or more processors to:
capture, in a first capture mode, a first subset of preview images of at least a portion of an object;
process, while capturing the first subset of preview images, first image data of the first subset of preview images;
determine, while capturing the first subset of preview images and based on processing the first image data, that a parameter, associated with a glare on the at least the portion of the object in at least one preview image of the first subset of preview images, does not satisfy a threshold;
provide, based on determining that the parameter does not satisfy the threshold, feedback to a user of the device to reduce the glare on the portion of the object;
capture, in the first capture mode and based on providing the feedback to the user, a second subset of preview images of the at least the portion of the object;
process, while capturing the se

Assignees

• Capital One Services Llc

Inventors

• Pribble Jason
• Capurso Nicholas
• Jarvis Daniel Alan

Classifications

• H04N23/71

  Circuitry for evaluating the brightness variation · CPC title

• G06V10/507

  Summing image-intensity values; Histogram projection analysis · CPC title

• G06V10/22

  by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06T2207/30176

  Document · CPC title