Real time shadow and glare analysis for document capture

Patent metadata

Field	Value
Publication number	US-10630905-B2
Application number	US-201816116764-A
Country	US
Kind code	B2
Filing date	Aug 29, 2018
Priority date	Aug 29, 2018
Publication date	Apr 21, 2020
Grant date	Apr 21, 2020

Abstract

There are described mobile devices, and methods thereof, for real time analyses of captured images. The device determines whether a light level of a first image meets or exceeds a low light threshold. The device also determines whether a shadow level of the first image meets or exceeds a shadow threshold in response to determining the light level does not meet or exceed the low light threshold. The light source is activated in response to determining the light level meets or exceeds the low light threshold or the shadow level meets or exceeds the shadow threshold. The device further determines whether a glare level of a second image meets or exceeds a glare threshold in response to identifying the second image. If so, then a final image is captured with the light source inactive. Otherwise, the final image is captured with the light source active.

First claim

What is claimed is:

1. In an environment for real time analysis of a document image to be captured, a method implemented by a mobile device having an imager and a light source, the method comprising:
capturing a first pre-image by the imager with the light source inactive;
determining whether a light level of the first pre-image meets or exceeds a low light threshold, the light level below the low light threshold being sufficient for document capture with the light source inactive;
determining whether a shadow level of the first pre-image meets or exceeds a shadow threshold in response to the determining the light level of the first pre-image is sufficient for the document capture, the shadow level below the shadow threshold being sufficient for the document capture with the light source inactive;
capturing a second pre-image by the imager with the light source active in response to the determining the light level of the first pre-image meets or exceeds the low light threshold or in response to the determining the shadow level of the first pre-image meets or exceeds the shadow threshold; and
capturing a final image by the imager with the light source inactive based on a glare level of the second pre-image meets or exceeds a glare threshold, the glare level above the glare threshold being insufficient for the document capture with the light source active.

2. The method as described in claim 1 , wherein:
the first pre-image includes a plurality of first image frames captured with the light source inactive; and
the second pre-image includes a plurality of second image frames captured with the light source active.

3. The method as described in claim 1 , further comprising capturing the final image by the imager with the light source active based on the glare level of the second pre-image does not meet or exceed the glare threshold.

4. The method as described in claim 1 , wherein the capturing the final image by the imager with the light source inactive is in response to the determining the shadow level of the first pre-image does not meet or exceed the shadow threshold.

5. The method as described in claim 1 , wherein the capturing the first pre-image includes detecting the first pre-image is positioned within an image frame of the imager.

6. The method as described in claim 1 , wherein:
the determining whether the shadow level of the first pre-image meets or exceeds the shadow threshold includes determining that a contrast level between a shadow area and an area adjacent to the shadow area meets or exceeds the shadow threshold, wherein the shadow area is darker than the area adjacent to the shadow area; and
the glare level of the second pre-image meets or exceeds the glare threshold comprises determining that a contrast level between a glare area and an area adjacent to the glare area meets or exceeds the glare threshold, wherein the glare area is lighter than the area adjacent to the glare area.

7. The method as described in claim 1 , further comprising post-processing the final image to identify the document image from the final image.

8. A mobile device implemented for image analysis of document images for document capture in a digital medium environment, the mobile device comprising:
an imager configured to capture pre-images and images for the document capture;
a light source configured to activate or remain inactive to capture the pre-images and the images of the document for the document capture;
a document capture module implemented at least partially in computer hardware to:
initiate the imager to capture a first pre-image with the light source inactive;
determine whether a light level of the first pre-image meets or exceeds a low light threshold, the light level below the low light threshold being sufficient for document capture with the light source inactive;
determine whether a shadow level of the first pre-image meets or exceeds a shadow threshold in response to the light level of the first pre-image being determined sufficient for the document capture, the shadow level below the shadow threshold being sufficient for the document capture with the light source inactive;
initiate the imager to capture a second pre-image with the light source active in response to the light level of the first pre-image determined to meet or exceed the low light threshold, or in response to the shadow level of the first pre-image determined to meet or exceed the shadow threshold; and
initiate the imager to capture a final image with the light source inactive based on a glare level of the second pre-image determined to meet or exceed a glare threshold, the glare level above the glare threshold being insufficient for the document capture with the light source active.

9. The mobile device as described in claim 8 , wherein the imager is configured to:
capture the first pre-image as multiple first image frames captured with the light source inactive; and
capture the second pre-image as multiple second image frames captured with the light source active.

10. The mobile device as described in claim 8 , wherein the document capture module is implemented to initiate the imager to capture the final image with the light source active based on the glare level of the second pre-image determined not to meet or exceed the glare threshold.

11. The mobile device as described in claim 8 , wherein the document capture module is implemented to initiate the imager to capture the final image with the light source inactive based on the shadow level of the first pre-image determined not to meet or exceed the shadow threshold.

12. The mobile device as described in claim 8 , wherein the document capture module is implemented to detect that the first pre-image is positioned within an image frame of the imager, and initiate the imager to capture a first pre-image.

13. The mobile device as described in claim 8 , wherein:
to determine whether the shadow level of the first pre-image meets or exceeds the shadow threshold, the document capture module is implemented to determine that a contrast level between a shadow area and an area adjacent to the shadow area meets or exceeds the shadow threshold, the shadow area being darker than the area adjacent to the shadow area; and
to determine whether the glare level of the second pre-image meets or exceeds the glare threshold, the document capture module is implemented to determine that a contrast level between a glare area and an area adjacent to the glare area meets or exceeds the glare threshold, the glare area being lighter than the area adjacent to the glare area.

14. The mobile device as described in claim 8 , wherein the document capture module is implemented to post-process the final image for the document capture.

15. A method implemented by document capture module of a computing device for image analysis of document images for document capture, the method comprising:
determining whether a light level of a first pre-image meets or exceeds a low light threshold, the light level below the low light threshold being sufficient for the document capture with a light source inactive;
determining whether a shadow level of the first pre-image meets or exceeds a shadow threshold in response to the determining the light level of the first pre-image is sufficient for the document capture, the shadow level below the shadow threshold being sufficient for the document capture with the light source inactive;
initiating an imager to capture a second pre-image with the light source active in response to the determining the light level of the first pre-image meets or exceeds the low light threshold or in re

Assignees

• Adobe Inc

Inventors

• Mondal Prasenjit
• Shara Anuj
• Bal Ankit

Classifications

• H04N5/2351 Primary

  Electricity · mapped topic

• G06K9/00442

  Physics · mapped topic

• H04N5/2354

  Electricity · mapped topic

• G06V10/98 Primary

  Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns · CPC title

• G06V10/141

  Control of illumination · CPC title