Automatic image capture system based on a determination and verification of a physical object size in a captured image

Patent metadata

Field	Value
Publication number	US-12293600-B2
Application number	US-202318449405-A
Country	US
Kind code	B2
Filing date	Aug 14, 2023
Priority date	Jun 7, 2019
Publication date	May 6, 2025
Grant date	May 6, 2025

Abstract

Described herein is a system for automatically capturing images. A device may execute an application on the device. In response to receiving a request for capturing an image of a document, the application may control the operation of the camera to contemporaneously and continuously capture image frames of an area within the field of view of a camera of the device. The field of view may include an object and in turn may be included in the captured image frames. The application may determine whether the aspect ratio and real-world size of the object in the captured image frames corresponds with a specified threshold size and aspect ratio which corresponds with a given document type. In response to determining the object corresponds to the given document type, the camera may automatically extract an image of the object.

First claim

What is claimed is:

1. A method for automatically capturing images, comprising:
obtaining, by at least one processor, an image frame having a first object within a field of view of a camera, the image frame associated with at least one environmental feature, wherein the at least one environmental feature includes at least one of: an angle with respect to the first object and the camera, a distance between the first object and the camera, or a second object other than the first object in the image frame;
processing, in real-time, by the at least one processor, the image frame to identify an outline of the first object in the image frame; and
determining, by the at least one processor, the first object corresponds with an object type based on at least one image parameter value being within a threshold value, wherein the at least one image parameter value is determined based on the outline of the first object and the at least one environmental feature.

2. The method of claim 1 , wherein the at least one image parameter value comprises a calculated size of the first object, and wherein the calculated size of the first object in the image frame corresponds to a real-world size of the first object.

3. The method of claim 1 , wherein the processing comprises:
converting, by the at least one processor, the image frame into a grayscale image;
generating, by the at least one processor, a blurred image based on the grayscale image;
detecting, by the at least one processor, a plurality of edges in the blurred image;
identifying, by the at least one processor, a plurality of shapes based on the plurality of edges;
defining, by the at least one processor, a plurality of bounding rectangles for the plurality of shapes; and
determining, by the at least one processor, the outline of the first object based on the plurality of bounding rectangles.

4. The method of claim 1 , further comprising:
controlling, by the at least one processor, operation of the camera of a device to capture the image frame including an area within the field of view of the camera including the first object, in response to receiving a request for an image of a document.

5. The method of claim 1 , wherein the at least one image parameter value comprises an aspect ratio of the first object in the image frame determined by the at least one processor.

6. The method of claim 1 , further comprising: determining, by the at least one processor, whether a consistency of image parameter values across image frames including the image frame is within a given threshold.

7. The method of claim 6 , further comprising: determining, by the at least one processor, a final image parameter value in response to determining that the consistency of the image parameter values across the image frames is within the given threshold.

8. A system for automatically capturing images, the system comprising:
a memory; and
at least one processor coupled to the memory, wherein the at least one processor is configured to:
obtain an image frame having a first object within a field of view of a camera, the image frame associated with at least one environmental feature, wherein the at least one environmental feature includes at least one of: an angle with respect to the first object and the camera, a distance between the first object and the camera, or a second object other than the first object in the image frame;
process, in real-time, the image frame to identify an outline of the first object in the image frame; and
determine the first object corresponds with an object type based on at least one image parameter value being within a threshold value, wherein the at least one image parameter value is determined based on the outline of the first object and the at least one environmental feature.

9. The system of claim 8 , wherein the at least one image parameter value comprises a calculated size of the first object, and wherein the calculated size of the first object in the image frame corresponds to a real-world size of the first object.

10. The system of claim 8 , wherein when processing the image frame the at least one processor is configured to:
convert the image frame into a grayscale image;
generate a blurred image based on the grayscale image;
detect a plurality of edges in the blurred image;
identify a plurality of shapes based on the plurality of edges;
define a plurality of bounding rectangles for the plurality of shapes; and
determine the outline of the first object based on the plurality of bounding rectangles.

11. The system of claim 8 , wherein the at least one processor is further configured to:
control operation of the camera of a device to capture the image frame including an area within the field of view of the camera including the first object, in response to receiving a request for an image of a document.

12. The system of claim 8 , wherein the at least one image parameter value comprises an aspect ratio of the first object in the image frame determined by the at least one processor.

13. The system of claim 8 , wherein the at least one processor is further configured to determine whether a consistency of image parameter values across image frames including the image frame is within a given threshold.

14. The system of claim 13 , wherein the at least one processor is further configured to determine a final image parameter value in response to determining that the consistency of the image parameter values across the image frames is within the given threshold.

15. A non-transitory computer-readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations, the operations comprising:
obtaining an image frame having a first object within a field of view of a camera, the image frame associated with at least one environmental feature, wherein the at least one environmental feature includes at least one of: an angle with respect to the first object and the camera, a distance between the first object and the camera, or a second object other than the first object in the image frame;
processing the image frame to identify an outline of the first object in the image frame; and
determining the first object corresponds with an object type based on at least one image parameter value being within a threshold value, wherein the at least one image parameter value is determined based on the outline of the first object and the at least one environmental feature.

16. The non-transitory computer-readable medium of claim 15 , wherein the at least one image parameter value comprises a calculated size of the first object, and wherein the calculated size of the first object in the image frame corresponds to a real-world size of the first object.

17. The non-transitory computer-readable medium of claim 15 , wherein the processing comprises:
converting the image frame into a grayscale image;
generating a blurred image based on the grayscale image;
detecting a plurality of edges in the blurred image;
identifying a plurality of shapes based on the plurality of edges;
defining a plurality of bounding rectangles for the plurality of shapes; and
determining the outline of the first object based on the plurality of bounding rectangles.

18. The non-transitory computer-readable medium of claim 15 , wherein the operations further comprise:
controlling operation of the camera of a device to capture the image frame including an area within the field of view of the camera including the first object, in response to receivi

Assignees

• Capital One Services Llc

Inventors

• Pribble Jason
• Jarvis Daniel Alan
• Capurso Nicholas

Classifications

• G06V30/142

  using hand-held instruments; Constructional details of the instruments · CPC title

• G06T7/62 Primary

  of area, perimeter, diameter or volume · CPC title

• G06T2207/30176

  Document · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• H04N23/61

  based on recognised objects · CPC title