Automatically capturing and cropping image of check from video sequence for banking or other computing application

Patent metadata

Field	Value
Publication number	US-9747509-B2
Application number	US-201514633992-A
Country	US
Kind code	B2
Filing date	Feb 27, 2015
Priority date	Feb 27, 2015
Publication date	Aug 29, 2017
Grant date	Aug 29, 2017

Abstract

A mobile device with camera automatically captures an image of a check from a video sequence. A computing application assesses quality metrics of a frame of the video and, if acceptable, initiates capture of the check in that frame without user selection. Metrics include an aspect ratio of the check, image quality of the routing transit symbols that delineate a routing transit number on a MICR line of the check, distances between the routing transit symbols and to an edge of the check, recognition of digits of the routing transit number, checksum of the routing transit numbers, and image sharpness. Other embodiments note cropping of the check from the background of the image, properly orienting the check for viewing, and providing color coded visual feedback to users about the quality of the image frame about the check, to name a few.

First claim

The invention claimed is:

1. A mobile computing device, comprising:
a housing;
a controller in the housing hosting a computing application with executable instructions, the computing application for depositing or transferring funds of an amount of a check; and
a camera maneuvered by a user manipulating the housing, the camera when activated by the computing application delivers to the controller for processing a video sequence of a plurality of frames of images of the check, wherein the controller is configured to
find in a single frame of the plurality of frames of the video sequence both routing transit symbols that delineate a routing transit number on a magnetic ink character recognition (MICR) line of the check,
determine a first distance from one of the routing transit symbols to the other of the routing transit symbols and a second distance from said one of the routing transit symbols to an edge of the check,
calculate a ratio of the first distance to the second distance;
determine values for each digit of the routing transit number; and
capture an image of the check without user selection from the single frame upon the ratio being within a predetermined acceptable range,

wherein the first distance is parallel to the second distance.

2. The mobile computing device of claim 1 , wherein the controller is further configured to crop the check from the single frame, including eliminating background pixels.

3. The mobile computing device of claim 1 , wherein the controller is further configured to assess stability of the video sequence.

4. The mobile computing device of claim 1 , wherein the controller is further configured to determine an orientation of the check in the single frame.

5. The mobile computing device of claim 4 , wherein the controller is further configured to find said both routing transit symbols relative to only a bottom or top portion of the check depending on said orientation.

6. The mobile computing device of claim 4 , further including a display wherein the controller is further configured to rotate the check for viewing on the display from left-to-right if the orientation of the check is upside-down.

7. The mobile computing device of claim 1 , wherein the controller is further configured to calculate a checksum of the routing transit number.

8. The mobile computing device of claim 1 , wherein the controller is further configured to calculate a sharpness of the image of the check in the single frame.

9. The mobile computing device of claim 1 , wherein the controller is further configured to calculate a possible bounding border of the check in the single frame.

10. The mobile computing device of claim 9 , further including a display, wherein the controller is further configured to display to a user the possible bounding border with color-coding according to a calculated quality of the possible bounding border.

11. The mobile computing device of claim 1 , wherein the controller is further configured to compare said each digit of the routing transit number to templates of digits ranging from values 0 to 9 and selecting a best matching image template therefore.

12. The mobile computing device of claim 1 , wherein the controller is further configured to calculate an image width to an image height of the check in the single frame to determine an aspect ratio of the check, wherein an acceptable range of aspect ratios ranges from about 1.7 to about 3.1.

13. The mobile computing device of claim 1 , wherein the controller is further configured to determine said first and second distances from an (x, y) position coordinate of a bounding box about said both routing transit symbols.

14. A method, comprising:
receiving at a controller of a mobile computing device from a camera of the mobile computing device a video sequence having a plurality of frames of an image of a check;
finding in bit values corresponding to pixels of a single frame of the plurality of frames of the video sequence both routing transit symbols that delineate a routing transit number on a magnetic ink character recognition (MICR) line of the check;
determining a first distance from one of the routing transit symbols to the other of the routing transit symbols and a second distance from said one of the routing transit symbols to an edge of the check;
calculating a ratio of the first distance to the second distance;
comparing each digit of the routing transit number to templates of digits ranging from 0 to 9 to determine a value for said each digit by selecting a best matching image template therefore; and
upon the ratio being within a predetermined acceptable range and the values for said each digit being determinable, capturing the image of the check from the single frame without user selection,
wherein the first distance is parallel to the second distance.

15. The method of claim 14 , further including determining an aspect ratio of the check.

16. The method of claim 14 , further including calculating a checksum corresponding to the values of the routing transit number.

17. The method of claim 14 , further including rotating the check for properly-oriented viewing on a display of the mobile computing device if an orientation of the check is upside-down.

18. The method of claim 14 , further including assessing stability of the video sequence.

Assignees

• Lexmark Int Inc

Inventors

• Eid Ahmed Hamad Mohamed
• Cholewo Tomasz Jan
• Daniel Stuart Willard
• Simpson Stacy Lee

Classifications

• G06V10/993 Primary

  Evaluation of the quality of the acquired pattern · CPC title

• G06K9/036 Primary

  Physics · mapped topic

• G06K9/186

  Physics · mapped topic

• H04N5/2628

  Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation · CPC title

• G06K9/325

  Physics · mapped topic