Extracting card data with wear patterns

Patent metadata

Field	Value
Publication number	US-9235771-B2
Application number	US-201314091093-A
Country	US
Kind code	B2
Filing date	Nov 26, 2013
Priority date	Jun 28, 2013
Publication date	Jan 12, 2016
Grant date	Jan 12, 2016

Abstract

Embodiments herein provide computer-implemented techniques for allowing a user computing device to extract financial card information using optical character recognition (“OCR”). Extracting financial card information may be improved by applying various classifiers and other transformations to the image data. For example, applying a linear classifier to the image to determine digit locations before applying the OCR algorithm allows the user computing device to use less processing capacity to extract accurate card data. The OCR application may train a classifier to use the wear patterns of a card to improve OCR algorithm performance. The OCR application may apply a linear classifier and then a nonlinear classifier to improve the performance and the accuracy of the OCR algorithm. The OCR application uses the known digit patterns used by typical credit and debit cards to improve the accuracy of the OCR algorithm.

First claim

What is claimed is:

1. A computer-implemented method for training systems to recognize wear patterns on cards, comprising:
receiving, by one or more computing devices, an image of a card from a camera, the card having digits thereon that are worn according to a wear pattern;
performing, by the one or more computing devices, a classification algorithm the image;
providing for display, by the one or more computing devices, results of the performance of the classification algorithm along with a revision indication control to provide revisions of the results of the performance of the classification algorithm;
receiving, by the one or more computing devices, a revision of the results of the performance of the classification algorithm, wherein the revision comprises an identification of a wear pattern of the digits and the revision of the results was input using the revision indication control;
categorizing, by the one or more computing devices, the wear pattern of the digits indicated by the revision; and
creating, by the one or more computing devices, a wear pattern data transformation for a category of the wear pattern based at least in part on the revised results.

2. The method of claim 1 , wherein the image of the card is simulated.

3. The method of claim 1 , wherein the revisions are provided by an operator of the one or more computing devices.

4. The method of claim 1 , wherein an application of the wear pattern data transformation to a classification of a subsequent card corrects errors caused by wear patterns on the subsequent card.

5. A computer-implemented method for using wear pattern transformations, comprising:
receiving, by one or more computing devices, an image of a card from a camera;
performing, by the one or more computing devices, an optical character recognition algorithm on the image;
determining, by the one or more computing devices, a first confidence level of a result of the application of the optical character recognition algorithm to the data;
applying, by the one or more computing devices, a first wear pattern data transformation to the image;
performing, by the one or more computing devices, the optical character recognition algorithm to the transformed image;
determining, by the one or more computing devices, a second confidence level of a result of the application of the optical character recognition algorithm to the transformed image;
determining that the second confidence level is higher than the first confidence level; and
applying, by the one or more computing devices, the first wear pattern data transformation to an image of a second physical card based upon a determination that the second confidence level is higher than the first confidence level.

6. The method of claim 5 , wherein the first wear pattern data transformation is a support vector machine.

7. The method of claim 5 , wherein the first wear pattern transformation is applied to any subsequent card image associated with an account of a user associated with the physical card.

8. The method of claim 5 , further comprising:
applying, by the one or more computing devices, additional wear pattern data transformations to the image;
determining, by the one or more computing devices, a confidence level of a result of the applications of the optical character recognition algorithm to the data after an application of each of the additional wear pattern data transformations;
determining, by the one or more computing devices, the wear pattern data transformation that is associated with a highest confidence level; and
applying, by the one or more computing devices, the wear pattern data transformation that is associated with the highest confidence level to an image of a second card.

9. The method of claim 5 , wherein the card is a credit card, a debit card, an identification card, a loyalty card, an access card, or a stored value card.

10. A computer program product, comprising:
a non-transitory computer-readable storage device having computer-executable program instructions embodied thereon that when executed by a computer cause the computer to extract financial card information with relaxed alignment, comprising:
computer-executable program instructions to receive an image of a card from a camera;
computer-executable program instructions to perform an optical character recognition algorithm on the image;
computer-executable program instructions to determine a first confidence level of a result of the application of the optical character recognition algorithm to the data;
computer-executable program instructions to apply a first wear pattern data transformation to the image;
computer-executable program instructions to perform the optical character recognition algorithm to the transformed image;
computer-executable program instructions to determine a second confidence level of a result of the application of the optical character recognition algorithm to the transformed image;
computer-executable program instructions to determine that the second confidence level is higher than the first confidence level; and
computer-executable program instructions to select the result of the application of the optical character recognition algorithm to the transformed image based at least in part on the determination that the second confidence level is higher than the first confidence level.

11. The computer program product of claim 10 , wherein the first wear pattern data transformation is a support vector machine.

12. The computer program product of claim 10 , wherein the first wear pattern transformation is applied to any subsequent card image associated with an account of a user associated with the physical card.

13. The computer program product of claim 10 , the computer-executable program instructions further comprising:
computer program instructions to apply additional wear pattern data transformations to the image;
computer program instructions to determine a confidence level of a result of the applications of the optical character recognition algorithm to the data after an application of each of the additional wear pattern data transformations;
computer program instructions to determine the wear pattern data transformation that is associated with a highest confidence level; and
computer program instructions to apply the wear pattern data transformation that is associated with the highest confidence level to an image of a second card.

14. The computer program product of claim 10 , wherein the card is a credit card, a debit card, an identification card, a loyalty card, an access card, or a stored value card.

15. A system for training systems to recognize wear patterns on cards, the system comprising:
a storage device;
a processor communicatively coupled to the storage device, wherein the processor executes application code instructions that are stored in the storage device to cause the system to:
receive an image of a card from a camera, the card having digits thereon that are worn according to a wear pattern;
perform a linear classification algorithm on the image;
provide for display results of the performance of the linear classification algorithm along with a revision indication control to provide revisions of the results of the performance of the linear classification algorithm;
receive a revision of the results of the performance of the linear classification algorithm, wherein the revision comprises an identification of a wear pattern of the digits and the revision of the results was input using the revision indication control;
categorize the wear pattern of the digits indicated by the revision; an

Assignees

• Google Inc

Inventors

• Rowley Henry Allan
• Kumar Sanjiv
• Wang Xiaohang
• Bissacco Alessandro
• Rodrigues Jose Jeronimo Moreira
• Papineni Kishore Ananda

Classifications

• G06Q20/227 Primary

  characterised in that multiple accounts are available, e.g. to the payer · CPC title

• G06F2218/12

  Classification; Matching · CPC title

• G06F18/2411

  based on the proximity to a decision surface, e.g. support vector machines · CPC title

• G06F18/24

  Classification techniques · CPC title

• G06V30/10

  Character recognition · CPC title