Extracting card data for simultaneous display with an image

Patent metadata

Field	Value
Publication number	US-10387742-B2
Application number	US-201615342116-A
Country	US
Kind code	B2
Filing date	Nov 2, 2016
Priority date	Jun 27, 2013
Publication date	Aug 20, 2019
Grant date	Aug 20, 2019

Abstract

Extracting card data comprises receiving, by one or more computing devices, a digital image of a card; perform an image recognition process on the digital representation of the card; identifying an image in the digital representation of the card; comparing the identified image to an image database comprising a plurality of images and determining that the identified image matches a stored image in the image database; determining a card type associated with the stored image and associating the card type with the card based on the determination that the identified image matches the stored image; and performing a particular optical character recognition algorithm on the digital representation of the card, the particular optical character recognition algorithm being based on the determined card type. Another example superimposes the extracted data directly above, below, or beside the corresponding section on the displayed image.

First claim

What is claimed is:

1. A computer-implemented method to extract card information, comprising:
performing, by one or more computing devices, an optical character recognition algorithm on an image of a card to identify a number sequence from the image of the card;
presenting, by the one or more computing devices and via a user interface of the one or more computing devices, the image of the card, the image of the card comprising the number sequence;
presenting, by the one or more computing devices and via the user interface of the one or more computing devices, a virtual display of the identified number sequence, the virtual display of the identified number sequence being superimposed on the presented image of the card;
presenting, by the one or more computing devices and via the user interface of the one or more computing devices, an interface object to request an acceptance of the identified number sequence, wherein the interface object is presented simultaneously with the virtual display of the identified number sequence on the user interface;
receiving, by the one or more computing devices, a user tap on the superimposed image of the identified number sequence on the user interface, wherein the user tap indicates that the identified number sequence is incorrect; and
performing, by the one or more computing devices, a second optical character recognition algorithm on the image of the card upon receipt of the user tap.

2. The method of claim 1 , wherein accepting the identified number sequence based on an input via the interface object indicates that the presented identified number sequence matches corresponding information on the presented image of the card.

3. The method of claim 2 , further comprising submitting the identified number sequence to a digital wallet to be used in a transaction in response to accepting the identified number sequence.

4. The method of claim 1 , further comprising rejecting the identified number sequence based on the user tap on the superimposed image, wherein rejecting the identified number sequence indicates that the presented identified number sequence does not match corresponding information on the presented image of the card.

5. The method of claim 1 , wherein the card comprises one or more of a credit card, a debit card, an identification card, a loyalty card, an access card, or a stored value card.

6. The method of claim 1 , further comprising receiving, by the one or more computing devices, an input from a user via the interface object specifying whether the presented identified number sequence matches the presented number sequence of the card.

7. The method of claim 1 , wherein the virtual display of the identified number sequence is superimposed below the presented number sequence on the presented image of the card.

8. A computer program product, comprising:
a non-transitory computer-readable storage device having computer-executable program instructions embodied thereon that when executed by a computer cause the computer to extract card information, comprising:
computer-executable program instructions to present an image of a card on a user interface of one or more computing devices;
computer-executable program instructions to perform a first optical character recognition algorithm on the image of the card;
computer-executable program instructions to identify based on the performance of the first optical character recognition algorithm on the image of the card, an identification number associated with an issuer of the card from information and characteristics of the identification number, the characteristics being one or more of a font, color, and spacing of characters of the identification number;
computer-executable program instructions to present a virtual display of the identified identification number on the user interface, the virtual display of the identified identification number being superimposed on the presented image of the card;
computer-executable program instructions to present an interface object to request an acceptance of the identified identification number, wherein the interface object is presented simultaneously with the virtual display of the identified identification number on the user interface;
computer-executable program instructions to receive a user tap on the superimposed image of the identified identification number on the user interface, wherein the user tap indicates that the identified identification number is incorrect; and
computer-executable program instructions to perform a second optical character recognition algorithm on the image of the card upon receipt of the user tap.

9. The computer program product of claim 8 , further comprising computer-executable program instructions to receive an input from a user via the interface object specifying whether the presented identified identification number matches the identification number of the card.

10. The computer program product of claim 8 , further comprising computer-executable program instructions to accept the identified identification number based on an input from a user via the interface object, wherein accepting the identified identification number indicates that the presented identified identification number matches the identification number of the card.

11. The computer program product of claim 8 , further comprising computer-executable program instructions to reject the identified identification number based on the user tap on the superimposed image, wherein rejecting the identified identification number indicates that the presented identified identification number does not match the identification number of the card.

12. The computer program product of claim 8 , wherein the virtual display of the identified identification number is superimposed below the identification number on the presented image of the card.

13. The computer program product of claim 8 , further comprising computer-executable program instructions to submit the identified identification number to a digital wallet to be used in a transaction.

14. A system to extract card information, comprising:
a storage resource; and
a processor communicatively coupled to the storage resource, wherein the processor is configured to execute computer-readable instructions that are stored in the storage resource to cause the system to:
present an image of a card on a user interface of one or more computing devices;
perform a first optical character recognition algorithm on the image of the card;
identify based on the performance of the first optical character recognition algorithm on the image of the card, an identification number associated with an issuer of the card from information and characteristics of the identification number, the characteristics being one or more of a font, color, and spacing of characters of the identification number;
present a virtual display of the identified identification number, the virtual display of the identified identification number being superimposed on the presented image of the card;
present an interface object to request an acceptance of the identified identification number, wherein interface object is presented simultaneously with the virtual display of the identified identification number on the user interface;

receive a user tap on the superimposed image of the identified identification number on the user interface, wherein the user tap indicates that the identified identification number is incorrect; and
perform a second optical character recognition algorithm on the image of the card upon receipt of the user tap.

15. The system of claim 14 , further comprising instruction

Assignees

• Google Inc
• Google Llc

Inventors

• Mitchell Marcus Quintana
• Wang Xiaohang

Classifications

• G06V30/416 Primary

  Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors · CPC title

• G06V30/2253

  Recognition of characters printed with magnetic ink (G06V30/2247 takes precedence) · CPC title

• G06V30/10

  Character recognition · CPC title

• G06Q20/3276

  using a pictured code, e.g. barcode or QR-code, being read by the M-device · CPC title

• G06Q20/34

  using cards, e.g. integrated circuit [IC] cards or magnetic cards · CPC title