System for verifying the identity of a user

Patent metadata

Field	Value
Publication number	US-11853406-B2
Application number	US-202218055293-A
Country	US
Kind code	B2
Filing date	Nov 14, 2022
Priority date	Aug 6, 2018
Publication date	Dec 26, 2023
Grant date	Dec 26, 2023

Abstract

A system receives an image including a live facial image of the user and an identity document including a photograph of the user. Moreover, the system calculates a facial match score by comparing facial features in the live facial image to facial features in the photograph. The system recognizes data objects and characters in the identity document using optical character recognition (OCR) and computer vision, and then identifies, based on the recognized data objects and characters, a type of the identity document. Further, the system calculates a document validity score by comparing the recognized characters and data objects to character strings and data objects known to be present in the identified type of the identity document. Additionally, the system determines and outputs the user's identity verification status based on comparing the facial match score to a facial match threshold and comparing the document validity score to a document validity threshold.

First claim

The invention claimed is:

1. A method comprising:
receiving, by a computer processor, image data from an electronic source comprising:
i) a facial image of a user, and
ii) an identity document, comprising a photograph of the user;

calculating, by the computer processor, a facial match score by comparing a plurality of first facial features extracted from the facial image to a plurality of second facial features extracted from the photograph;
determining, by the computer processor, an identity verification status of the user based on the facial match score; and
outputting, by the computer processor, the identity verification status so as to verify the identity of the user with a user request;
wherein outputting the identity verification status comprises prompting the user to submit an additional image including another live facial image of the user holding the identity document in response to determining that the facial match score is below the facial match threshold.

2. The method of claim 1 , wherein calculating the facial match score comprises:
extracting a first set of facial features from the live facial image;
extracting a second set of facial features from the photograph;
comparing, using a facial recognition algorithm, the first set of facial features to the second set of facial features; and
calculating the facial match score as a percentage of facial features in common between the live facial image and the photograph.

3. The method of claim 1 , wherein:
outputting the identity verification status comprises presenting, on a display device, the identity verification status; and
the identity verification status indicates that the identity of the user is verified in response to determining that the facial match score exceeds the facial match threshold.

4. The method of claim 1 , further comprising comparing the recognized data objects to a watermark security feature present in the identified type of the identity document.

5. The method of claim 1 , further comprising:
extracting, based on comparing the recognized characters to characteristics present in the identified type of the identity document, one or more secondary characteristics of the user from the image; and
comparing the one or more secondary characteristics to the facial features in the live facial image and the facial features in the photograph.

6. The method of claim 5 , wherein the characteristics present in the identified type of the identity document include one or more of: hair color; eye color; gender, weight; height; date of birth; and ethnicity.

7. The method of claim 5 , wherein determining the identity verification status of the user is further based on comparing the one or more secondary characteristics to user profile data for the user retrieved from a data store.

8. The method of claim 1 , wherein outputting the identity verification status comprises prompting the user to submit an additional image including another live facial image of the user holding another identity document in response to determining that the document validity score is below the document validity threshold.

9. The method of claim 1 , wherein the recognized data objects include one or more of: a watermark; a hologram; a bar code; a serial number; a thumbnail version of the photograph; a negative image of the photograph; and a Quick Response (QR) code.

10. The method of claim 1 , wherein determining the identity verification status of the user is further based on comparing the recognized data objects to user profile data for the user retrieved from a data store.

11. A system comprising:
at least one processor in communication with at least one non-transitory computer readable medium having software instructions stored thereon, wherein, upon execution of the software instructions, the at least one processor is configured to:
receive image data from an electronic source comprising:
i) a facial image of a user, and
ii) an identity document, comprising a photograph of the user;

calculate a facial match score by comparing a plurality of first facial features extracted from the facial image to a plurality of second facial features extracted from the photograph;
determine an identity verification status of the user based on the facial match score; and
output the identity verification status so as to verify the identity of the user with a user request;
wherein outputting the identity verification status comprises prompting the user to submit an additional image including another live facial image of the user holding the identity document in response to determining that the facial match score is below the facial match threshold.

12. The system of claim 11 , wherein calculating the facial match score comprises:
extracting a first set of facial features from the live facial image;
extracting a second set of facial features from the photograph;
comparing, using a facial recognition algorithm, the first set of facial features to the second set of facial features; and
calculating the facial match score as a percentage of facial features in common between the live facial image and the photograph.

13. The system of claim 11 , wherein:
outputting the identity verification status comprises presenting, on a display device, the identity verification status; and
the identity verification status indicates that the identity of the user is verified in response to determining that the facial match score exceeds the facial match threshold.

14. The system of claim 11 , wherein, upon execution of the software instructions, the at least one processor is further configured to compare the recognized data objects to a watermark security feature present in the identified type of the identity document.

15. The system of claim 11 , wherein, upon execution of the software instructions, the at least one processor is further configured to:
extract, based on comparing the recognized characters to characteristics present in the identified type of the identity document, one or more secondary characteristics of the user from the image; and
compare the one or more secondary characteristics to the facial features in the live facial image and the facial features in the photograph.

16. The system of claim 15 , wherein the characteristics present in the identified type of the identity document include one or more of: hair color; eye color; gender, weight; height; date of birth; and ethnicity.

17. The system of claim 15 , wherein determining the identity verification status of the user is further based on comparing the one or more secondary characteristics to user profile data for the user retrieved from a data store.

18. The system of claim 11 , wherein outputting the identity verification status comprises prompting the user to submit an additional image including another live facial image of the user holding another identity document in response to determining that the document validity score is below the document validity threshold.

19. The system of claim 11 , wherein the recognized data objects include one or more of: a watermark; a hologram; a bar code; a serial number; a thumbnail version of the photograph; a negative image of the photograph; and a Quick Response (QR) code.

20. The system of claim 11 , wherein determining the identity verification status of the user is further based on comparing the recognized data objects to user profile data for the user retrieved from a data store.

Assignees

• Capital One Services Llc

Inventors

• Benkreira Abdelkader M'Hamed
• Edwards Joshua
• Mossoba Michael

Classifications

• G06F21/32 Primary

  using biometric data, e.g. fingerprints, iris scans or voiceprints · CPC title

• G06V20/62

  Text, e.g. of license plates, overlay texts or captions on TV images · CPC title

• G06V30/1444

  Selective acquisition, locating or processing of specific regions, e.g. highlighted text, fiducial marks or predetermined fields · CPC title

• G06V30/153

  using recognition of characters or words · CPC title

• G06V30/413

  Classification of content, e.g. text, photographs or tables · CPC title