Augmented reality identity verification

Patent metadata

Field	Value
Publication number	US-12482287-B2
Application number	US-202217579445-A
Country	US
Kind code	B2
Filing date	Jan 19, 2022
Priority date	Jun 3, 2016
Publication date	Nov 25, 2025
Grant date	Nov 25, 2025

Abstract

An augmented reality device (ARD) can present virtual content which can provide enhanced experiences with the user's physical environment. For example, the ARD can detect a linkage between a person in the FOV of the ARD and a physical object (e.g., a document presented by the person) or detect linkages between the documents. The linkages may be used in identity verification or document verification.

First claim

What is claimed is:

1 . A method for verifying an identity of a person using an augmented reality (AR) system, the method comprising:
under control of the AR system comprising computer hardware, the AR system comprising: an outward-facing camera configured to image an environment, and an optical sensor configured to emit light outside of a human visible spectrum: obtaining, with the outward-facing camera, an image of the environment; identifying a first biometric information associated with a person based at least partly on an analysis of the image of the environment; identifying a second biometric information in a first document presented by the person to the outward facing camera; identifying a third biometric information in a second document presented by the person to the outward facing camera; and determining a first match between the first biometric information with the second biometric information; determining, upon the determination of the first match, a second match between at least one of the first biometric information or the second biometric information with the third biometric information.

2 . The method of claim 1 , wherein the light emitted by the optical sensor comprises ultraviolet light.

3 . The method of claim 1 , wherein the first biometric information or the second biometric information comprises one or more of the following: a fingerprint, a height, a gender, a hair color, or a weight.

4 . The method of claim 1 , wherein identifying the first biometric information and identifying the second biometric information comprise:
detecting a first face in the image, wherein the first face comprises first facial features and is associated with the person; and detecting a second face in the image, wherein the second face comprises second facial features and is included in the document presented by the person, wherein determining the match comprises: calculating a first feature vector for the first face the based at least partly on the first facial features or calculating a second feature vector for the second face based at least partly on the second facial features, respectively; calculating a distance between the first feature vector and the second feature vector; comparing the distance to a threshold value; and confirming the match when the distance passes the threshold value, wherein calculating the first feature vector or calculating the second feature vector is implemented using one or more of the following: a facial landmark detection algorithm, a deep neural network algorithm, or a template matching algorithm.

5 . The method of claim 1 , wherein identifying the first biometric information and identifying the second biometric information comprise:
detecting a first face in the image, wherein the first face comprises first facial features and is associated with the person; and detecting a second face in the image, wherein the second face comprises second facial features and is included in the document presented by the person, wherein determining the match comprises: calculating a first feature vector for the first face based at least partly on the first facial features or calculating a second feature vector for the second face based at least partly on the second facial features, respectively; calculating a distance between the first feature vector and the second feature vector; comparing the distance to a threshold value; and confirming the match when the distance passes the threshold value.

6 . The method of claim 1 , wherein identifying the first biometric information and identifying the second biometric information comprise:
detecting a first face in the image, wherein the first face comprises first facial features and is associated with the person; and detecting a second face in the image, wherein the second face comprises second facial features and is included in the document presented by the person, wherein detecting the first face or detecting the second face comprises locating the first face or the second face in the image using at least one of the following: a wavelet-based boosted cascade algorithm or a deep neural network algorithm.

7 . The method of claim 1 , wherein identifying the first biometric information and identifying the second biometric information comprise:
detecting a first face in the image, wherein the first face comprises first facial features and is associated with the person; detecting a second face in the image, wherein the second face comprises second facial features and is included in the document presented by the person; and assigning first weights to the first facial features based at least partly on locations of the respective first facial features, or assigning second weights to second facial features based at least partly on locations of the respective second facial features.

8 . The method of claim 1 , wherein identifying the first biometric information and identifying the second biometric information comprise:
detecting a first face in the image, wherein the first face comprises first facial features and is associated with the person; and detecting a second face in the image, wherein the second face comprises second facial features detected in a photograph within the document presented by the person to the outward facing camera of the AR system from the image captured by the outward facing camera in which the first biometric information is identified.

9 . The method of claim 1 , wherein identifying the second information comprises:
emitting a light, by the optical sensor, onto the document presented by the person to the outward facing camera of the AR system, wherein the light is outside the human visible spectrum; and identifying the information under the light emitted by the optical sensor, wherein the second information is not directly visible when illuminated with light within the human visible spectrum.

10 . The method of claim 1 , wherein identifying the second information comprises:
identifying a label in the document presented by the person to the outward facing camera of the AR system, wherein the label contains encoded biometric information; and retrieving decoded biometric information based at least partly on the analysis of the label, wherein retrieving decoded biometric information comprises retrieving biometric information from a data source other than the image of the environment.

11 . The method of claim 1 , wherein identifying the second information comprises: identifying a label in the document presented by the person to the outward facing camera of the AR system, wherein the label contains encoded biometric information; and retrieving decoded biometric information based at least partly on the analysis of the label.

12 . The method of claim 1 , further comprising a virtual annotation indicating a result of the determination of the match between the first biometric with the second biometric information.

13 . An augmented reality (AR) system comprising:
an outward-facing camera, configured to image an environment; an optical sensor configured to emit light outside of a human visible spectrum; computer hardware configured to perform operations comprising: under control of the AR system comprising computer hardware, the AR system comprising an outward-facing camera configured to image an environment and an optical sensor: obtaining, with the outward-facing camera, an image of the environment; identifying a first face as first biometric information associated with a person based at least partly on an analysis of the image of the environment; identifying a second face as second biometric information in a p

Assignees

• Magic Leap Inc

Inventors

• Kaehler Adrian

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06V20/20 Primary

  in augmented reality scenes · CPC title

• G06F18/2148

  characterised by the process organisation or structure, e.g. boosting cascade · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06V40/171

  Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships · CPC title