Techniques for detecting a three-dimensional face in facial recognition

Patent metadata

Field	Value
Publication number	US-12154378-B2
Application number	US-202318447991-A
Country	US
Kind code	B2
Filing date	Aug 10, 2023
Priority date	Aug 7, 2019
Publication date	Nov 26, 2024
Grant date	Nov 26, 2024

Abstract

Examples relate to processing a first image captured by a camera at a first time to determine a first set of multiple key points of a face in the first image, processing a second image captured by the camera at a second time to determine a second set of the multiple key points on the face in the second image, determining a location of at least a portion of the multiple key points in a three-dimensional space based on a first location of each of the portion of the multiple key points in the first image and a second location of each of the portion of the multiple key points in the second image, and detecting whether the face is a valid three-dimensional face for facial recognition based at least in part on the location of at least the portion of the multiple key points in the three-dimensional space.

First claim

What is claimed is:

1. A system for detecting three-dimensional features in validating a face for facial recognition, comprising:
a camera; and
at least one processor configured to:
process a first image captured by the camera at a first time to determine a first set of multiple key points of a face in the first image;
process a second image captured by the camera at a second time, that is within a threshold time of the first time, to determine a second set of the multiple key points on the face in the second image;
determine, based on a first location of each of a portion of the multiple key points in the first image and a second location of each of the portion of the multiple key points in the second image, a three-dimensional location of at least the portion of the multiple key points in a three-dimensional space; and
detect whether the face is a valid three-dimensional face for facial recognition at least in part on the three-dimensional location of at least the portion of the multiple key points.

2. The system of claim 1 , wherein the at least one processor is configured to detect whether the face is the valid three-dimensional face based on using a classifier on the three-dimensional locations.

3. The system of claim 1 , wherein the at least one processor is configured to detect whether the face is the valid three-dimensional face based on comparing the three-dimensional location of at least the portion of the multiple key points to similar key points of a known face to determine a difference.

4. The system of claim 3 , wherein the at least one processor is configured to detect whether the face is the valid three-dimensional face based on providing the difference to a classifier that indicates, based on the difference, whether the face is the valid three-dimensional face.

5. The system of claim 3 , wherein the at least one processor is further configured to apply, before comparing at least the portion of the multiple key points to similar key points of the known face, at least one of an alignment or a scaling to the three-dimensional location of at least the portion of the multiple key points in the three-dimensional space.

6. The system of claim 1 , further comprising an infrared pass filter for applying to at least one of the first image or the second image to filter infrared light for detecting whether the face is the valid three-dimensional face for facial recognition.

7. The system of claim 1 , wherein the camera is a video camera configured to capture the first image and the second image in a stream of images in a video.

8. The system of claim 1 , wherein the second image is captured by the camera based on detecting movement after capturing the first image.

9. The system of claim 1 , wherein the at least one processor is further configured to perform facial recognition based on detecting that the face is the valid three-dimensional face for facial recognition.

10. The system of claim 1 , wherein the at least one processor is configured to detect whether the face is the valid three-dimensional face for facial recognition at least in part by determining a confidence level associated with the detecting.

11. The system of claim 10 , wherein the at least one processor is further configured to provide the confidence level to an access control system for restricting, based at least in part on the confidence level, access to an area.

12. A computer-implemented method for detecting three-dimensional features in validating a face for facial recognition, comprising:
processing a first image captured by a camera at a first time to determine a first set of multiple key points of a face in the first image;
processing a second image captured by the camera at a second time, that is within a threshold time of the first time, to determine a second set of the multiple key points on the face in the second image;
determining, based on a first location of each of a portion of the multiple key points in the first image and a second location of each of the portion of the multiple key points in the second image, a three-dimensional location of at least the portion of the multiple key points in a three-dimensional space; and
detecting whether the face is a valid three-dimensional face for facial recognition at least in part on the three-dimensional location of at least the portion of the multiple key points.

13. The computer-implemented method of claim 12 , wherein detecting whether the face is the valid three-dimensional face is based on using a classifier on the three-dimensional locations.

14. The computer-implemented method of claim 12 , wherein detecting whether the face is the valid three-dimensional face is based on comparing the three-dimensional location of at least the portion of the multiple key points to similar key points of a known face to determine a difference.

15. The computer-implemented method of claim 14 , wherein detecting whether the face is the valid three-dimensional face is based on providing the difference to a classifier that indicates, based on the difference, whether the face is the valid three-dimensional face.

16. The computer-implemented method of claim 14 , further comprising applying, before comparing at least the portion of the multiple key points to similar key points of the known face, at least one of an alignment or a scaling to the three-dimensional location of at least the portion of the multiple key points in the three-dimensional space.

17. The computer-implemented method of claim 12 , further comprising applying, to at least one of the first image or the second image, an infrared pass filter to filter infrared light for detecting whether the face is the valid three-dimensional face for facial recognition.

18. A non-transitory computer-readable medium, comprising code executable by one or more processors for detecting three-dimensional features in validating a face for facial recognition, the code comprising code for:
processing a first image captured by a camera at a first time to determine a first set of multiple key points of a face in the first image;
processing a second image captured by the camera at a second time, that is within a threshold time of the first time, to determine a second set of the multiple key points on the face in the second image;
determining, based on a first location of each of a portion of the multiple key points in the first image and a second location of each of the portion of the multiple key points in the second image, a three-dimensional location of at least the portion of the multiple key points in a three-dimensional space; and
detecting whether the face is a valid three-dimensional face for facial recognition at least in part on the three-dimensional location of at least the portion of the multiple key points.

19. The non-transitory computer-readable medium of claim 18 , wherein the code for detecting detects whether the face is the valid three-dimensional face based on using a classifier on the three-dimensional locations.

20. The non-transitory computer-readable medium of claim 18 , wherein the code for detecting detects whether the face is the valid three-dimensional face based on comparing the three-dimensional location of at least the portion of the multiple key points to similar key points of a known face to determine a difference.

Assignees

• Tyco Fire & Security Gmbh

Inventors

• Rozner Amit
• Kirsch Lior
• Boué Tamar
• Falik Yohay

Classifications

• G06V20/647

  by matching two-dimensional images to three-dimensional objects · CPC title

• G06T2200/08

  involving all processing steps from image acquisition to 3D model generation · CPC title

• G06T17/205

  Re-meshing · CPC title

• G06F21/32

  using biometric data, e.g. fingerprints, iris scans or voiceprints · CPC title

• G06V40/40

  Spoof detection, e.g. liveness detection · CPC title