Alarm system facial recognition

Patent metadata

Field	Value
Publication number	US-12198528-B2
Application number	US-202218146808-A
Country	US
Kind code	B2
Filing date	Dec 27, 2022
Priority date	Dec 27, 2022
Publication date	Jan 14, 2025
Grant date	Jan 14, 2025

Abstract

A premises device associated with a premises security system includes a three-dimensional (3D) depth sensor and a camera and processing circuitry in communication with the camera and the 3D depth sensor. The processing circuitry in the premises device generates a two-dimensional (2D) template of a face based on an image captured by the camera. The 2D template indicates a facial characteristic associated with the person's face. A 3D mapping of the facial characteristic is generated using data from the 3D depth sensor. At least one of an emotional state or facial gesture is determined based on the 3D mapping. The premises security system performs a security action based on the at least one of the determined emotional state or facial gesture.

First claim

What is claimed is:

1. A premises device associated with a premises security system for monitoring a premises, the premises device comprising:
a three-dimensional (3D) depth sensor;
a camera; and
processing circuitry in communication with the camera and the 3D depth sensor, the processing circuitry configured to:
generate a two-dimensional (2D) template of a face based on an image captured by the camera, the 2D template indicating a facial characteristic associated with the face;
generate a 3D mapping of the facial characteristic using data from the 3D depth sensor;
authenticate a user based on the 2D template and the 3D mapping;
based on authenticating the user, unlock a user interface and enable gesture control of the user interface;
in response to enabling the gesture control of the user interface, detect, using at least one of the camera or the 3D depth sensor, a control gesture;
determine a facial gesture for gesture control based on the control gesture that was detected; and

perform a premises security system action in response to the facial gesture, the premises security system action comprising arming the premises security system and causing at least one door to lock.

2. The premises device of claim 1 , further comprising a light emitter that projects structured light in a grid or dot matrix format; and
wherein processing circuitry is further configured to generate the 3D mapping based on the structed light projected onto the face.

3. The premises device of claim 2 , wherein the light emitter is an infrared light emitter.

4. The premises device of claim 1 , wherein the processing circuitry is further configured to authenticate a user by comparing the 3D mapping of the face to a stored 3 D mapping associated with an authorized user.

5. The premises device of claim 1 , wherein the 3D depth sensor is a time- of-flight sensor.

6. The premises device of claim 1 , wherein the processing circuitry is further configured to determine the facial characteristic based on pixel information.

7. The premises device of claim 1 , wherein the premises device is a control panel of the premises security system.

8. The premises device of claim 1 , wherein at least one of the 3D depth sensor or the camera are further configured to rotate.

9. The premises device of claim 1 , wherein the processing circuitry is further configured to use at least one of the camera or the 3D depth sensor to detect an environmental event in an environment of the premises device.

10. A method performed in a premises device associated with a premises security system for monitoring a premises, the method comprising:
generating a two-dimensional (2D) template of a face based on an image captured by a camera, the 2D template indicating a facial characteristic associated with the face;
generating a 3D mapping of the facial characteristic using data from a 3D depth sensor;
authenticating a user based on the 2D template and the 3D mapping;
based on authenticating the user, unlocking a user interface and enabling gesture control of the user interface;
in response to enabling the gesture control of the user interface, detecting, using at least one of the camera or the 3D depth sensor, a control gesture;
determining a facial gesture for gesture control based on the control gesture that was detected; and
performing a premises security system action in response to the facial gesture, the premises security system action comprising arming the premises security system and causing at least one door to lock.

11. The method of claim 10 , further comprising using a light emitter to project structured light, the structured light being in a grid or dot matrix format; and
wherein the 3D mapping is generated based on the structed light being projected onto the face.

12. The method of claim 11 , wherein the light emitter is an infrared light emitter.

13. The method of claim 10 , further comprising authenticating a user by comparing the 3D mapping of the face to a stored 3D mapping associated with an authorized user.

14. The method of claim 10 , wherein the 3D depth sensor is a time-of-flight sensor.

15. The method of claim 10 , further comprising determining the facial characteristic based on pixel information.

16. The method of claim 10 , wherein the premises device is a control panel of the premises security system.

17. The method of claim 10 , further comprising rotating at least one of the 3D depth sensor and the camera to capture a wider field of view.

18. The method of claim 10 , further comprising using at least one of the camera and the 3D depth sensor to detect an environmental event occurring in an environment of the premises device.

Assignees

• The Adt Security Corp

Inventors

• Else Steven
• Patel Jatin

Classifications

• G06V40/172

  Classification, e.g. identification · CPC title

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• G06V40/174

  Facial expression recognition · CPC title

• G08B13/19608

  Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position · CPC title

• G08B25/008

  Alarm setting and unsetting, i.e. arming or disarming of the security system · CPC title