ATM transaction security using facial detection

Patent metadata

Field	Value
Publication number	US-10949652-B1
Application number	US-201916678807-A
Country	US
Kind code	B1
Filing date	Nov 8, 2019
Priority date	Nov 8, 2019
Publication date	Mar 16, 2021
Grant date	Mar 16, 2021

Abstract

Disclosed herein are system, method, and computer program product embodiments for securing ATM transactions based on facial detection. The approach contemplates performing facial detection on an image of a user of an ATM when the user authenticates themselves, and comparing the user's detected face to facial detection results of subsequent images taken at the ATM. Based on this comparison, various security events may be detected and, for any given security event, a particular action may be taken.

First claim

What is claimed is:

1. A computer implemented method, comprising:
capturing, by one or more computing devices, responsive to authentication of a session with an Automated Teller Machine (ATM), one or more first images from a camera disposed on the ATM, at the time the authentication of the session is completed;
performing facial detection, by the one or more computing devices, on the one or more first images to obtain a first facial detection result comprising a first detected face;
associating, by the one or more computing devices, the first detected face with the authenticated session, wherein the first detected face is held in memory while the authenticated session remains active;
capturing, by the one or more computing devices, one or more second images from the camera during the authenticated session;
performing facial detection, by the one or more computing devices, on the one or more second images to obtain a second facial detection result;
detecting a security event, by the one or more computing devices, by comparing the second facial detection result to the first facial detection result; and
updating, by the one or more computing devices, a state of the authenticated session based on the detected security event.

2. The computer implemented method of claim 1 , wherein the second facial detection result comprises a determination that no face is present in the one or more second images.

3. The computer implemented method of claim 1 , wherein updating the state of the session based on the detected security event comprises:
interrupting the session.

4. The computer implemented method of claim 1 , wherein updating the state of the session based on the detected security event comprises:
updating the state of the session using an action assigned to the security event.

5. The computer implemented method of claim 4 , further comprising:
assigning, by the one or more computing devices, the action to the security event from a set of actions.

6. The computer implemented method of claim 4 , wherein the action assigned to the security event includes one or more actions from a set of actions comprising:
terminating the session,
contacting an attendant,
contacting an emergency service,
sounding an alarm,
locking a door, and
sending at least one of the one or more second images to an authority.

7. The computer implemented method of claim 1 , wherein updating the state of the session is further based on detecting interaction with the ATM during the security event.

8. The computer implemented method of claim 1 , wherein the second facial detection result comprises a second detected face different from the first detected face.

9. The computer implemented method of claim 8 , wherein updating the state of the session based on the detected security event comprises:
updating the state of the session using an action assigned to detection of the second detected face different from the first detected face.

10. The computer implemented method of claim 8 , wherein updating the state of the session is further based on detecting interaction with the ATM during the security event.

11. A computer readable storage device having instructions stored thereon, execution of which, by one or more processing devices, causes the one or more processing devices to perform operations comprising:
capturing, responsive to authentication of a session with an Automated Teller Machine (ATM), one or more first images from a camera disposed on the ATM, at the time the authentication of the session is completed;
performing facial detection on the one or more first images to obtain a first facial detection result comprising a first detected face;
associating the first detected face with the authenticated session, wherein the first detected face is held in memory while the authenticated session remains active;
capturing one or more second images from the camera during the authenticated session;
performing facial detection on the one or more second images to obtain a second facial detection result;
detecting a security event by comparing the second facial detection result to the first facial detection result; and
updating a state of the authenticated session based on the detected security event.

12. The computer readable storage device of claim 11 , wherein the second facial detection result comprises a determination that no face is present in the one or more second images.

13. The computer readable storage device of claim 11 , wherein the authentication of the session comprises a first level of authentication that occurs prior to a second level of authentication.

14. The computer readable storage device of claim 11 , wherein updating the state of the session based on the detected security event comprises:
updating the state of the session using an action assigned to the security event.

15. The computer implemented method of claim 14 , further comprising:
assigning, by the one or more computing devices, the action to the security event from a set of actions.

16. The computer readable storage device of claim 11 , wherein updating the state of the session is further based on detecting interaction with the ATM during the security event.

17. The computer readable storage device of claim 11 , wherein the second facial detection result comprises a second detected face different from the first detected face.

18. A computer implemented method, comprising:
performing facial detection, by one or more computing devices and responsive to completion of an authentication process for a session with an Automated Teller Machine (ATM), on one or more first images from a camera disposed on the ATM to obtain a first facial detection result, wherein the first facial detection result comprises a first detected face;
associating, by the one or more computing devices, the first detected face with the authenticated session, wherein the first detected face is held in memory while the authenticated session remains active;
performing facial detection, by the one or more computing devices, on one or more second images from the camera to obtain a second facial detection result;
detecting a security event, by the one or more computing devices, by comparing the second facial detection result with the first facial detection result; and
updating, by the one or more computing devices, a state of the authenticated session based on the detected security event.

19. The computer implemented method of claim 18 , wherein the second facial detection result comprises a determination that no face is present in the one or more second images.

20. The computer implemented method of claim 18 , wherein updating the state of the session comprises interrupting the session.

21. The computer implemented method of claim 18 , wherein updating the state of the session based on the detected security event comprises:
updating, by the one or more computing devices, the state of the session using an action assigned to the security event.

22. The computer implemented method of claim 21 , wherein the action assigned to the security event includes one or more actions from a set of actions comprising:
terminating the session,
contacting an attendant,
contacting an emergency service,
sounding an alarm,
locking a door, and
sending one or more images from the camera to an authority.

23. The computer implemented method of claim 18 ,
wherein updating the state of the session is further based on detecting intera

Assignees

• Capital One Services Llc

Inventors

• Cruz Ana
• Pham Vincent
• Ghalaty Nahid Farhady
• Camenares Christopher
• Adcock Lee
• Yl Jason
• Shyamala Geeta

Classifications

• G06V40/168

  Feature extraction; Face representation · CPC title

• G06V40/161

  Detection; Localisation; Normalisation · CPC title

• G06V40/172 Primary

  Classification, e.g. identification · CPC title

• G06V40/10

  Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands · CPC title

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title