Gesture matching mechanism

Patent metadata

Field	Value
Publication number	US-11449592-B2
Application number	US-202017066138-A
Country	US
Kind code	B2
Filing date	Oct 8, 2020
Priority date	Mar 28, 2015
Publication date	Sep 20, 2022
Grant date	Sep 20, 2022

Abstract

An example apparatus is disclosed herein that includes a memory and at least one processor. The at least one processor is to execute instructions to: select a gesture from a database, the gesture including a sequence of poses; translate the selected gesture into an animated avatar performing the selected gesture for display at a display device; display a prompt for the user to perform the selected gesture performed by the animated avatar; capture an image of the user performing the selected gesture; and perform a comparison between a gesture performed by the user in the captured image and the selected gesture to determine whether there is a match between the gesture performed by the user and the selected gesture.

First claim

The invention claimed is:

1. An apparatus comprising:
memory;
machine-readable instructions; and
at least one processor to execute the instructions to:
select a gesture from a database, the gesture including a sequence of poses;
translate the selected gesture into an animated avatar for display at a display device, the animated avatar representative of a user performing the selected gesture, the animated avatar including a face;
display a prompt for the user to perform the selected gesture performed by the animated avatar;
cause an image of the user performing the selected gesture to be captured; and
perform a comparison between a gesture performed by the user in the captured image and the selected gesture to determine whether there is a match between the gesture performed by the user and the selected gesture.

2. The apparatus of claim 1 , wherein the at least one processor is to authenticate the user when the gesture performed by the user in the captured image matches the selected gesture.

3. The apparatus of claim 2 , wherein the image includes a plurality of frames, and the at least one processor is to:
select a key frame from the image; and
determine a temporal sequence across multiple frames for the comparison of the gesture performed by the user to the selected gesture.

4. The apparatus of claim 3 , wherein the at least one processor is to apply dynamic time warping to perform the comparison.

5. The apparatus of claim 1 , wherein the database includes multiple gestures, and the at least one processor to identify the gestures from a plurality of images of the user captured prior to display of the selected gesture.

6. The apparatus of claim 1 , wherein the gesture performed by the user is a first gesture, and the at least one processor is to:
identify a second gesture performed by the user; and
add the second gesture to the database.

7. The apparatus of claim 6 , wherein the at least one processor is to:
compare the second gesture to gestures in the database; and
add the second gesture to the database when the second gesture does not match one of the gestures in the database.

8. The apparatus of claim 1 , wherein the at least one processor is to:
monitor gestures of the user over time; and
determine if there is a health problem based on a change in the gestures.

9. The apparatus of claim 8 , wherein the gestures are facial gestures, and the at least one processor is to detect a micro change in the facial gestures to determine if there is the health problem.

10. The apparatus of claim 9 , wherein the facial gestures include movements of a mouth.

11. The apparatus of claim 9 , wherein the health problem includes a stroke.

12. The apparatus of claim 1 , wherein to translate the selected gesture into the animated avatar, the at least one processor is to blend a plurality of shape features corresponding to facial gesture data.

13. An apparatus comprising:
memory;
instructions in the apparatus;
at least one processor to execute instructions to:
translate a first gesture into an animated avatar for display at a display device, the animated avatar representative of a user performing the first gesture, the first gesture including a sequence of poses, and the animated avatar including eyes and a mouth; and
display a prompt for the user to perform the first gesture performed by the animated avatar; and

an image capturing device to capture an image of a second gesture, the second gesture being the user performing the first gesture, wherein the at least one processor is to perform a comparison between the second gesture performed by the user in the image and the first gesture to determine whether there is a match between the second gesture performed by the user and the first gesture.

14. The apparatus of claim 13 , wherein the at least one processor is to authenticate the user when the second performed by the user in the image matches the first gesture.

15. The apparatus of claim 14 , wherein the image includes a plurality of frames, and the at least one processor is to:
select a key frame from the image; and
determine a temporal sequence across multiple frames for the comparison of the second gesture performed by the user to the first gesture.

16. The apparatus of claim 15 , wherein the at least one processor is to use time warping to perform the comparison.

17. The apparatus of claim 13 , wherein the at least one processor is to identify the first gesture from a plurality of images of the user captured prior to display of the first gesture.

18. The apparatus of claim 13 , wherein at least one processor is to:
identify a third gesture performed by the user; and
add the third gesture to a database.

19. The apparatus of claim 18 , wherein the at least one processor is to:
compare the third gesture to gestures in the database; and
add the third gesture to the database when the third gesture does not match one of the gestures in the database.

20. The apparatus of claim 13 , wherein the first and second gestures are facial gestures, and the at least one processor is to:
monitor the facial gestures of the user over time; and
determine if there is a health problem based on a change in the facial gestures.

21. The apparatus of claim 20 , wherein the at least one processor is to detect a micro change in the facial gestures to determine if there is the health problem.

Assignees

• Intel Corp

Inventors

• Li Wenlong
• Shen Xiaolu
• Zhang Lidan
• Lorenzo Jose E
• Li Qiang
• Holmes Steven
• Tong Xiaofeng
• Du Yangzhou
• Smiley Mary
• Mishra Alok

Classifications

• H04W12/065

  Continuous authentication · CPC title

• G06F21/32 Primary

  using biometric data, e.g. fingerprints, iris scans or voiceprints · CPC title

• H04L9/32

  including means for verifying the identity or authority of a user of the system {or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials} · CPC title

• H04W12/06

  Authentication · CPC title

• G06F21/30

  Authentication, i.e. establishing the identity or authorisation of security principals · CPC title