Biometric authentication using gesture

Patent metadata

Field	Value
Publication number	US-10733274-B2
Application number	US-201615209457-A
Country	US
Kind code	B2
Filing date	Jul 13, 2016
Priority date	Aug 11, 2015
Publication date	Aug 4, 2020
Grant date	Aug 4, 2020

Abstract

There is provided a biometric authentication method using a portable electronic device. The method includes identifying a gesture of a user to be authenticated through a gesture recognition unit of the portable electronic device and acquiring biometric information of the user through an information input unit of the portable electronic device. The method further includes comparing the identified gesture and the acquired biometric information with an authentication information stored in an information storage unit to perform the biometric authentication of the user, and outputting a result of the biometric authentication.

First claim

What is claimed is:

1. A non-transitory computer-readable storage medium including computer-executable instructions, which cause, when executed by at least one of a handheld electronic device, the handheld electronic device to perform a method for user authentication, the method comprising:
acquiring biometric information of a user through a biometric sensor of the handheld electronic device;
capturing, via a camera of the handheld electronic device, an image of the user holding the handheld electronic device at the time of acquiring the biometric information of the user;
processing the image to determine a positional angle comprising a first inclination angle and a second inclination angle of the handheld electronic device at the time of capturing the image,
wherein processing the image to determine the positional angle comprises:
1) analyzing the image to recognize eyes of the user,
2) estimating a tetragonal shape corresponding to a face of the user based on locations of the eyes on the image, and
3) computing a gradient of the tetragonal shape in the image,

wherein the first inclination angle is defined between an axis passing a surface of the handheld electronic device and a vertical reference axis perpendicular to a horizontal plane, wherein the second inclination angle is defined between the surface of the handheld electronic device and the horizontal plane,
wherein the positional angle comprising the first inclination angle and the second inclination angle of the handheld electronic device at the time of capturing the image is determined based on the gradient of the tetragonal shape computed by processing the captured image rather than values of orientation changes measured by a gyro sensor;

computing a gesture similarity, which comprises comparing the positional angle with registered user gesture information stored in at least one memory;
computing a biometric similarity, which comprises comparing the acquired biometric information with registered user biometric information stored in the at least one memory;
computing a combined similarity, which comprises processing the gesture similarity and the biometric similarity; and
comparing the combined similarity with a predetermined similarity threshold for authentication of the user.

2. The non-transitory computer-readable storage medium of claim 1 , wherein the method for user authentication further comprises determining a motion of the user performed with the handheld electronic device and a touch operation performed on the handheld electronic device for a predetermined time period,
wherein computing the gesture similarity further comprises processing the registered user gesture information and the motion of the user, and the touch operation.

3. The non-transitory computer-readable storage medium of claim 1 , further comprising:
prior comparing the combined similarity with the predetermined similarity threshold, determining whether acquiring the biometric information and capturing the image were simultaneous so that comparing the combined similarity with the predetermined similarity threshold is performed only when acquiring the biometric information and capturing the image were performed simultaneously.

4. A user authentication method for a handheld electronic device, the method comprising:
acquiring biometric information of a user through a biometric sensor of the handheld electronic device;
capturing, via a camera of the handheld electronic device, an image of the user holding the handheld electronic device at the time of acquiring the biometric information of the user;
processing the image to determine a positional angle comprising a first inclination angle and a second inclination angle of the handheld electronic device at the time of capturing the image,
wherein processing the image to determine the positional angle comprises:
1) analyzing the image to recognize eyes of the user,
2) estimating a tetragonal shape corresponding to a face of the user based on locations of the eyes on the image, and
3) computing a gradient of the tetragonal shape in the image,

wherein the first inclination angle is defined between an axis passing a surface of the handheld electronic device and a vertical reference axis perpendicular to a horizontal plane, wherein the second inclination angle is defined between the surface of the handheld electronic device and the horizontal plane,
wherein the positional angle comprising the first inclination angle and the second inclination angle of the handheld electronic device at the time of capturing the image is determined based on the gradient of the tetragonal shape computed by processing the captured mage rather than values of orientation changes measured by a gyro sensor;

computing a gesture similarity, which comprises comparing the positional angle with registered user gesture information stored in at least one memory;
computing a biometric similarity, which comprises comparing the acquired biometric information with registered user biometric information stored in the at least one memory;
computing a combined similarity, which comprises processing the gesture similarity and the biometric similarity; and
comparing the combined similarity with a predetermined similarity threshold for authentication of the user.

5. The method of claim 4 , wherein a user gesture is further determined by a touch operation on the handheld electronic device for a predetermined time period.

6. The method of claim 5 , further comprising:
prior comparing the combined similarity with the predetermined similarity threshold, determining whether acquiring the biometric information and capturing the image were simultaneous so that comparing the combined similarity with the predetermined similarity threshold is performed only when acquiring the biometric information and capturing the image were performed simultaneously.

7. A handheld electronic apparatus comprising:
a camera;
a biometric sensor configured to receive biometric information of a user;
a memory storing user authentication information; and
at least one controller configured to process user authentication biometric information received by the biometric sensor and an image of the user captured by the camera at the time of receiving the biometric information, wherein the at least one controller is configured:
to process the image to determine a positional angle comprising a first inclination angle and a second inclination angle of the handheld electronic apparatus at the time of capturing the image,
wherein to determine the positional angle, the at least one controller is configured to:
1) analyze the image to recognize eyes of the user,
2) estimate a tetragonal shape corresponding to a face of the user based on locations of the eyes on the image, and
3) compute a gradient of the tetragonal shape in the image,

wherein the first inclination angle is defined between an axis passing a surface of the handheld electronic apparatus and a vertical reference axis perpendicular to a horizontal plane, wherein the second inclination angle is defined between the surface of the handheld electronic apparatus and the horizontal plane,
wherein the positional angle comprising the first inclination angle and the second inclination angle of the handheld electronic apparatus at the time of capturing the image is determined based on the gradient of the tetragonal shape computed by processing the captured image rather than values of orientation changes measured by a gyro sensor;

to compute a gesture similarity, which comprises comparing the positional angle with registered user gesture information stored in at least one memory;
to compute a biometric similarity, which comprises comparing the acquired biometric information with regis

Assignees

• Suprema Inc

Inventors

• Shin Hochul
• Lee Kideok
• Lee Hyeonchang
• Lee Jong Man
• Song Bong Seop
• Lee Jae Won

Classifications

• G06V40/70

  Multimodal biometrics, e.g. combining information from different biometric modalities · CPC title

• G06F21/31

  User authentication · CPC title

• G06F21/32 Primary

  using biometric data, e.g. fingerprints, iris scans or voiceprints · CPC title

• G06K9/00892

  Physics · mapped topic