Dynamic keyboard and touchscreen biometrics

Patent metadata

Field	Value
Publication number	US-9747428-B2
Application number	US-201414169007-A
Country	US
Kind code	B2
Filing date	Jan 30, 2014
Priority date	Jan 30, 2014
Publication date	Aug 29, 2017
Grant date	Aug 29, 2017

Abstract

Embodiments of the present invention are directed toward providing ongoing authentication using biometric data. Fingerprints and/or other biometric data can be captured during the normal use of an electronic device, such as typing on a keyboard, and compared with associated reference biometrics to provide ongoing authentication to an application while the electronic device is being used. Comparison results may further be combined with additional physiological or behavioral biometrics to determine a level of authentication encompassing multiple biometric inputs and/or types.

First claim

What is claimed is:

1. A method of authenticating a user of an electronic device, the method comprising:
capturing, by one or more sensors of the electronic device, a plurality of biometric images in succession over a period of time while the user is interacting with a user interface of the electronic device to input user data for a non-authentication operation;
for each image of the plurality of biometric images: (1) determining, by a processor of the electronic device, a key of the user interface, the key selected by the user while interacting with the user interface, the key associated with the capture of the image; and (2) determining, by the processor of the electronic device, a finger corresponding to the key of the user interface;
determining, by the processor, whether the plurality of biometric images correspond to a single finger of the user;
in response to the determining that the plurality of biometric images correspond to the single finger of the user, selecting, for comparison to the plurality of captured images, by the processor of the electronic device, at least one reference image from a plurality of reference images based on the single finger of the user corresponding to the plurality of biometric images;
comparing, by the processor of the electronic device, the plurality of biometric images with the at least one selected reference image; and
authenticating the user for access to the electronic device based on the comparing.

2. The method of claim 1 , wherein the user interface comprises a virtual keyboard on a touchscreen of the electronic device.

3. The method of claim 1 , wherein the user interface comprises a physical keyboard.

4. The method of claim 1 , wherein comparing the plurality of biometric images with the at least one selected reference image results in a plurality of comparisons, the method further comprising combining results of the plurality of comparisons into a single result.

5. The method of claim 1 , wherein comparing the plurality of biometric images with the at least one selected reference image comprises:
combining the plurality of biometric images into a composite image; and
comparing the composite image with the at least one selected reference image.

6. The method of claim 5 , wherein the combining the plurality of biometric images into a composite image further comprising stitching the plurality of biometric images together to form the composite image of a fingerprint.

7. The method of claim 6 , wherein at least two of the captured plurality of biometric images are each associated with a different key of the user interface.

8. The method of claim 1 , further comprising:
capturing behavioral biometric data; and
comparing the captured behavioral biometric data with stored behavioral biometric data;
wherein the authenticating the user for access to the electronic device is further based on the comparing the captured behavioral biometric data with the stored behavioral biometric data.

9. The method of claim 8 , further comprising combining (i) information regarding the comparison of the plurality of biometric images with the at least one selected reference image and (ii) results of the comparison of the captured behavioral biometric data with results of the stored behavioral biometric data to create a combined comparison score.

10. The method of claim 1 , wherein capturing the plurality of biometric images occurs after an initial authentication using the electronic device.

11. The method of claim 1 , wherein the provided information is used to determine a functionality of the application for the user.

12. The method of claim 1 , wherein the selecting the at least one reference image from the plurality of reference images for comparison to the plurality of captured images is based on an orientation of the electronic device when the user is interacting with the user interface.

13. The method of claim 1 , wherein the determining the finger corresponding to the key of the user interface includes selecting the finger from a plurality of fingers associated with the key.

14. The method of claim 13 , wherein each one of the plurality of fingers is associated with at least one different reference image of the plurality of reference images.

15. The method of claim 1 , wherein the determining the finger corresponding to the key of the user interface is based on a mapping between the key of the user interface and the finger.

16. The method of claim 15 , wherein each key of the user interface is mapped to at least one finger of the user and at least two keys of the user interfaces are mapped to one finger of the user.

17. A device comprising:
a user interface;
one or more sensors configured to capture a plurality of biometric images in succession over a period of time while a user is interacting with the user interface to input user data used for a non-authentication operation; and
a processing unit communicatively coupled with the one or more sensors, the processing unit configured to:
for each image of the plurality of biometric images: (1) determine a key of the user interface, the key selected by the user while interacting with the user interface, the key associated with the capture of the image; and (2) determine a finger corresponding to the key of the user interface;
determining whether the plurality of biometric images correspond to a single finger of the user;
in response to the determining that the plurality of biometric images correspond to the single finger of the user, select, for comparison to the plurality of captured images, at least one reference image from a plurality of reference images based on the single finger of the user corresponding to the plurality of biometric images; and
compare the plurality of biometric images with the at least one selected reference image; and
authenticate the user for access to the electronic device based on the comparing.

18. The device of claim 17 , further comprising a touchscreen, wherein the user interface comprises a virtual keyboard on the touchscreen.

19. The device of claim 17 , wherein the processing unit is further configured to:
make a plurality of comparisons by the comparing of each image of the plurality of biometric images with the at least one selected reference image, and
combine results of the plurality of comparisons into a single result.

20. The device of claim 17 , wherein the comparing the plurality of biometric images with the at least one selected reference image comprises:
combining the plurality of biometric images into a composite image; and
comparing the composite image with the at least one selected reference image.

21. The device of claim 17 , wherein the processing unit is further configured to:
capture behavioral biometric data; and
compare the captured behavioral biometric data with stored behavioral biometric data;
wherein the authenticating the user for access to the electronic device is further based on the comparing the captured behavioral biometric data with the stored behavioral biometric data.

22. The device of claim 21 , wherein the processing unit is further configured to combine (i) information regarding the comparison of the plurality of biometric images with the at least one selected reference image and (ii) results of the comparison of the captured behavioral biometric data with results of the stored behavioral biometric data to create a combined comparison score.

23. The device of claim 17 , wherein the

Assignees

• Qualcomm Inc

Inventors

• Tartz Robert Scott
• Farley Richard Oliver
• Schneider John Keith
• Keating Virginia Walker

Classifications

• G06F21/32 Primary

  using biometric data, e.g. fingerprints, iris scans or voiceprints · CPC title

• G06F21/83

  input devices, e.g. keyboards, mice or controllers thereof · CPC title