Radar-based authentication status feedback

Patent metadata

Field	Value
Publication number	US-11841933-B2
Application number	US-202016901189-A
Country	US
Kind code	B2
Filing date	Jun 15, 2020
Priority date	Jun 26, 2019
Publication date	Dec 12, 2023
Grant date	Dec 12, 2023

Abstract

This document describes techniques and systems that enable radar-based authentication status feedback. A radar field is used to enable an electronic device to account for the user's distal physical cues to determine and maintain an awareness of the user's location and movements around the device. This awareness allows the device to anticipate some of the user's intended interactions and provide functionality in a timely and seamless manner, such as preparing an authentication system to authenticate the user before the user touches or speaks to the device. These features also allow the device to provide visual feedback that can help the user understand that the device is aware of the user's location and movements. In some cases, the feedback is provided using visual elements presented on a display.

First claim

What is claimed is:

1. An electronic device, comprising:
a display,
a radar system, implemented at least partially in hardware, configured to:
provide a radar field;
sense reflections from a user in the radar field;
analyze the reflections from the user in the radar field; and
provide, based on the analysis of the reflections, radar data;

one or more computer processors; and
one or more computer-readable media having instructions stored thereon that, responsive to execution by the one or more computer processors, implement a radar-based awareness manager configured to:
maintain the electronic device in a dormant mode;
determine, based on a first subset of the radar data, a presence of the user within a recognition zone of the electronic device;
responsive to determining the presence of the user within the recognition zone, cause the electronic device to enter an aware mode in which the display presents a first visual element that indicates a first status of the electronic device;
detect a user action, based on a second subset of the radar data, the user action categorized as an indication of an intent of the user to interact with the electronic device, the user action including one or more of:
the user turning toward or away from the electronic device without the user's face being detected;
the user moving toward or away from the electronic device without the user's face being detected;
the user leaning toward the electronic device without the user's face being detected; or
the user making a reach gesture toward the electronic device without a touch to the electronic device and without the user's face being detected;

responsive to detection of the user action that is categorized as the indication of the intent of the user to interact with the electronic device, cause the electronic device to prepare an authentication system to perform an authentication process;
cause the prepared authentication system to perform, based on a trigger event, the authentication process on the user; and
responsive to the user being authenticated, cause the electronic device to enter an active mode.

2. The electronic device of claim 1 , wherein the first visual element that indicates the first status of the electronic device in the aware mode is one or more of a displayed time, a displayed date, a connectivity status, or a battery-level indicator.

3. The electronic device of claim 1 , wherein the radar-based awareness manager is further configured to, responsive to detection of the user action that is categorized as the indication of the intent of the user to interact with the electronic device, cause the electronic device to enter an engaged mode in which the display presents a second visual element that indicates a second status of the electronic device.

4. The electronic device of claim 3 , wherein the second visual element that indicates the second status of the electronic device in the engaged mode is one or more of a background image or a visual element that indicates the electronic device is locked.

5. The electronic device of claim 3 , wherein the radar-based awareness manager is further configured to, responsive to the user being authenticated, cause the electronic device to exit the engaged mode before entering the active mode.

6. The electronic device of claim 1 , wherein the authentication system is associated with a camera and a facial recognition module, and preparing the authentication system to perform the authentication process comprises:
causing the camera to enter a state in which the camera can capture an image; and
causing the facial recognition module to enter a state in which the facial recognition module can use the captured image to authenticate the user.

7. The electronic device of claim 1 , wherein causing the electronic device to enter the active mode further includes causing the display to present a third visual element that indicates a third status of the electronic device, the third visual element being at least one of: a background image, a wallpaper, a home screen, a screen with a visual element that indicates the electronic device is in an unlocked state, or a screen of an application that was most recently open prior to the electronic device entering a locked state.

8. The electronic device of claim 7 , wherein the radar-based awareness manager is further configured to:
determine, based on at least one of a first subset of the radar data or another subset of the radar data, whether another user is present within the recognition zone of the electronic device; and
determine, based at least in part on the determination of whether the other user is present within the recognition zone, the third visual element that indicates the third status of the electronic device.

9. The electronic device of claim 1 , wherein the trigger event comprises at least one of:
a change in user location;
a change in an orientation of the electronic device; or
an explicit touch input.

10. The electronic device of claim 1 , wherein the first subset of the radar data and the second subset of radar data are based on reflections from the user in the radar field at separate times.

11. The electronic device of claim 1 , wherein:
the electronic device includes machine-learning technology configured to generate a machine-learned model, the machine-learned model trained at least in part based on the user's history and behavior with the device; and
the radar-based awareness manager is further configured to:
detect the user action that is categorized as the indication of the intent of the user to interact with the electronic device via a library that is associated with the electronic device, the library including actions that are categorized as indicators of the user's intent to interact or not interact with the device; and
determine, using the machine-learned model, additions, removals, or modifications of actions included in the library that are categorized as indicators of the intent of the user to interact or not interact with the device.

12. A method implemented in an electronic device that includes a radar system and a radar-based awareness manager, the method comprising:
providing, by the radar system, a radar field;
sensing, by the radar system, reflections from a user in the radar field;
analyzing, by the radar system, the reflections from the user in the radar field;
providing, by the radar system and based on the analysis of the reflections, radar data;
maintaining, by the radar-based awareness manager, the electronic device in a dormant mode;
determining, based on a first subset of the radar data, a presence of the user within a recognition zone of the electronic device;
responsive to determining the presence of the user within the recognition zone, causing the electronic device to enter an aware mode in which the display presents a first visual element that indicates a first status of the electronic device;
detecting a user action, based on a second subset of the radar data, the user action categorized as an indication of an intent of the user to interact with the electronic device, the user action including one or more of:
the user turning toward or away from the electronic device without the user's face being detected;
the user moving toward or away from the electronic device without the user's face being detected;
the user leaning toward the electronic device without the user's face being detected; or
the user making a reach gesture toward the electronic device without a touch to the electronic device and without the user's face being detected;

responsive to detecting the user action that is categorized as the indication of th

Assignees

• Google Llc

Inventors

• Giusti Leonardo
• Poupyrev Ivan
• Sachidanandam Vignesh
• Prag Johan
• Barbello Brandon
• Kugler Tyler Reed
• Chandel Alok

Classifications

• G06F21/32 Primary

  using biometric data, e.g. fingerprints, iris scans or voiceprints · CPC title

• G01S7/412

  based on a comparison between measured values and known or stored values · CPC title

• G01S7/415

  Identification of targets based on measurements of movement associated with the target · CPC title

• G06F1/3231

  Monitoring the presence, absence or movement of users · CPC title

• G06F21/316

  by observing the pattern of computer usage, e.g. typical user behaviour · CPC title