Contactless sleep detection and disturbance attribution for multiple users

Patent metadata

Field	Value
Publication number	US-12070324-B2
Application number	US-202016990714-A
Country	US
Kind code	B2
Filing date	Aug 11, 2020
Priority date	Aug 11, 2020
Publication date	Aug 27, 2024
Grant date	Aug 27, 2024

Abstract

Various devices, systems and methods for performing contactless monitoring of the sleep of multiple users over a same time period are presented herein. Clustering may be performed based on data received from a radar sensor. Based on the clustering performed on the data received from the radar sensor, a determination may be made that two users are present within the region. In response to determining that two users are present, a midpoint location may be calculated between the clusters. A first portion of the data may be mapped to a first user and a second portion of the data may be mapped to a second user based on the calculated midpoint. Separate sleep analyses may be performed for the first user and the second user.

First claim

What is claimed is:

1. A contactless sleep analysis device for monitoring multiple users, the contactless sleep analysis device comprising:
a housing;
a radar sensor, housed by the housing, that uses frequency-modulated continuous wave (FMCW) radar;
a processing system, comprising one or more processors, housed by the housing, in communication with the radar sensor, wherein the processing system is configured to:
receive data from the radar sensor;
process the data from the radar sensor, comprising applying a movement filter to remove data indicative of static objects, such that the processed data comprises a first dimension representative of distance, a second dimension representative of frequency, and a third dimension representative of magnitude;
perform clustering on the processed data, wherein the clustered data indicates a first cluster and a second cluster;
based on the clustering performed on the processed data received from the radar sensor, determine that two users are present;
in response to determining that two users are present, calculate a midpoint location between the first cluster and the second cluster;
map a first portion of the processed data from the radar sensor to a first user based on the calculated midpoint;
map a second portion of the processed data from the radar sensor to a second user based on the calculated midpoint;
perform separate sleep analyses over a period of time on the first portion of the processed data for the first user and the second portion of the processed data for the second user; and
output sleep information for the first user based on the first portion of the processed data for over the period of time and sleep information for the second user based on the second portion of the processed data for over the period of time.

2. The contactless sleep analysis device for monitoring multiple users of claim 1 , wherein the processing system is further configured to:
receive additional data from the radar sensor;
after determining that two users are present and calculating the midpoint location, perform clustering on the additional data received from the radar sensor, wherein the clustered additional data indicates a single cluster; and
based on the clustering performed on the additional data received from the radar sensor, determine that only a single user is present.

3. The contactless sleep analysis device for monitoring multiple users of claim 2 , wherein the processing system is further configured to:
determine which user of the first user and the second user is the single user based on a location of the single cluster in relation to the calculated midpoint.

4. The contactless sleep analysis device for monitoring multiple users of claim 1 , wherein the processing system is further configured to:
convert the data received from the radar sensor to fewer dimensions, wherein the data received from the radar sensor is multi-dimensional, wherein the clustering performed on the data received from the radar sensor is performed on the converted data.

5. The contactless sleep analysis device for monitoring multiple users of claim 1 , wherein the processing system being configured to perform separate sleep analyses over the period of time on the first portion of the data for the first user and the second portion of the data for the second user comprises the processing system being configured to:
determine that the first user has entered a sleep state at a first time; and
determine that the second user has entered the sleep state at a second time.

6. The contactless sleep analysis device for monitoring multiple users of claim 1 , wherein the radar sensor uses low-power frequency-modulated continuous wave (FMCW) radar.

7. The contactless sleep analysis device for monitoring multiple users of claim 1 , further comprising a first environmental sensor housed by the housing.

8. The contactless sleep analysis device for monitoring multiple users of claim 7 , wherein the processing system is further configured to:
determine a transition time at which the first user transitions from a sleep state to an awake state;
identify an environmental event, based on data received from the first environmental sensor, occurring within a time period of the transition time; and
attribute the first user waking to the environmental event based on the environmental event occurring within the time period of the transition time.

9. The contactless sleep analysis device for monitoring multiple users of claim 8 , wherein the processing system is further configured to output an indication of the attributed environmental event mapped to the first user.

10. The contactless sleep analysis device for monitoring multiple users of claim 9 , wherein:
the first environmental sensor is an ambient light sensor; and
the processing system being configured to identify the environmental event comprises the processing system being configured to determine that an ambient light level has increased by at least a threshold amount.

11. The contactless sleep analysis device for monitoring multiple users of claim 9 , wherein:
the first environmental sensor is a microphone; and
the processing system being configured to identify the environmental event comprises the processing system being configured to determine that a sound has been detected.

12. The contactless sleep analysis device for monitoring multiple users of claim 1 , further comprising:
a wireless network interface housed by the housing;
a display screen housed by the housing;
a microphone housed by the housing;
a speaker housed by the housing; and
a stand incorporated as part of the housing, wherein:
the processing system is in communication with the wireless network interface, the display screen, the microphone, and the speaker.

13. The contactless sleep analysis device for monitoring multiple users of claim 12 , wherein the processing system is further configured to:
receive a voice-based query via the microphone;
output information based on the voice-based query via the wireless network interface;
receive data from a cloud-based server system via the wireless network interface; and
output a response to the voice-based query via the speaker.

14. A method for contactless sleep monitoring of multiple users, the method comprising:
receiving a radar data stream based on radio waves emitted into a region;
processing the radar data stream, comprising applying a movement filter to remove data indicative of static objects, such that the processed data comprises a first dimension representative of distance, a second dimension representative of frequency, and a third dimension representative of magnitude;
performing clustering on the processed radar data stream, wherein the clustered data indicates a first cluster and a second cluster;
based on the clustering performed on the radar data stream, determining that two users are present within the region;
in response to determining that two users are present, calculating a midpoint location between the first cluster and the second cluster;
mapping a first portion of the processed radar data stream to a first user based on the calculated midpoint;
mapping a second portion of the processed radar data stream to a second user based on the calculated midpoint;
performing separate sleep analyses over a period of time on the first portion of the processed radar data stream for the first user and the second portion of the processed radar data stream for the second user; and
outputting sleep information for the first user based on the first portion of the processed radar data stream for over the period

Assignees

• Google Llc

Inventors

• Shin Dongeek
• Dixon Michael
• Goldenson Andrew William

Classifications

• G06F18/23

  Clustering techniques · CPC title

• G01S13/88

  Radar or analogous systems specially adapted for specific applications (electromagnetic prospecting or detecting of objects, e.g. near-field detection, G01V3/00) · CPC title

• G01S13/32

  using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated · CPC title

• A61B5/11

  Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb {(A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721)} · CPC title

• G01S13/282

  using a frequency modulated carrier wave (G01S13/286 takes precedence) · CPC title