Systems and methods for detecting motion in a zone

Patent metadata

Field	Value
Publication number	US-11862000-B2
Application number	US-202217649742-A
Country	US
Kind code	B2
Filing date	Feb 2, 2022
Priority date	Feb 2, 2022
Publication date	Jan 2, 2024
Grant date	Jan 2, 2024

Abstract

A device may receive radio frequency (RF) transmissions from access points provided in a zone, and may calculate channel state information (CSI) for the access points based on the RF transmissions. The device may identify CSI phases that satisfy a phase threshold to eliminate surrounding movement in the zone and to focus on an entry location of the zone, and may perform a short-time Fourier transform of the CSI phases to generate a frequency versus time graph. The device may perform a spectrogram analysis of the frequency versus time graph or may process the frequency versus time graph, with a machine learning model, to determine a quantity of people in the zone and a start and stop times associated with entries and exits of the people to and from the zone. The device may perform actions based on the quantity of people and the start and stop times.

First claim

What is claimed is:

1. A method, comprising:
receiving, by a device, radio frequency transmissions from one or more access points provided in a zone;
calculating, by the device and based on determining that the device has sufficient resources to process channel state information associated with the one or more access points and based on the radio frequency transmissions, the channel state information;
identifying, by the device, channel state information phases that satisfy a phase threshold to eliminate surrounding movement in the zone and to focus on an entry location of the zone;
performing, by the device, a short-time Fourier transform of the channel state information phases to generate a frequency versus time graph; selectively:
performing, by the device, a spectrogram analysis of the frequency versus time graph to determine a quantity of people in the zone and start and stop times associated with entries and exits of the people to and from the zone; and
processing, by the device, the frequency versus time graph, with a model, to determine the quantity of people in the zone and the start and stop times associated with entries and exits of the people to and from the zone; and
performing, by the device, one or more actions based on the quantity of people and the start and stop times.

2. The method of claim 1 , wherein the device includes one or more of:
a network device of a network associated with the zone,
a connected device configured to communicate with the network device, or
a cloud-based device configured to communicate with the network device.

3. The method of claim 1 , further comprising:
calculating locations of the one or more access points in the zone based on the channel state information,
wherein identifying the channel state information phases comprises:
identifying the channel state information phases based on the locations of the one or more access points.

4. The method of claim 3 , wherein calculating the locations of the one or more access points comprises:
determining times of flight of the radio frequency transmissions based on the channel state information;
determining angles of arrival of the radio frequency transmissions based on the channel state information; and
calculating the locations of the one or more access points based on the times of flight and the angles of arrival.

5. The method of claim 1 , further comprising:
determining whether a person is entering or exiting the zone over a time period based on phase differences included in the channel state information.

6. The method of claim 5 , wherein determining whether the person is entering or exiting the zone over the time period comprises:
determining, at a first time, a first phase associated with a first access point of the one or more access points;
determining, at the first time, a second phase associated with a second access point of the one or more access points;
calculating a first phase difference based on the first phase and the second phase;
determining, at a second time, a third phase associated with the first access point;
determining, at the second time, a fourth phase associated with the second access point;
calculating a second phase difference based on the third phase and the fourth phase; and
determining whether the person is entering or exiting the zone based on the first phase difference and the second phase difference.

7. The method of claim 1 , wherein the phase threshold is based on locations of the one or more access points.

8. A device, comprising:
one or more processors configured to: receive radio frequency transmissions from one or more access points provided in a zone;
calculate channel state information for the one or more access points based on the radio frequency transmissions and based on determining that the device has sufficient resources to process the channel state information;
identify channel state information phases that satisfy a phase threshold to eliminate surrounding movement in the zone and to focus on an entry location of the zone,
wherein the phase threshold is based on locations of the one or more access points;
perform a short-time Fourier transform of the channel state information phases to generate a frequency versus time graph; selectively:
perform a spectrogram analysis of the frequency versus time graph to
determine a quantity of people in the zone and start and stop times
associated with entries and exits of the people to and from the zone; and
process the frequency versus time graph, with a machine learning model, to determine the quantity of people in the zone and the start and stop times associated with entries and exits of the people to and from the zone; and

perform one or more actions based on the quantity of people and the start and stop times.

9. The device of claim 8 , wherein the one or more processors, to perform the spectrogram analysis of the frequency versus time graph to determine the quantity of people in the zone and the start and stop times, are configured to:
calculate an exponential moving average based on the frequency versus time graph;
determine that people are entering or exiting the zone based on the exponential moving average satisfying a noise threshold;
calculate the start and stop times and velocities of the people based on the exponential moving average;
calculate motion energies of the people based on normalized fast Fourier transform coefficients; and
determine the quantity of the people based on the velocities of the people and the motion energies.

10. The device of claim 8 , wherein the machine learning model includes one of a convolutional neural network model or a deep learning single shot detector model.

11. The device of claim 8 , wherein the one or more processors are further configured to:
train the machine learning model with a plurality of frequency versus time graphs associated with different types of zones, prior to processing the frequency versus time graph with the machine learning model.

12. The device of claim 8 , wherein the one or more processors, to perform the one or more actions, are configured to one or more of:
provide the quantity of people and the start and stop times for display;
determine that the quantity satisfies a capacity threshold and cause additional people to be prevented from entering the zone;
cause crowd control or foot traffic control to be implemented in the zone based on the quantity and the start and stop times;
cause retail displays in the zone to be modified based on the quantity and the start and stop times; or
retrain the machine learning model based on the quantity and the start and stop times.

13. The device of claim 8 , wherein the one or more processors, to perform the one or more actions, are configured to:
determine that an intruder has entered the zone; and
contact a law enforcement agency about the intruder.

14. The device of claim 8 , wherein the one or more processors, to perform the one or more actions, are configured to:
determine that the quantity satisfies a rental threshold quantity; and
generate additional charges for rental of the zone based on determining that the quantity satisfies the rental threshold quantity.

15. A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising:
one or more instructions that, when executed by one or more processors of a device, cause the device to:
receive radio frequency transmissions from one or more access points provided in a zone;
calculate channel state information for the one or more access points based on the radio

Assignees

• Verizon Patent & Licensing Inc

Inventors

• Mahurkar Sagar Deepak
• Pericharla Anjaneya
• Ahuja Sanjay
• Kalidindi Srirama R

Classifications

• G08B13/19623 Primary

  Arrangements allowing camera linear motion, e.g. camera moving along a rail cable or track · CPC title

• G08B13/184

  using radiation reflectors · CPC title

• G08B13/19656

  Network used to communicate with a camera, e.g. WAN, LAN, Internet · CPC title

• G08B13/181 Primary

  using active radiation detection systems · CPC title

• G08B13/24

  by interference with electromagnetic field distribution · CPC title