System and method for object localization in an indoor environment

Patent metadata

Field	Value
Publication number	US-12389200-B2
Application number	US-202217853397-A
Country	US
Kind code	B2
Filing date	Jun 29, 2022
Priority date	Dec 30, 2019
Publication date	Aug 12, 2025
Grant date	Aug 12, 2025

Abstract

A system for object localization in an indoor environment, such as a passenger cabin of a vehicle or an aircraft, includes a wireless communication infrastructure to facilitate wireless communication within the indoor environment via a wireless communication network and including at least one wireless access point to provide user devices access to the wireless communication network within the indoor environment. The wireless access point is adapted to acquire signal propagation data of wireless signals transmitted over the wireless communication network along multiple propagation paths. A computing element is configured to analyze the signal propagation data and extract localization data from the signal propagation data, the localization data specifying the position of objects located within the indoor environment.

First claim

The invention claimed is:

1. A system for object localization in an indoor environment, comprising:
a wireless communication infrastructure configured to facilitate wireless communication within the indoor environment via a wireless communication network and comprising at least one wireless access point adapted to provide user devices access to the wireless communication network within the indoor environment, wherein the wireless access point is configured to acquire signal propagation data of wireless signals transmitted over the wireless communication network along multiple propagation paths; and
a computing element configured to execute an algorithm to analyze the signal propagation data and extract localization data from the signal propagation data, the localization data specifying a position of objects located within the indoor environment, wherein the algorithm is based on test localization data corresponding to a predetermined test arrangement of test objects within the indoor environment;
wherein the algorithm is trained to extract localization data from signal propagation data using training data received from an external positioning system; and
wherein the algorithm is a machine-learning algorithm executed on the signal propagation data, wherein the machine-learning algorithm is configured to extract the position data based on training data being generated using at least the predetermined test object arrangement within the indoor environment.

2. The system according to claim 1 , wherein the wireless communication infrastructure comprises a plurality of wireless access points, wherein the signal propagation data comprise correlation data of the wireless access points.

3. The system according to claim 1 , wherein the signal propagation data comprise channel state information, CSI.

4. The system according to claim 1 , wherein the signal propagation data comprise at least one of spatial, frequency and temporal variations of the wireless signals within the indoor environment.

5. The system according to claim 1 , wherein each wireless access point is a standard commercial wireless device operating according to a IEEE 802.11 standard.

6. The system according to claim 1 , wherein the machine-learning algorithm is configured to extract locations of static objects within the indoor environment.

7. The system according to claim 1 , wherein the signal propagation data are provided as raw data on a physical layer of the wireless communication infrastructure.

8. The system according to claim 7 , wherein the system comprises:
a set of wireless access points; and
a data aggregation unit in wireless communication with the set of wireless access points and configured to collect the signal propagation data of the set of wireless access points and transfer it to the computing element, wherein each wireless access point in the set of wireless access points is configured to preprocess the raw data generated at the respective wireless access point and transfer it to the data aggregation unit.

9. The system of claim 8 , wherein pre-processing the raw data generated at the respective wireless access point includes a processing circuit on the wireless access point being configured to:
normalize the raw data according to a normalization process and extract relevant features from the normalized raw data; and
wherein the extracted relevant features are forwarded to the data aggregation unit to aggregate the extracted relevant features from the set of wireless access points.

10. The system of claim 7 , wherein the raw data on the physical layer of the wireless communication infrastructure is received in the form of IQ-samples.

11. The system according to claim 1 , wherein the indoor environment is a passenger cabin of a vehicle.

12. The system according to claim 11 , wherein the vehicle is an aircraft.

13. The system of claim 1 , wherein the external positioning system includes a computer vision based external positioning system or a positioning system that uses accelerometers or gyroscopes.

14. An aircraft having a passenger cabin equipped with a system according to claim 1 .

15. A method for object localization in an indoor environment, or in a passenger cabin of a vehicle or an aircraft, the method comprising:
providing a system for object localization in the indoor environment or the passenger cabin, the system comprising:
a wireless communication infrastructure configured to facilitate wireless communication within the indoor environment or the passenger cabin via a wireless communication network and comprising at least one wireless access point adapted to provide user devices access to the wireless communication network within the indoor environment or the passenger cabin, wherein the wireless access point is configured to acquire signal propagation data of wireless signals transmitted over the wireless communication network along multiple propagation paths; and
a computing element configured to execute an algorithm to analyze the signal propagation data and extract localization data from the signal propagation data, the localization data specifying a position of objects located within the indoor environment or the passenger cabin, wherein the algorithm is based on test localization data corresponding to a predetermined test arrangement of test objects within the indoor environment or the passenger cabin;
wherein the algorithm is trained to extract localization data from signal propagation data using training data received from an external positioning system; and
wherein the algorithm is a machine-learning algorithm executed on the signal propagation data, wherein the machine-learning algorithm is configured to extract the position data based on training data being generated using at least the predetermined test object arrangement within the indoor environment or the passenger cabin;

acquiring, using the system, signal propagation data of wireless signals transmitted over the wireless communication network along multiple propagation paths; and
analyzing, using the system, the signal propagation data and extracting localization data from the signal propagation data, the localization data specifying the position of objects located within the indoor environment or within the passenger cabin.

16. The method according to claim 15 , wherein the machine-learning algorithm extracts locations of static objects within the passenger cabin; and
wherein the training data is further generated using an object position measurement system.

Assignees

• Airbus Sas

Inventors

• Mendes Paulo
• Multerer Thomas
• Geyer Fabien

Classifications

• H04W4/33

  for indoor environments, e.g. buildings · CPC title

• H04L67/12

  specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks · CPC title

• G06N20/00

  Machine learning · CPC title

• H04W84/12

  WLAN [Wireless Local Area Networks] · CPC title

• H04W88/08

  Access point devices · CPC title