System, method and computer-accessible medium for real time imaging using a portable device

Patent metadata

Field	Value
Publication number	US-12320910-B2
Application number	US-202117552200-A
Country	US
Kind code	B2
Filing date	Dec 15, 2021
Priority date	May 24, 2018
Publication date	Jun 3, 2025
Grant date	Jun 3, 2025

Abstract

Exemplary system, method and computer-accessible medium for selecting at least one location of (i) at least one receiver or transceiver or (ii) at least one transmitter or transceiver can be provided. For example, it is possible to facilitate a receipt, from the at least one transmitter or transceiver, of a plurality of signals by the receiver(s) or transceiver(s). Each of the signals has a multipath component. Then, it is possible to determine time of flight (ToF) information and angle of arrival (AoA) information of the multipath components present in the signals. Further, it is possible to determine one or more possible locations of (i) the receiver(s) or transceiver(s) or (ii) the transmitter(s) or transceiver(s) based on the ToF information, the AoA information, and a model of physical surroundings. The location(s) of (i) the receiver(s) or transceiver(s), or (ii) the transmitter(s) or transceiver(s) can be selected based on the one or more possible locations.

First claim

What is claimed is:

1. A computer-based method for generating an estimated location of a portable device (PD) in an environment that includes a base station (BS), the PD including a PD antenna array connected to a PD radio frequency (RF) transmitter and a PD RF receiver, and the BS including a BS antenna array connected to a BS RF transmitter and a BS RF receiver, the method comprising computer steps of:
building a three-dimensional (3D) map of physical surroundings of the portable device, by steps including:
transmitting, by the PD RF transmitter via the PD antenna array, a plurality of RF radar beams, and receiving, via the PD RF receiver from the antenna array, reflections of the transmitted RF radar beams from RF radar reflective surfaces within an RF radar range of the PD, wherein
the transmitting the plurality of RF radar beams has an RF radar transmission configuration resulting in reflections of the transmitted RF radar beams including reflections from an RF reflective surface that, from the PD location, is a hidden reflective surface not visible to a user of the PD,
the RF radar transmission configuration includes the transmitted RF radar beams comprising radio frequencies within a band extending from 6 GHz to 1 THz,

generating, by an RF radar 3D imaging processing of the received RF radar reflections, at least a portion of the 3D map of physical surroundings of the PD, the portion including a 3D map feature corresponding to the hidden reflective surface,
generating the 3D map of physical surroundings of the PD, based at least in part on a repeating of the transmitting the plurality of RF radar beams, the receiving reflections of the transmitted RF radar beams, and the generating the at least a portion of the 3D map storing, and
storing the 3D map of physical surroundings of the PD in a computer-accessible storage medium or storage device; and

performing a PD transmit mode generating of the estimated location of the PD, wherein the PD transmit mode generating comprises computer steps of:
facilitating a receiving by the BS of at least two multipath components of an RF signal transmitted by the PD transmitter,
determining, based at least in part on the receiving by the BS, respective time of flight (ToF) information and angle of arrival (AoA) information of the at least two multipath components,
determining, by a map-assisted positioning with angle and time (MAP-AT) computer processing, one or more candidate locations of the PD, based at least in part on the ToF information, the AoA information, and the generated 3D map of physical surroundings, and
selecting the estimated location of the portable device, based on the one or more candidate locations.

2. The method of claim 1 , further comprising:
prior to performing the PD transmit mode generating the estimated location of the PD, updating the 3D map of the physical surroundings using any among or any combination of two or more among a:
one or more video recordings of at least a portion of the physical surroundings, obtained using a visible-light camera,
one or more pictures of the environment obtained using the visible-light camera,
one or more light detection and ranging (LIDAR) techniques,
a computer-aided design (CAD) software application,
a hand drawing, and/or
floorplans or blueprints of a building.

3. The method of claim 1 , wherein the determining the one or more candidate locations further comprises a comparing at least one candidate location with the ToF information and the AoA information.

4. The method of claim 1 , further comprising facilitating a cooperative localization as a function of the determination of at least one candidate location.

5. The method of claim 1 , wherein the determining the one or more candidate locations is performed by a computer arrangement that comprises (i) a mobile computer system provided at the PD, (ii) a fixed computer system provided at the base station, or (iii) a cloud computing system, or any combination of any two or more among (i), (ii), and (iii).

6. The method of claim 1 , further comprising estimating a velocity or an acceleration of the portable device, by steps comprising applying a Kalman filter, and/or an extended Kalman filter, and/or a particle filter.

7. The method of claim 1 , wherein the selecting the estimated position of the portable device comprises:
grouping the one or more candidate locations, into two or candidate location clusters, wherein the grouping is arranged such that, for each candidate location cluster, all candidate locations within the cluster are spaced not more than a maximum distance from one another;
selecting among the candidate location clusters the candidate location cluster containing the relative maximum number of the candidate locations;
computing a centroid of the candidate locations within the candidate location cluster containing the relative maximum number of candidate locations; and
setting the estimated position of the PD based on a result of the computing the centroid.

8. The method of claim 1 , further comprising determining a carrier phase of at least one of the at least two multipath components received by the BS RF receiver, wherein the determining the one or more candidate locations is further based on the determined carrier phase.

9. The method of claim 1 , further comprising, using one or more sensors onboard the PD:
determining an orientation of the PD, and/or
determining z-co-ordinates of the PD.

10. The method of claim 9 , wherein the one or more sensors onboard the PD used for determining the orientation of the PD comprise a gyroscope and/or an accelerometer.

11. The method of claim 9 , wherein determining z-coordinates of the PD is based at least in part on measurements from an onboard barometer.

12. The method of claim 1 , wherein the selecting the at least one location is based on a lookup table which includes the AoA information and the ToF information measured at a location calibrated in a surveyed environment.

13. The method of claim 1 , wherein at least one of the RF radar beams comprises (i) a pulsed signal, or (ii) a signal that discretized over a plurality of individual frequencies or (ii) and (ii).

14. The method of claim 1 , wherein the PD antenna array is an adaptive antenna array and the transmitting the plurality of RF radar beams includes a sequential scanning, via the adaptive antenna array, in azimuth and elevation.

15. The method of claim 1 , wherein the RF radar 3D imaging processing includes a holographic 3D imaging processing of the received RF radar reflections.

16. A non-transitory computer-accessible medium having stored thereon computer-executable instructions for selecting at least one location of a portable device (PD) in an environment that includes a base station (BS), the PD including a PD antenna array that is connected to a PD radio frequency (RF) transmitter and to a PD RF receiver, and the BS including BS antenna array that is connected to a BS RF transmitter and to a BS RF receiver, wherein, when a computer arrangement executes the instructions, the computer arrangement is configured to perform procedures comprising:
building a three-dimensional (3D) map of physical surroundings of the portable device, the building of the 3D map including:
causing a transmitting by the PD RF transmitter via the PD antenna array, of a plurality of RF radar beams, and receiving, via the PD RF receiver from the antenna array, reflections of the transmitted RF radar beams from RF radar reflective surfaces within an RF radar range of the PD,
wherein the transmitting the plurality of RF rada

Assignees

• Univ New York

Inventors

• Rappaport Theodore S
• Kanhere Ojas

Classifications

• G01C19/00

  Gyroscopes; Turn-sensitive devices using vibrating masses; Turn-sensitive devices without moving masses; Measuring angular rate using gyroscopic effects · CPC title

• G01P15/00

  Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration · CPC title

• G01S5/0294

  Trajectory determination or predictive filtering, e.g. target tracking or Kalman filtering · CPC title

• G01S5/0221

  Receivers · CPC title

• G01S2013/464

  using only the non-line-of-sight signal(s), e.g. to enable survey of scene 'behind' the target only the indirect signal is evaluated · CPC title