Positioning with radio and video-based channel state information (vcsi) fusion

Patent metadata

Field	Value
Publication number	US-2025193831-A1
Application number	US-202318847210-A
Country	US
Kind code	A1
Filing date	Feb 17, 2023
Priority date	May 4, 2022
Publication date	Jun 12, 2025
Grant date	—

Abstract

A user equipment (UE) performs combined radio-based positioning techniques and video-based channel state information (vCSI) based positioning techniques. An example method performed by a first UE includes receiving a first request for visual positioning of the first UE, the visual positioning based at least in part on visual signals captured by a visual sensor of the first UE and on one or more radio positioning signals, capturing visual data based on the relative direction, determining video-based channel state information (vCSI) based on the captured visual data, and transmitting the vCSI to a network entity associated with the first UE.

First claim

1 . A method performed by a first user equipment (UE) for supporting positioning of the UE in a wireless network, comprising:
receiving a first request for visual positioning of the first UE, the visual positioning based at least in part on visual signals captured by a visual sensor of the first UE and on one or more radio positioning signals; capturing visual data based on the first request; determining video-based channel state information (vCSI) based on the captured visual data; and transmitting the vCSI to a network entity associated with the first UE.

2 . The method of claim 0 , wherein the visual data is associated with one or more wireless devices within visual range of the first UE.

3 . The method of claim 2 , wherein the one or more radio positioning signals are received by the first UE from one of the one or more wireless devices within visual range of the first UE.

4 . The method of claim 2 , wherein the first request includes a distance associated with at least one of the one or more wireless devices.

5 . The method of claim 2 , wherein the first request indicates a relative direction for pointing the visual sensor of the first UE.

6 . The method of claim 5 , further comprising:
receiving, prior to receiving the first request, a sidelink (SL) positioning request requesting the first UE to determine positioning information associated with the relative direction; receiving the one or more radio positioning signals from one of the one or more wireless devices; and transmitting a response to the SL positioning request associated with the relative direction based at least in part on the one or more radio positioning signals.

7 . The method of claim 2 , wherein the vCSI is associated with a presence of at least one of the one or more wireless devices, wherein the method further comprises:
receiving a request from the network entity requesting radio positioning of one of the one or more wireless devices, the request for radio positioning based at least in part on the vCSI; receiving the one or more radio positioning signals from the at least one of the one or more wireless devices; and transmitting a response to the network entity based at least in part on the one or more radio positioning signals.

8 . The method of claim 1 , wherein the first request indicates at least a threshold distance, wherein the vCSI is only determined for objects within the threshold distance of the first UE.

9 . The method of claim 0 , wherein the vCSI is determined based on the captured visual data using a trained machine learning model.

10 . The method of claim 1 , wherein the vCSI is based at least in part on one or more tags, the one or more tags indicating one or more zone properties associated with the visual data.

11 . The method of claim 1 , wherein the first request further indicates a category of object of interest, wherein the vCSI is determined based at least in part on the category of object of interest.

12 . The method of claim 1 , further comprising, prior to receiving the first request:
receiving a request for radio-based positioning of the first UE; receiving the one or more radio positioning signals based on the request for radio-based positioning; determining one or more radio positioning measurements based on the one or more radio positioning signals; and transmitting one or more signals to the network entity indicating the one or more radio positioning measurements, wherein the first request is based at least in part on the one or more radio positioning measurements.

13 . The method of claim 12 , further comprising receiving one or more signals from the network entity indicating one or more points of interest determined to be proximate to the first UE based on the one or more radio positioning measurements, wherein the visual data is based at least in part on the one or more points of interest.

14 . The method of claim 1 , further comprising, prior to receiving the first request, reporting one or more capabilities to the network entity associated with determining the vCSI, the one or more capabilities comprising one or more of a number of cameras coupled to the first UE, one or more visual zoom capabilities associated with the first UE, one or more ranges of motion associated with capturing the visual data, one or more visual resolutions associated with capturing the visual data.

15 . A first user equipment (UE) configured to transmit location information messages in a wireless network, comprising:
a wireless transceiver configured to wirelessly communicate with entities in the wireless network; at least one memory; and at least one processor coupled to the wireless transceiver and the at least one memory, wherein the at least one processor is configured to:
receive a first request for visual positioning of the first UE, the visual positioning based at least in part on visual signals captured by a visual sensor of the first UE and on one or more radio positioning signals;
capture visual data based on the first request;
determine video-based channel state information (vCSI) based on the captured visual data; and
transmit the vCSI to a network entity associated with the first UE.

16 . The first UE of claim 15 , wherein the visual data is associated with one or more wireless devices within visual range of the first UE.

17 . The first UE of claim 16 , wherein the one or more radio positioning signals are received by the first UE from one of the one or more wireless devices within visual range of the first UE.

18 . The first UE of claim 16 , wherein the first request includes a distance associated with at least one of the one or more wireless devices.

19 . The first UE of claim 16 , wherein the first request indicates a relative direction for pointing the visual sensor of the first UE.

20 . The first UE of claim 19 , wherein the at least one processor is further configured to:
receive, prior to receiving the first request a sidelink (SL) positioning request requesting the first UE to determine positioning information associated with the relative direction; receive the one or more radio positioning signals from one of the one or more wireless devices; and transmit a response to the SL positioning request associated with the relative direction based at least in part on the one or more radio positioning signals.

21 . The first UE of claim 16 , wherein the vCSI is associated with a presence of at least one of the one or more wireless devices, wherein the at least one processor is further configured to:
receive a request from the network entity requesting radio positioning of one of the one or more wireless devices, the request for radio positioning based at least in part on the vCSI; receive the one or more radio positioning signals from the at least one of the one or more wireless devices; and transmit a response to the network entity based at least in part on the one or more radio positioning signals.

22 . The first UE of claim 15 , wherein the vCSI is determined based on the captured visual data using a trained machine learning model.

23 . The first UE of claim 15 , wherein the at least one processor is further configured to, prior to receiving the first request:
receive a request for radio-based positioning of the first UE; receive the one or more radio positioning signals based on the request for radio-based positioning; determine one or more radio positioning measurements based on the

Assignees

• Qualcomm Inc

Inventors

• Manolakos Alexandros
• Zhang Duo
• Huang Fei
• Zhu Xipeng
• Zou Wei

Classifications

• H04W92/18

  between terminal devices · CPC title

• H04W8/22

  Processing or transfer of terminal data, e.g. status or physical capabilities · CPC title

• H04B7/0626

  Channel coefficients, e.g. channel state information [CSI] · CPC title

• H04W4/023

  using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds · CPC title

• H04W4/021

  Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences · CPC title