Method, apparatus, and system for wireless writing tracking

Patent metadata

Field	Value
Publication number	US-11592913-B2
Application number	US-202117180763-A
Country	US
Kind code	B2
Filing date	Feb 20, 2021
Priority date	Jul 17, 2015
Publication date	Feb 28, 2023
Grant date	Feb 28, 2023

Abstract

Methods, apparatus and systems for wireless writing tracking are described. In one example, a described system comprises: a transmitter configured for transmitting a first wireless signal through a wireless multipath channel of a venue; a receiver configured for receiving a second wireless signal through the wireless multipath channel; and a processor. The second wireless signal comprises a reflection of the first wireless signal by a tip of a writing instrument in the venue. The processor is configured for: obtaining a time series of channel information (CI) of the wireless multipath channel based on the second wireless signal, wherein each CI comprises at least one of: a channel state information (CSI), channel impulse response (CIR), channel frequency response (CFR), or received signal strength index (RSSI); and tracking a movement of the tip of the writing instrument based on the time series of CI (TSCI).

First claim

We claim:

1. A system for wireless writing tracking, comprising:
a transmitter configured for transmitting a first wireless signal through a wireless multipath channel of a venue;
a receiver configured for receiving a second wireless signal through the wireless multipath channel, wherein
the second wireless signal comprises a reflection of the first wireless signal by a tip of a writing instrument in the venue,
both the first and second wireless signals are compliant to a wireless data communication standard,
a location of the tip of the writing instrument is determined based on a plurality of spatial bins in the venue,
each of the plurality of spatial bins is determined by: a respective direction and a respective distance range originating from the receiver, and
each direction is identified by a corresponding azimuth angle and a corresponding elevation angle; and

a processor configured for:
obtaining a time series of channel information (CI) of the wireless multipath channel based on the second wireless signal, wherein each CI comprises a channel impulse response (CIR),
generating a time series of background-subtracted CIRs based on a time series of background CIRs and the time series of CIRs, wherein the time series of background-subtracted CIRs are generated by, for each CIR:
synchronizing a respective background CIR with the CIR,
scaling the synchronized background CIR, and
computing a respective background-subtracted CIR by subtracting the scaled synchronized background CIR from the CIR,

for each of a plurality of distance ranges of interest and for each of the background-subtracted CIRs, computing a directional CIR by applying beamforming on the background-subtracted CIR, with respect to each of a plurality of directions originating from the receiver, wherein the plurality of distance ranges of interest and the plurality of directions form a plurality of spatial bins of interest,
for each time instance and for each spatial bin of interest, transforming the directional CIR into frequency domain with a moving time window to compute signal powers at different frequencies, including a zero frequency and a plurality of non-zero frequencies,
generating a first power matrix including power values for each time instance and for each spatial bin of interest, wherein each power value in the first power matrix is a maximum signal power among the plurality of non-zero frequencies, for a respective time instance and for a respective spatial bin of interest, and
tracking a movement of the tip of the writing instrument based on the time series of background-subtracted CIRs and the signal powers.

2. The system of claim 1 , wherein:
the movement of the tip is along a surface; and
any point on the surface has a zero elevation angle with respect to the receiver.

3. The system of claim 1 , wherein:
the transmitter is further configured for transmitting a third wireless signal through the wireless multipath channel of the venue, with no moving object in the venue;
the receiver is further configured for receiving a fourth wireless signal through the wireless multipath channel; and
the processor is further configured for obtaining the time series of background CIRs of the wireless multipath channel based on the fourth wireless signal.

4. The system of claim 3 , wherein:
the first wireless signal and the third wireless signal are transmitted using a plurality of transmit antennas of the transmitter;
the second wireless signal and the fourth wireless signal are received using a plurality of receive antennas of the receiver;
each background CIR is obtained by averaging over time; and
each CIR and the respective background CIR synchronized with the CIR are associated with a same respective one of the plurality of transmit antennas of the transmitter and associated with a same respective one of the plurality of receive antennas of the receiver.

5. The system of claim 1 , wherein the processor is further configured for:
comparing each power value in the first power matrix with a first threshold, to generate a corresponding element of a filtered first power matrix,
wherein each element of the filtered first power matrix is equal to:
a corresponding power value of the first power matrix, when the corresponding power value is greater than the first threshold, or
zero, when the corresponding power value is not greater than the first threshold.

6. The system of claim 5 , wherein the processor is further configured for:
for each time instance, determining a first set of spatial bins of interest including at least one spatial bin, wherein an element of the filtered first power matrix corresponding to the time instance and each of the at least one spatial bin is equal to a non-zero power value.

7. The system of claim 6 , wherein the processor is further configured for:
determining a presence of at least one moving target in the venue based on the first set of spatial bins of interest, wherein each of the at least one moving target has a location in the first set of spatial bins of interest for at least one time instance.

8. The system of claim 7 , wherein the processor is further configured for:
refining the locations of the at least one moving target based on interpolation.

9. The system of claim 7 , wherein the processor is further configured for:
for each of the at least one moving target,
determining that two locations of the moving target at two consecutive time instances are continuous when the two locations are closer than a distance threshold,
generating a continuous trajectory of the moving target based on continuous locations of the moving target,
computing a continuity score for the moving target to indicate a length of the continuous trajectory of the moving target, and
determining a candidate trajectory for the tip of the writing instrument based on the continuous trajectory, when the continuity score is greater than a predetermined threshold.

10. The system of claim 9 , wherein the two locations are closer than the distance threshold when elevation angles of the two locations are closer than a predetermined threshold.

11. The system of claim 9 , wherein the two locations are closer than the distance threshold when:
azimuth angles of the two locations are closer than a first predetermined threshold;
elevation angles of the two locations are closer than a second predetermined threshold; and
distance ranges of the two locations are closer than a third predetermined threshold.

12. The system of claim 9 , wherein the processor is further configured for:
when a single candidate trajectory is determined in total based on the at least one moving target,
determining a moving trajectory of the tip of the writing instrument based on the single candidate trajectory, and
identifying the tip of the writing instrument based on the moving target having the single candidate trajectory.

13. The system of claim 9 , wherein the processor is further configured for:
when a plurality of candidate trajectories are determined in total based on the at least one moving target,
determining an average elevation angle for all locations associated with each of the plurality of candidate trajectories,
determining a moving trajectory of the tip of the writing instrument based on a lowest elevation candidate trajectory associated with a lowest average elevation angle, among the plurality of candidate trajectories, and
identifying the tip of the writing instrument based on the moving target having the lowest elevation candidate trajectory.

14. The system of claim 13 , wherein the processor is further conf

Assignees

• Regani Sai Deepika
• Wu Chenshu
• Wang Beibei
• Wu Min
• Liu K J Ray
• Au Oscar Chi Lim
• Origin Wireless Inc

Inventors

• Regani Sai Deepika
• Wu Chenshu
• Wang Beibei
• Wu Min
• Liu K J Ray
• Au Oscar Chi-Lim

Classifications

• G06F3/0346 Primary

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F2203/0384

  Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices · CPC title

• G06F3/038 Primary

  Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry · CPC title

• G06F3/03545

  Pens or stylus · CPC title

• H04W4/029

  Location-based management or tracking services · CPC title