Low-latency wireless audio streaming

Patent metadata

Field	Value
Publication number	US-2025175729-A1
Application number	US-202318523379-A
Country	US
Kind code	A1
Filing date	Nov 29, 2023
Priority date	Nov 29, 2023
Publication date	May 29, 2025
Grant date	—

Abstract

Streaming audio data wirelessly to a head-mounted display (HMD) with low latency and with reduced auditory artifacts is described. An example process includes determining one or more statistics indicative of a latency associated with audio data received wirelessly by the HMD and stored in a buffer of the HMD, and determining to adjust a size of the buffer based at least in part on the statistic(s). To decrease the size of the buffer, segments of the audio data may be replaced with a synthetic audio data segment to obtain modified audio data in the buffer. To increase the size of the buffer, a synthetic audio data segment(s) may be added to the audio data to obtain modified audio data in the buffer. Audio content can then be output via one or more speakers of the HMD based at least in part on the modified audio data.

First claim

What is claimed is:

1 . A method comprising:
determining, by a processor, one or more statistics indicative of a latency associated with audio data received wirelessly by a head-mounted display (HMD) and stored in a buffer of the HMD; determining, by the processor, to decrease a size of the buffer based at least in part on the one or more statistics; replacing, by the processor, segments of the audio data with a synthetic audio data segment to obtain modified audio data in the buffer; and causing, by the processor, audio content to be output via one or more speakers of the HMD based at least in part on the modified audio data.

2 . The method of claim 1 , further comprising creating, by the processor, the synthetic audio data segment based at least in part on a combination of non-sequential segments of the audio data.

3 . The method of claim 2 , wherein the replacing the segments comprises replacing the non-sequential segments and one or more intermediate segments of the audio data between the non-sequential segments with the synthetic audio data segment to obtain the modified audio data in the buffer.

4 . The method of claim 2 , wherein the creating comprises overlapping the non-sequential segments and cross-fading respective audio signal waveforms of the non-sequential segments.

5 . The method of claim 1 , further comprising:
determining, by the processor, one or more second statistics indicative of a latency associated with second audio data received wirelessly by the HMD and stored in the buffer; determining, by the processor, to increase the size of the buffer based at least in part on the one or more second statistics; adding, by the processor, a second synthetic audio data segment to the second audio data to obtain second modified audio data in the buffer; and causing, by the processor, second audio content to be output via the one or more speakers based at least in part on the second modified audio data.

6 . The method of claim 5 , further comprising creating, by the processor, the second synthetic audio data segment based at least in part on a combination of non-sequential segments of the second audio data.

7 . The method of claim 1 , further comprising:
determining, by the processor, based at least in part on the one or more statistics, that the latency is greater than or equal to a threshold latency, wherein the threshold latency is greater than a target latency, wherein the determining to decrease the size of the buffer is based at least in part on the latency being greater than or equal to the threshold latency.

8 . The method of claim 1 , further comprising:
determining, by the processor, one or more second statistics indicative of a latency associated with second audio data received wirelessly by the HMD and stored in the buffer; determining, by the processor, based at least in part on the one or more second statistics, that the latency associated with the second audio data is less than a threshold latency; and causing, by the processor, second audio content to be replayed via the one or more speakers for a predefined number of times based at least in part on at least a portion of the second audio data.

9 . The method of claim 8 , further comprising, after causing the second audio content to be replayed for the predefined number of times:
determining, by the processor, one or more third statistics indicative of a latency associated with remaining audio data stored in the buffer; determining, by the processor, based at least in part on the one or more third statistics, that the latency associated with the remaining audio data is less than the threshold latency; and causing, by the processor, remaining audio content to be output via the one or more speakers based at least in part on the remaining audio data while progressively decreasing a volume of the remaining audio content as the remaining audio content is being output.

10 . A head-mounted display (HMD) system comprising:
a HMD comprising one or more speakers; one or more processors; and memory storing computer-executable instructions that, when executed by the one or more processors, cause the HMD system to:
determine one or more statistics indicative of a latency associated with audio data received wirelessly by the HMD and stored in a buffer of the HMD;
determine to decrease a size of the buffer based at least in part on the one or more statistics;
replace segments of the audio data with a synthetic audio data segment to obtain modified audio data in the buffer; and
cause audio content to be output via the one or more speakers based at least in part on the modified audio data.

11 . The HMD system of claim 10 , wherein the computer-executable instructions, when executed by the one or more processors, further cause the HMD system to create the synthetic audio data segment based at least in part on a combination of non-sequential segments of the audio data.

12 . The HMD system of claim 11 , wherein replacing the segments comprises replacing the non-sequential segments and one or more intermediate segments of the audio data between the non-sequential segments with the synthetic audio data segment to obtain the modified audio data in the buffer.

13 . The HMD system of claim 11 , wherein creating the synthetic audio data segment comprises overlapping the non-sequential segments and cross-fading respective audio signal waveforms of the non-sequential segments.

14 . The HMD system of claim 10 , wherein the computer-executable instructions, when executed by the one or more processors, further cause the HMD system to:
determine one or more second statistics indicative of a latency associated with second audio data received wirelessly by the HMD and stored in the buffer; determine, based at least in part on the one or more second statistics, that the latency associated with the second audio data is less than a threshold latency; and cause second audio content to be replayed via the one or more speakers for a predefined number of times based at least in part on at least a portion of the second audio data.

15 . The HMD system of claim 14 , wherein the computer-executable instructions, when executed by the one or more processors, further cause the HMD system to, after causing the second audio content to be replayed for the predefined number of times:
determine one or more third statistics indicative of a latency associated with remaining audio data stored in the buffer; determine, based at least in part on the one or more third statistics, that the latency associated with the remaining audio data is less than the threshold latency; and cause remaining audio content to be output via the one or more speakers based at least in part on the remaining audio data while progressively decreasing a volume of the remaining audio content as the remaining audio content is being output.

16 . A method comprising:
determining, by a processor, one or more statistics indicative of a latency associated with audio data received wirelessly by a head-mounted display (HMD) and stored in a buffer of the HMD; determining, by the processor, to increase a size of the buffer based at least in part on the one or more statistics; adding, by the processor, a synthetic audio data segment to the audio data to obtain modified audio data in the buffer; and causing, by the processor, audio content to be output via one or more speakers of the HMD based at least in part on the modified audio data.

17 . The method of claim 16 , further comprising creating, by the processor, the synt

Assignees

• Valve Corp

Inventors

• Leinbaugh Jeffrey George

Classifications

• H04R1/1041 Primary

  Mechanical or electronic switches, or control elements (switches in general H01H) · CPC title

• H04R2430/01

  Aspects of volume control, not necessarily automatic, in sound systems · CPC title

• H04R2420/07

  Applications of wireless loudspeakers or wireless microphones · CPC title

• H04R1/1008

  Earpieces of the supra-aural or circum-aural type · CPC title

• H04R2499/15

  Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops · CPC title