Audio spatialization

Patent metadata

Field	Value
Publication number	US-11218829-B2
Application number	US-201816132580-A
Country	US
Kind code	B2
Filing date	Sep 17, 2018
Priority date	Sep 27, 2012
Publication date	Jan 4, 2022
Grant date	Jan 4, 2022

Abstract

A camera input can be used by the computer to support audio spatialization or to improve audio spatialization of an application that already supports it. A computer system may to support audio spatialization, for example, by modifying the relative latency or relative amplitude of the rendered audio packets. If a sound is intended, for example, to be located on the left side of the user, then the audio channel that is rendered on the headset speaker located on the user's left ear may have a somewhat decreased latency and increased amplitude compared to the other audio channel.

First claim

What is claimed is:

1. One or more storage devices comprising a plurality of instructions that, when executed by one or more processors of a compute device, causes the one or more processors of the compute device to:
identify a change in at least one of a position or an orientation of a head of a user of the compute device, the compute device to be communicatively coupled to earphones worn by the user, the earphones to move with movement of the head of the user;
access audio data for a first channel and audio data for a second channel;
adjust, in response to the change in the at least one of the position or the orientation of the head of the user, the audio data for the first channel and the audio data for the second channel, wherein the adjusted audio data for the first channel is different from the adjusted audio data for the second channel to create an effect of three dimensional sound; and
cause transmission of audio signals based on the adjusted audio data for the first channel and the adjusted audio data for the second channel to the earphones.

2. The one or more storage devices of claim 1 , wherein the plurality of instructions causes the one or more processors of the compute device to:
obtain video of the user from a camera device of the compute device;
analyze the video; and
determine, based on the analysis of the video, the change in the at least one of the position or the orientation of the head of the user.

3. The one or more storage devices of claim 1 , wherein the change in the at least one of the position or the orientation of the head of the user of the compute device is based on one or more parameters indicative of the at least one of the position or the orientation of the head of the user of the compute device relative to a default position of the user.

4. The one or more storage devices of claim 1 , wherein the plurality of instructions causes the one or more processors of the compute device to:
access audio data for at least one additional channel, and
down mix, based on the change in the at least one of the position or the orientation of the head of the user, the audio data for the first channel, the audio data for the second channel, and the audio data for the at least one additional channel in order to adjust the audio data for the first channel and the audio data for the second channel.

5. The one or more storage devices of claim 1 , wherein the plurality of instructions further causes the one or more processors of the compute device to modify at least one of a latency or an amplitude of the audio data for the second channel relative to the audio data for the first channel in order to adjust the audio data for the first channel and the audio data for the second channel.

6. The one or more storage devices of claim 1 , wherein the earphones are headphones.

7. The one or more storage devices of claim 1 , wherein the plurality of instructions causes the one or more processors of the compute device to obtain the audio data for the first channel and the audio data for the second channel from a remote content delivery device.

8. The one or more storage devices of claim 1 , wherein the audio data for the first channel and the audio data for the second channel correspond to video data, and wherein the plurality of instructions causes the one or more processors of the compute device to cause the transmission of the audio signals to the earphones contemporaneously with transmission of a video signal based on the video data to a display.

9. The one or more storage devices of claim 1 , wherein the audio data for the first channel and the audio data for the second channel correspond to media data, wherein the media data includes gaming information, and wherein the plurality of instructions causes the one or more processors of the compute device to cause the transmission of the audio signals to the earphones contemporaneously with transmission of a video signal based on the gaming information to a display.

10. The one or more storage devices of claim 1 , wherein the audio data for the first channel and the audio data for the second channel correspond to media data, wherein the media data includes medical information, and wherein the plurality of instructions causes the one or more processors of the compute device to cause transmission of a video signal based on the medical information to a display contemporaneously with the transmission of the audio signals to the earphones.

11. A compute device comprising:
one or more processors; and
one or more storage devices including a plurality of instructions that, when executed by the one or more processors, causes the compute device to:
identify a change in at least one of a position or an orientation of a head of a user of the compute device, the compute device to be communicatively coupled to earphones worn by the user, the earphones to move with movement of the head of the user;
identify audio data for a first channel and audio data for a second channel;
adjust, in response to the change in the at least one of the position or the orientation of the head of the user, the audio data for the first channel and the audio data for the second channel, wherein the adjusted audio data for the first channel is different from the adjusted audio data for the second channel to create an effect of three-dimensional sound; and
transmit audio signals based on the adjusted audio data for the first channel and the adjusted audio data for the second channel to the earphones.

12. The compute device of claim 11 , further including a camera device, wherein the plurality of instructions causes the compute device to:
obtain video of the user with the camera device;
analyze the video; and
determine, based on the analysis of the video, the change in the at least one of the position or the orientation of the head of the user.

13. The compute device of claim 11 , wherein the change in the at least one of the position or the orientation of the head of the user of the compute device is based on one or more parameters indicative of the at least one of the position or the orientation of the head of the user of the compute device relative to a default position of the user.

14. The compute device of claim 11 , wherein the plurality of instructions causes the compute device to:
identify audio data for at least one additional channel, and
down mix, based on the change in the at least one of the position or the orientation of the head of the user, the audio data for the first channel, the audio data for the second channel, and the audio data for the at least one additional channel in order to adjust the audio data for the first channel and the audio data for the second channel.

15. The compute device of claim 11 , wherein the plurality of instructions further causes the compute device to modify at least one of a latency or an amplitude of the audio data for the second channel relative to the audio data for the first channel in order to adjust the audio data for the first channel and the audio data for the second channel.

16. The compute device of claim 11 , wherein the one or more processors include an audio digital signal processor, and wherein the one or more processors are to use the audio digital signal processor to adjust the audio data for the first channel and the audio data for the second channel.

17. The compute device of claim 11 , wherein the one or more processors include a graphics engine, and wherein the one or more processors are to use the graphics engine to adjust the audio data for the first channel and the audio data for th

Assignees

• Intel Corp

Inventors

• Kaburlasos Nikos
• Cheng Scott W
• Worrell Devon

Classifications

• H04S2420/01

  Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD] · CPC title

• H04S7/304 Primary

  For headphones · CPC title

• H04S2400/11

  Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) · CPC title

• H04S5/00 Primary

  Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation · CPC title

• H04R5/02 Primary

  Spatial or constructional arrangements of loudspeakers · CPC title