Processing segments or channels of sound with HRTFs

Patent metadata

Field	Value
Publication number	US-11665496-B2
Application number	US-202217703466-A
Country	US
Kind code	B2
Filing date	Mar 24, 2022
Priority date	Jun 10, 2016
Publication date	May 30, 2023
Grant date	May 30, 2023

Abstract

One or more electronic devices include one or more processors that process different segments or channels of an audio signal of sound for a user. The one or more processors process a first segment or channel of the sound with first HRTFs so the first segment or channel externally localizes in front of and to a right of a head of the user and process a second segment or channel of the sound with second HRTFs so the second segment or channel externally localizes in front of and to a left of the head of the user.

First claim

What is claimed is:

1. A method comprising:
convolving, by one or more electronic devices and with a first pair of head related transfer functions (HRTFs), a first channel of an audio signal of a song so the first channel of the audio signal of the song externally localizes to a first sound localization point (SLP) in empty space that is in front of and to a right side of a face of a listener;
convolving, by the one or more electronic devices and with a second pair of HRTFs, a second channel of the audio signal of the song so the second channel of the audio signal of the song externally localizes to a second SLP in empty space that is in front of and to a left side of the face of the listener; and
playing the song to the listener so the first channel of the audio signal of the song externally localizes outside the head of the listener to the first SLP in empty space that is in the front of and to the right side of the face of the listener and so the second channel of the audio signal of the song externally localizes outside the head of the listener to the second SLP in empty space that is in the front of and to the left side of the face of the listener.

2. The method of claim 1 , further comprising:
convolving, by the one or more electronic devices and with a third pair of HRTFs, a third channel of the audio signal of the song so the third channel of the audio signal of the song externally localizes outside the head of the listener to a third SLP that is in front of the face of the listener, wherein the first channel, the second channel, and the third channel simultaneously play to the listener.

3. The method of claim 1 , further comprising:
convolving, by the one or more electronic devices and with a third pair of HRTFs, a third channel of the audio signal that is a voice of a person so the voice externally localizes outside the head of the listener to a third SLP that is located at a smartphone in front of the face of the listener.

4. The method of claim 1 , further comprising:
convolving, by the one or more electronic devices and with a third pair of HRTFs, a third channel of the audio signal that is a voice of a person so the voice externally localizes outside the head of the listener to a third SLP that is located at a television in front of the face of the listener.

5. The method of claim 1 further comprising:
segmenting, by the one or more electronic devices, the audio signal of the song into a plurality of segments that include a first segment being the first channel, a second segment being the second channel, and a third segment being a third channel; and
convolving, by the one or more electronic devices, the third channel of the audio signal to externally localize outside the head of the listener to a third SLP that is located at a display of an electronic device.

6. The method of claim 1 , wherein the first SLP is a first virtual speaker located at a fixed position to the right side of the face of the listener, and the second SLP is a second virtual speaker located at a fixed position to the left side of the face of the listener.

7. The method of claim 1 further comprising:
simultaneously convolving, by the one or more electronic devices, the first channel and the second channel, wherein the song plays as binaural sound to the listener through headphones or earphones worn on the head of the listener.

8. A method comprising:
processing, with one or more electronic devices and with a first pair of head related transfer functions (HRTFs), a first voice in sound that externally localizes in empty space to a first virtual person in front of and to a right side of a head of a listener;
processing, with the one or more electronic devices and with a second pair of HRTFs, a second voice in the sound that externally localizes in empty space to a second virtual person in front of and to a left side of the head of the listener;
processing, with the one or more electronic devices and with a third pair of HRTFs, a third voice in the sound that externally localizes in empty space to a third virtual person in front of the head of the listener; and
playing the first voice, the second voice, and the third voice with a wearable electronic device (WED) worn on the head of the listener that provides the first virtual person, the second virtual person, and the third virtual person as augmented reality (AR) or virtual reality (VR).

9. The method of claim 8 , wherein the first, second, and third voices are people in an electronic call with the listener.

10. The method of claim 8 , wherein the one of more electronic devices include a server that processes the sound with the first, second, and third pair of HRTFs and transmits the sound to the WED worn on the head of the listener.

11. The method of claim 8 , wherein the sound is in a movie displayed to the listener with the WED worn on the head of the listener.

12. The method of claim 8 , wherein the sound is binaural sound, and the first voice, the second voice, and the third voice are in a computer game played by the WED.

13. The method of claim 8 , wherein the one or more electronic devices is a cloud server that processes the first voice with the first pair of HRTFs, the second voice with the second pair of HRTFs, and the third voice with the third pair of HRTFs.

14. The method of claim 8 further comprising:
processing, with the one or more electronic devices, the sound into five different channels that externally localize outside the head of the listener to five different sound localization points (SLPs).

15. A wearable electronic device (WED) worn on a head of a user, the WED comprising:
a display that displays a virtual environment with sound to the user; and
one or more processors that process a first segment of the sound with first head-related transfer functions (HRTFs) so the first segment of sound externally localizes to a first virtual person that is in front of and to a right of the head of the user, process a second segment of the sound with second HRTFs so the second segment of sound externally localizes to a second virtual person in front of and to a left of the head of the user, and process a third segment of the sound with third HRTFs so the third segment of sound externally localizes to a third virtual person in front of the head of the user.

16. The WED of claim 15 , wherein the sound occurs in a teleconference call, the first segment of sound is a voice of a first person to the teleconference call, the second segment of sound is a voice of a second person to the teleconference call, and the third segment of sound is a voice of a third person to the teleconference call.

17. The WED of claim 15 , wherein the one or more processors process the sound with room impulse responses (RIRs) assigned to the virtual environment.

18. The WED of claim 15 , wherein the WED plays a segment of the sound that internally localizes inside the head of the user.

19. The WED of claim 15 , wherein the one or more processors simultaneously process the first, second, and third segments of the sound.

20. The WED of claim 15 , wherein the one or more processors identifies the first segment of sound as belonging to the first virtual person, the second segment of sound as belonging to the second virtual person, and the third segment of sound as belonging to the third virtual person.

Assignees

• Lyren Philip Scott
• Norris Glen A

Inventors

• Lyren Philip Scott
• Norris Glen A

Classifications

• H02M3/24

  by static converters · CPC title

• H02M1/4208

  Arrangements for improving power factor of AC input · CPC title

• H02M1/08

  Circuits specially adapted for the generation of control voltages for semiconductor devices incorporated in static converters · CPC title

• H04S7/30 Primary

  Control circuits for electronic adaptation of the sound field · CPC title

• H04S2420/01

  Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD] · CPC title