Playing binaural sound in response to a person being at a location

Patent metadata

Field	Value
Publication number	US-11832076-B2
Application number	US-202117520584-A
Country	US
Kind code	B2
Filing date	Nov 5, 2021
Priority date	Feb 20, 2016
Publication date	Nov 28, 2023
Grant date	Nov 28, 2023

Abstract

An electronic device includes a display and one or more processors. The display displays, when a person is at a location, a virtual image at a sound localization point (SLP) in empty space. The one or more processors process sound with a room impulse response (RIR) for the location in order to generate binaural sound that externally localizes at the SLP in empty space in response to the person being at the location.

First claim

What is claimed is:

1. A method comprising:
determining, with a portable electronic device of a person entering a location, whether a room impulse response (RIR) for the location is stored in memory;
retrieving, from the memory, the RIR for the location in response to determining the RIR for the location is stored in the memory;
capturing, with the portable electronic device, the RIR for the location in response to determining the RIR for the location is not stored in the memory;
processing, with one or more processors, sound with the RIR for the location to generate binaural sound; and
playing, with the portable electronic device and to the person, the binaural sound that externally localizes at a sound localization point (SLP) in empty space in response to determining the person is at the location.

2. The method of claim 1 further comprising:
determining, with the portable electronic device, the person moved from the location to a second location having a second RIR; and
changing processing of the sound with the RIR to processing of the sound with the second RIR in response to the determining the person moved from the location to the second location.

3. The method of claim 1 further comprising:
playing, with the portable electronic device with the person, a sound to capture the RIR for the location in response to the determining the RIR for the location is not stored in the memory.

4. The method of claim 1 further comprising:
designating the SLP in empty space at a location where the portable electronic device is pointed.

5. The method of claim 1 further comprising:
generating, with the portable electronic device, the RIR for the location from a three-dimensional (3D) map of the location in response to the determining the RIR for the location is not stored in the memory.

6. The method of claim 1 further comprising:
displaying, on a display of the portable electronic device, a virtual map that shows locations of different RIRs for different locations.

7. The method of claim 1 further comprising:
mapping the RIR into a three-dimensional (3D) virtual map; and
displaying, with the portable electronic device that is worn on a head of the person, the 3D virtual map that includes the RIR.

8. A method comprising:
determining whether a room impulse response (RIR) exists for a location where a person wearing a wearable electronic device (WED) is located;
generating, with the WED worn on a head of the person, the RIR for the location in response to determining the RIR does not exist for the location;
processing, with one or more processors, sound with the RIR for the location to generate binaural sound; and
automatically playing, with the WED worn on the head of the person, the binaural sound that externally localizes at a sound localization point (SLP) in empty space in response to determining the person is at the location.

9. The method of claim 8 further comprising:
determining, with the WED, the person moved from the location to a second location having a different RIR; and
changing processing of the sound with the RIR to processing of the sound with the second RIR in response to the determining the person moved from the location to the second location.

10. The method of claim 8 further comprising:
generating, from a three-dimensional map of the location, the RIR for the location in response to determining the RIR does not exist for the location.

11. The method of claim 8 further comprising:
displaying, with a display of the WED worn on the head of the person, a virtual map that shows locations of different RIRs in a spherical shape.

12. The method of claim 8 further comprising:
mapping the RIR into a three-dimensional (3D) map of the location; and
displaying, with the WED, a virtual image of the 3D map that shows the RIR for the location.

13. The method of claim 8 further comprising:
displaying, with a display of the WED, a plurality of SLPs in empty space that extend around the head of the person as a partial sphere.

14. The method of claim 8 further comprising:
generating the RIR with sound played from a portable electronic device in a hand of the person.

15. An electronic device, comprising:
a display that displays, when a person is at a location, a virtual image at a sound localization point (SLP) in empty space;
a memory; and
one or more processors that execute instructions that cause the electronic device to retrieve a room impulse response (RIR) for the location from the memory in response to determining the RIR for the location is stored in the memory, generate the RIR for the location in response to determining the RIR for the location is not stored in the memory, and process sound with the RIR for the location in order to generate binaural sound that externally localizes at the SLP in empty space in response to the person being at the location.

16. The electronic device of claim 15 , wherein the display displays a three-dimensional virtual reality (VR) map of the location that shows the RIR.

17. The electronic device of claim 16 , wherein the display displays a plurality of virtual SLPs in a spherical shape around a head of the person.

18. The electronic device of claim 16 further comprising:
one or more sensors that designates a location of the SLP by pointing to the location of the SLP.

19. The electronic device of claim 16 , wherein the electronic device designates a location of the SLP as a location where the electronic device is while held in a hand of the person.

20. The electronic device of claim 16 , wherein display displays a plurality of SLPs in empty space as virtual images that form a partial sphere around a head of the person.

Assignees

• Lyren Philip Scott
• Norris Glen A

Inventors

• Lyren Philip Scott
• Norris Glen A

Classifications

• H04S1/005 Primary

  For headphones · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title