Customized head-related transfer functions

Patent metadata

Field	Value
Publication number	US-9544706-B1
Application number	US-201514666253-A
Country	US
Kind code	B1
Filing date	Mar 23, 2015
Priority date	Mar 23, 2015
Publication date	Jan 10, 2017
Grant date	Jan 10, 2017

Abstract

A technology for creating head-related transfer functions that are customized for a pinna of a human is described. The method may include capturing a plurality of digital images of a human pinna using a camera. The method may also include generating a 3D (three-dimensional) digital model of the human pinna using the digital images. In addition, the method may also include determining a head related transfer function (HRTF) that is customized for the human pinna using the 3D digital model. The HRTF can be associated with a user profile and the user profile may include sound output customization information for a speaker arrangement capable of producing virtual surround sound. The customized HRTF may then be used by an application in association with a specific user profile to produce a virtual surround sound experience through headphones.

First claim

What is claimed is:

1. A method for generating a head related transfer function that is customized for a user for use in an interactive gaming environment, the method comprising:
receiving a plurality of digital images of a human pinna and a reference object using a camera;
generating a 3D (three-dimensional) digital model of the human pinna using the plurality of images, the 3D digital model representing the three-dimensional (3D) structure of the human pinna;
deriving a head related transfer function (HRTF) that is customized for the human pinna using the 3D digital model;
associating the HRTF with a user profile, the user profile comprising settings customized to at least one user sound output preference and a driver identifier for headphones capable of producing virtual surround sound;
generating an audio signal that has been modified using the HRTF, a driver associated with the driver identifier, and at least one user sound output preference to provide virtual surround sound; and
streaming the audio signal that was customized to headphones.

2. The method as in claim 1 , wherein the user profile further comprises an additional driver identifier for a speaker device capable of producing virtual surround sound.

3. The method of claim 1 , wherein the audio signal represents sound associated with the interactive gaming environment and takes into account interactive content being accessed.

4. The method of claim 3 , wherein the user provides control information to control an avatar in a 3D environment depicted in the interactive gaming environment and the audio signal is adjusted based at least in part on changes of the avatar and changes in the 3D environment based at least in part on the control information.

5. The method of claim 1 , wherein the headphones perform noise control to mitigate audio interference from sounds that emanate from a source other than the headphones.

6. A method for generating a head related transfer function that is customized for a user for use in an interactive gaming environment, comprising:
receiving a plurality of digital sensor readings, the digital sensor readings are based on reading at least a portion of a human pinna;
deriving a digital model of the human pinna using the plurality of sensor readings, the digital model representing at least a portion of a three-dimensional (3D) structure of the human pinna;
determining a head related transfer function (HRTF) that is customized for a user using the digital model and the HRTF;
associating the HRTF with a user profile, the user profile comprising at least one user sound output preference and a driver identifier for a speaker arrangement capable of producing virtual surround sound; and
providing the HRTF and the driver identifier to an application to enable the application to provide virtual surround sound to the user through the speaker arrangement.

7. The method of claim 6 , wherein the digital sensor readings comprise at least one of digital photographs, digital video footage, readings from laser scanners, readings from structured-laser-light-based 3-D scanners, readings from projected light stripe systems, readings from LiDAR (Light Detection And Ranging), readings from radar, readings from sonar, or readings from time-of-flight (TOF) sensors.

8. The method of claim 6 , wherein the application is configured to use the HRTF and input from one or more motion-detecting sensors to provide the customized virtual surround sound experience to the user through the speaker arrangement.

9. The method of claim 8 , wherein the one or more motion-detecting sensors comprise at least one of: an accelerometer, a gyroscope, a magnetic sensor, a tomographic motion detector, a passive infrared sensor, a microwave sensor, an ultrasonic sensor, a barometer, or a camera.

10. The method of claim 9 , wherein the application comprises an interactive gaming environment depicting a 3D environment and the application adjusts the virtual surround sound experience at least in part based on changes in the 3D environment relative to an avatar that is in the 3D environment, the changes being based at least in part on the input from the one or more motion-detecting sensors.

11. The method of claim 10 , wherein the motion-detecting sensors are mounted to a user's head and the avatar is at least partly controlled by movement of the user's head that is detected using the motion-detecting sensors.

12. The method of claim 6 , wherein the speaker arrangement comprises headphones that are circumaural in order to mitigate audio interference from sounds that emanate from a source other than the headphones.

13. The method of claim 6 , wherein the speaker arrangement comprises headphones that perform noise control to mitigate audio interference from sounds from a source other than the headphones.

14. The method of claim 6 , wherein the user profile further comprises user preferences including at least one of: a bass level, a treble level, or a fade level.

15. The method of claim 6 , wherein the user profile further comprises a second driver identifier for a second speaker arrangement capable of producing virtual surround sound.

16. A non-transitory computer-readable medium storing instructions thereon which, when executed by one or more processors, perform the following:
receiving a plurality of digital sensor readings, the digital sensor readings are based on reading at least a part of a user's pinna and a user's head;
deriving a digital model using the plurality of sensor readings, the digital model representing at least a part of the three-dimensional (3D) structure of the user's pinna and the user's head;
determining a head related transfer function (HRTF) that is customized for a user using the digital model;
associating the HRTF with a user profile, the user profile comprising sound output customization information and a driver identifier for a speaker arrangement capable of producing virtual surround sound; and
providing the HRTF and the driver identifier to an application to enable the application to provide virtual surround sound to the user through the speaker arrangement.

17. The non-transitory computer-readable medium of claim 16 , wherein the plurality of digital sensor readings comprise one or more of digital photographs or digital video footage.

18. The non-transitory computer-readable medium of claim 16 , wherein the instructions, when executed by the one or more processors, further perform the following:
using the HRTF that is customized for the user to customize a streaming audio signal for the speaker arrangement to enable an application to provide customized virtual surround sound for the user.

19. The non-transitory computer-readable medium of claim 16 , wherein the instructions, when executed by the one or more processors, further perform the following:
using the HRTF to provide a customized virtual surround sound experience to the user through headphones.

Assignees

• Amazon Tech Inc

Inventors

• Hirst Alistair Robert

Classifications

• H04S7/302 Primary

  Electronic adaptation of stereophonic sound system to listener position or orientation (H04S7/301 takes precedence) · CPC title

• H04S2420/01

  Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD] · CPC title

• H04S1/00

  Two-channel systems (H04S5/00, H04S7/00 take precedence) · CPC title

• H04S7/304

  For headphones · CPC title

• H04S7/00

  Indicating arrangements; Control arrangements, e.g. balance control · CPC title