Apparatus and method for reproducing a spatially extended sound source or apparatus and method for generating a bitstream from a spatially extended sound source

Patent metadata

Field	Value
Publication number	US-12445796-B2
Application number	US-202418431423-A
Country	US
Kind code	B2
Filing date	Feb 2, 2024
Priority date	Dec 19, 2018
Publication date	Oct 14, 2025
Grant date	Oct 14, 2025

Abstract

An apparatus for reproducing a spatially extended sound source having a defined position and geometry in a space includes an interface for receiving a listener position; a projector for calculating a projection of a two-dimensional or three-dimensional hull associated with the spatially extended sound source onto a projection plane using the listener position, information on the geometry of the spatially extended sound source, and information on the position of the spatially extended sound source; a sound position calculator for calculating positions of at least two sound sources for the spatially extended sound source using the projection plane; and a renderer for rendering the at least two sound sources at the positions to obtain a reproduction of the spatially extended sound source having two or more output signals, wherein the renderer is configured to use different sound signals for the different positions.

First claim

The invention claimed is:

1. An apparatus for reproducing a spatially extended sound source comprising a defined position and geometry in a space, the apparatus comprising:
an interface or a detector for receiving a listener position;
a projector for calculating data on a hull associated with the spatially extended sound source and projecting the data on the hull in a direction towards the listener position to obtain a projection of the hull as projector output data, or for projecting information on a geometry of the spatially extended sound source towards the listener position and for computing data on a hull of a result of the projecting to obtain projector output data;
a sound position calculator for calculating positions of at least two sound sources for the spatially extended sound source using the projector output data; and
a renderer for rendering the at least two sound sources at the positions of the at least two sound sources to acquire a reproduction of the spatially extended sound source comprising two or more output signals, wherein the renderer is configured to use different sound signals for the positions of the at least two sound sources, wherein the different sound signals are associated with the spatially extended sound source.

2. The apparatus of claim 1 , configured for receiving a scene description, the scene description comprising the information on the defined position and the information on the defined geometry of the spatially extended sound source, and at least one basis sound signal associated with the spatially extended sound source,
wherein the apparatus further comprises a scene description parser for parsing the scene description to retrieve the information on the defined position, the information on the defined geometry and the at least one basis sound signal, or
wherein the scene description comprises, for the spatially extended sound source, at least two basis sound signals and location information for each basis sound signal of the at least two basis sound signals with respect to the information on the geometry of the spatially extended sound source, and wherein the sound position calculator is configured to use the location information for the at least two basis signals when calculating the positions of the at least two sound sources using the projection plane.

3. The apparatus of claim 1 ,
wherein the sound position calculator is configured to calculate the position so that the at least two sound sources are peripheral sound sources and are located on the projection plane, or wherein the sound position calculator is configured for calculating such that a position of a peripheral sound source of the peripheral sound sources is located on the right of the projection plane with respect to the listener and/or to the left of the projection plane with respect to the listener, and/or on top of the projection plane with respect to the listener and/or at the bottom of the projection plane with respect to the listener.

4. The apparatus of claim 1 ,
wherein the renderer is configured to render the at least two sound sources using
panning operations depending on the positions of the at least two sound sources to acquire loudspeaker signals for a predefined loudspeaker setup, or
binaural rendering operations using head related transfer functions depending on the positions of the at least two sound sources to acquire headphone signals.

5. The apparatus of claim 1 ,
wherein a first number of basis sound signals is associated with the spatially extended sound source, the first number being one or greater than one, wherein the first number of basis sound signals is related to the same spatially extended sound source,
wherein the sound position calculator determines a second number of sound sources used for the rendering of the spatially extended sound source, the second number being greater than one, and
wherein the renderer comprises one or more decorrelators for generating a decorrelated signal from one or more basis sound signals of the first number, wherein the second number is greater than the first number.

6. The apparatus of claim 1 , wherein the projector is configured
to calculate the projection as a picture plane, or
to calculate the projection as a spherical surface around a head of the listener, or
to calculate the projection as the projection plane being located at a predetermined distance from a center of the listener's head, or
to calculate the projection of the hull of the spatially extended sound source or the hull of the result of the projection from an azimuth angle and an elevation angle being derived from spherical coordinates relative to the perspective of a listener's head.

7. The apparatus of claim 1 ,
wherein the sound position calculator is configured to calculate the positions so that the positions of the at least two sound sources are uniformly distributed around the projection of the hull or the hull of the result of the projection, or so that the positions are placed at extremal or peripheral points of the projection of the hull or the hull of the result of the projection, or so that the positions are located at horizontal or vertical extremal or peripheral points of the projection of the hull or the hull of the result of the projection.

8. The apparatus of claim 1 ,
wherein the sound position calculator is configured to determine, in addition to positions for peripheral sound sources, positions for auxiliary sound sources located on or before or behind or within the projection of the hull or the hull of the result of the projection with respect to the listener.

9. The apparatus of claim 1 ,
wherein the projector is configured to additionally shrink the projection of the hull or the hull of the result of the projection by a variable or predetermined amount or by different variable or predetermined amounts in different directions.

10. The apparatus of claim 1 , wherein the sound position calculator is configured for calculating such that at least one additional auxiliary sound source is located on the projection plane between a left peripheral sound source and a right peripheral sound source with respect to the listener position, or
wherein the sound position calculator is configured for calculating such that at least one additional auxiliary sound source is located on the projection plane between a left peripheral sound source and a right peripheral sound source with respect to the listener position, wherein a single additional auxiliary source is placed in the middle between the left peripheral sound source and the right peripheral sound source, or two or more additional auxiliary sources are placed equidistantly between the left peripheral sound source and the right peripheral sound source.

11. The apparatus of claim 1 ,
wherein the sound position calculator is configured to perform a rotation of the positions of the at least two sound sources of the spatially extended sound source around a center of gravity of the projection in case of a receipt of a circular motion of the listener around the spatially extended sound source via the interface, or in case of a receipt of a rotation of the spatially extended sound source with respect to a stationary listener position via the interface.

12. The apparatus of claim 1 ,
wherein the renderer is configured to receive, for each sound source, an opening angle depending on the distance between the listener and the sound source and to render the sound source depending on the opening angle, or
wherein the renderer is configured to receive a distance information for each sound source, and wherein the renderer is configured to render the sound source depending on th

Assignees

• Fraunhofer Ges Forschung

Inventors

• Herre Jürgen
• Habets Emanuel
• Schlecht Sebastian
• Adami Alexander

Classifications

• H04S2420/03

  Application of parametric coding in stereophonic audio systems · CPC title

• H04S2420/01

  Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD] · CPC title

• H04S2400/11

  Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) · CPC title

• H04S7/303 Primary

  Tracking of listener position or orientation · CPC title