Segment-wise adjustment of spatial audio signal to different playback loudspeaker setup

Patent metadata

Field	Value
Publication number	US-9805726-B2
Application number	US-201514713292-A
Country	US
Kind code	B2
Filing date	May 15, 2015
Priority date	Nov 15, 2012
Publication date	Oct 31, 2017
Grant date	Oct 31, 2017

Abstract

Apparatus for adapting a spatial audio signal for an original loudspeaker setup to a playback loudspeaker setup that differs from the original loudspeaker setup. The apparatus includes a direct-ambience decomposer that is configured to decomposing channel signals in a segment of the original loudspeaker setup into direct sound and ambience components, and to determine a direction of arrival of the direct sound components. A direct sound renderer receives a playback loudspeaker setup information and adjusts the direct sound components using the playback loudspeaker setup information so that a perceived direction of arrival of the direct sound components in the playback loudspeaker setup is substantially identical to the direction of arrival of the direct sound components. A combiner combines adjusted direct sound components and possibly modified ambience components to obtain loudspeaker signals for loudspeakers of the playback loudspeaker setup.

First claim

The invention claimed is:

1. An apparatus for adapting a spatial audio signal for an original loudspeaker setup to a playback loudspeaker setup that differs from the original loudspeaker setup, wherein the spatial audio signal comprises a plurality of channel signals, each channel signal being a loudspeaker channel corresponding to a loudspeaker of the original loudspeaker setup, the apparatus comprising:
a grouper configured to group the plurality of channel signals into a plurality of original segments, wherein at least two neighboring channel signals are grouped into an original segment, and wherein a loudspeaker is assigned to a first original segment and to a second original segment;
a direct-ambience decomposer configured to decompose the at least two channel signals in the first original segment into at least one direct sound component and at least one ambience component, and to determine a direction of arrival of the at least one direct sound component for the first original segment, and to decompose the at least two channel signals in the second original segment into at least one direct sound component and at least one ambience component for the second original segment, and to determine a direction of arrival of the at least one direct sound component for the second original segment;
a direct sound renderer configured to receive a playback loudspeaker setup information for a first playback segment associated with the first original segment and to adjust the at least one direct sound component of the first original segment using the playback loudspeaker setup information for the first playback segment to obtain at least one adjusted direct sound component so that a perceived direction of arrival of the at least one direct sound component in the playback loudspeaker setup is identical to the direction of arrival of the first original segment or closer to the direction of arrival of the at least one direct sound component of the first original segment compared to a situation in which no adjusting of the at least one direct sound component has taken place, and configured to receive a playback loudspeaker setup information for a second playback segment associated with the second original segment and to adjust the at least one direct sound component of the second original segment using the playback loudspeaker setup information for the second playback segment to obtain at least one further adjusted direct sound component so that a perceived direction of arrival of the at least one direct sound component in the playback loudspeaker setup is identical to the direction of arrival of the second original segment or closer to the direction of arrival of the at least one direct sound component of the second original segment compared to a situation in which no adjusting of the at least one direct sound component has taken place; and
a combiner configured to combine the at least one adjusted direct sound component and the ambience components or modified ambience components of a first playback segment and the at least one further adjusted direct sound components and the ambience components or modified ambience components of a second playback segment.

2. The apparatus according to claim 1 , wherein the playback loudspeaker setup comprises an additional loudspeaker within the first or second original segment so that the first or second original segment of the original loudspeaker setup corresponds to two or more segments of the playback loudspeaker segment;
wherein the direct sound renderer is configured to generate the adjusted direct sound components for the at least two loudspeakers and the additional loudspeaker of the playback loudspeaker setup.

3. The apparatus according to claim 1 , wherein the playback loudspeaker setup lacks a loudspeaker compared to the original loudspeaker setup so that a left or right original segment and a neighboring left or right original segment of the original loudspeaker setup are merged to one merged segment of the playback loudspeaker setup;
wherein the direct sound renderer is configured to distribute adjusted direct sound components of a channel corresponding to the loudspeaker that lacks in the playback loudspeaker setup to at least two remaining loudspeakers of the merged segment of the playback loudspeaker setup.

4. The apparatus according to claim 1 , wherein the direct sound renderer is configured to reallocate a direct sound component comprising a determined direction of arrival from a left or right original segment of the original loudspeaker setup to a neighboring segment of the playback loudspeaker setup if a boundary between the left or right original segment and the neighboring segment trespasses the determined direction of arrival when passing from the original loudspeaker setup to the playback loudspeaker setup.

5. The apparatus according to claim 4 , wherein the direct sound renderer is further configured to reallocate the direct sound component comprising the determined direction of arrival from at least one first loudspeaker to at least one second loudspeaker, the at least one first loudspeaker being assigned to the left or right original segment in the original loudspeaker setup but not to the neighboring segment in the playback loudspeaker setup and the at least one second loudspeaker being assigned to the neighboring segment in the playback loudspeaker setup.

6. The apparatus according to claim 1 , wherein the direct sound renderer is configured to perform a panning of the at least one direct sound component using the playback loudspeaker setup information and the perceived direction of arrival of the at least one direct sound component.

7. The apparatus according to claim 6 , wherein the direct sound renderer is further configured to perform the panning of the at least one direct sound component comprising the determined direction of arrival using the playback loudspeaker setup information and the perceived direction of arrival of the at least one direct sound component by adjusting loudspeaker signals for loudspeakers in the left or right original segment to acquire adjusted loudspeaker signals for loudspeakers in a corresponding modified segment of the playback loudspeaker setup if at least one of the loudspeakers in the left or right original segment is displaced in the corresponding modified segment of the playback loudspeaker setup without trespassing the determined direction of arrival.

8. The apparatus according to claim 1 , wherein the direct sound renderer is configured to generate loudspeaker-segment-specific direct sound components for at least two valid loudspeaker-segment pairs of the playback loudspeaker setup, the at least two valid loudspeaker-segment pairs referring to a specific loudspeaker and two neighboring segments in the playback loudspeaker setup; and
wherein the combiner is configured to combine the loudspeaker-segment-specific direct sound components for the at least two valid loudspeaker-segment pairs referring to the specific loudspeaker to acquire one of the loudspeaker signals for at least two loudspeakers of the playback loudspeaker setup the at least two loudspeakers comprising the specific loudspeaker.

9. The apparatus according to claim 1 , wherein the direct sound renderer is further configured to process the at least one direct sound component for a given segment of the playback loudspeaker setup and to thereby generate adjusted direct sound components for each loudspeaker assigned to the given segment.

10. The apparatus according to claim 1 , further comprising an ambience renderer configured to receive the playback loudspeaker setup information for a left or right playback segment and to adjust the at least one ambience component using the playb

Assignees

• Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E V
• Univ Ilmenau Tech

Inventors

• Adami Alexander
• Herre Juergen
• Kuntz Achim
• Del Galdo Giovanni
• Kuech Fabian

Classifications

• H04S7/303

  Tracking of listener position or orientation · CPC title

• G10L19/008 Primary

  Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing · CPC title

• H04S5/02

  of the pseudo four-channel type, e.g. in which rear channel signals are derived from two-channel stereo signals · CPC title

• H04S7/30

  Control circuits for electronic adaptation of the sound field · CPC title

• H04S5/00 Primary

  Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation · CPC title