System and method for processing an input signal to produce 3d audio effects

Patent metadata

Field	Value
Publication number	US-2016174012-A1
Application number	US-201615051599-A
Country	US
Kind code	A1
Filing date	Feb 23, 2016
Priority date	Jan 19, 2010
Publication date	Jun 16, 2016
Grant date	—

Abstract

A processing system for processing an input signal to produce three-dimensional audio effects is disclosed. The processing system comprises: a cue sending path configured to extract a set of binaural cues from the input signal and further configured to send at least a portion of the extracted set of binaural cues to at least one directional loudspeaker for transmission; and an ambience sending path configured to send at least a part of the input signal comprising ambience sounds to at least one conventional loudspeaker for transmission.

First claim

What is claimed is:

1 . A processing system for processing an input signal to produce three-dimensional audio effects, the processing system comprising:
a cue sending path configured to extract a set of binaural cues from the input signal and further configured to send at least a portion of the extracted set of binaural cues to at least one directional loudspeaker for transmission, said at least one directional loudspeaker being a parametric loudspeaker for generating a modulated ultrasonic wave; and an ambience sending path configured to send at least a part of the input signal comprising ambience sounds to at least one conventional loudspeaker for transmission.

2 . A processing system according to claim 1 , wherein the ambience sending path comprises an ambience extraction unit configured to subtract from the input signal at least a portion of the extracted set of binaural cues to extract the part of the input signal comprising ambience sounds.

3 . A processing system according to claim 2 , wherein the portion of the extracted set of binaural cues to be subtracted from the input signal is adjustable.

4 . A processing system according to claim 1 , wherein the portion of the extracted set of binaural cues to be sent to the at least one directional loudspeaker is adjustable.

5 . A processing system according to claim 1 , wherein the cue sending path comprises a cue extraction module configured to extract the set of binaural cues from the input signal.

6 . A processing system according to claim 5 , wherein the processing system is coupled with a plurality of conventional loudspeakers comprising surround loudspeakers and non-surround loudspeakers; and
wherein the ambience sending path is configured to send at least a portion of the extracted set of binaural cues to the surround loudspeakers for transmission and is further configured to send the part of the input signal comprising ambience sounds to the non-surround loudspeakers for transmission.

7 . A processing system according to claim 1 , wherein the ambience sending path is operable in a plurality of modes comprising:
a reconfiguration mode in which the ambience sending path is operable to reconfigure the part of the input signal comprising ambience sounds to match a configuration of the at least one conventional loudspeaker before sending the part of the input signal comprising ambience sounds to the at least one conventional loudspeaker; and a direct-through mode in which the ambience sending path is configured to send the part of the input signal comprising ambience sounds directly to the at least one conventional loudspeaker.

8 . A processing system according to claim 1 , wherein the ambience sending path comprises a reconfiguration module operable to reconfigure the part of the input signal comprising ambience sounds to match a configuration of the at least one conventional loudspeaker.

9 . A processing system according to claim 8 , wherein the cue sending path further comprises a further reconfiguration module operable to reconfigure the portion of the extracted set of binaural cues to be sent to the at least one directional loudspeaker, to match a configuration of the at least one directional loudspeaker.

10 . A processing system according to claim 1 , wherein the cue sending path further comprises a pre-processing module configured to modulate the portion of the extracted set of binaural cues to be sent to the at least one directional loudspeaker, the pre-processing module employing a modulation technique which uses a pre-distortion term with a variable order.

11 . A processing system according to claim 1 , wherein the input signal comprises a plurality of channels and at least a part of the cue sending path is configured to process each channel of the input signal independently.

12 . A processing system according to claim 11 , wherein the cue sending path is configured to extract a group of binaural cues from each of one or more channels of the input signal and is further configured to send at least a portion of each extracted group of binaural cues to the at least one directional loudspeaker.

13 . A processing system according to claim 12 , wherein the portion of each extracted group of binaural cues to be sent to the at least one directional loudspeaker is independently adjustable.

14 . A processing system according to claim 1 , wherein the input signal comprises a plurality of channels and at least a part of the ambience sending path is configured to process each channel of the input signal independently.

15 . A processing system according to claim 14 , wherein the ambience sending path is configured to subtract from each of one or more channels of the input signal, at least a portion of a group of binaural cues extracted from the channel.

16 . A processing system according to claim 15 , wherein the portion of each group of binaural cues to be subtracted from the respective channel of the input signal is independently adjustable.

17 . A processing system according to claim 1 , wherein the input signal comprises a plurality of frequency bands and at least a part of one or both of the cue sending path and the ambience sending path is configured to process each frequency band independently.

18 . A processing system according to claim 1 , wherein the input signal comprises a plurality of channels, each channel comprising a plurality of frequency bands; and
wherein at least a part of one or both of the cue sending path and the ambience sending path is configured to process each frequency band of each channel independently.

19 . A processing system according to claim 1 , further comprising a video tracking module configured to track one or both of a user's position and the user's head movements.

20 . An audio system comprising:
a processing system for processing an input signal to produce three-dimensional audio effects according to any of the preceding claims; at least one directional loudspeaker configured to receive the portion of the extracted set of binaural cues for transmission, said at least one directional loudspeaker being a parametric loudspeaker for generating a modulated ultrasonic wave; and at least one conventional loudspeaker configured to receive the part of the input signal comprising ambience sounds for transmission.

21 . An audio system according to claim 20 when dependent on claim 19 , the audio system further comprising:
a steering mechanism configured to cooperate with the video tracking module of the processing system for steering a sound beam from the at least one directional loudspeaker according to one or both of the user's position and the user's head movements.

22 . A method for processing an input signal to produce three-dimensional audio effects, the method comprising the steps of:
extracting a set of binaural cues from the input signal and sending at least a portion of the extracted set of binaural cues to at least one directional loudspeaker for transmission, said at least one directional loudspeaker being a parametric loudspeaker for generating a modulated ultrasonic wave; and sending at least a part of the input signal comprising ambience sounds to at least one conventional loudspeaker for transmission.

Assignees

• Univ Nanyang Tech

Inventors

• Tan Ee Leng
• Gan Woon Seng

Classifications

• H04R1/403

  loud-speakers · CPC title

• H04S2420/01

  Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD] · CPC title

• H04S7/304 Primary

  For headphones · CPC title

• H04R2217/03

  Parametric transducers where sound is generated or captured by the acoustic demodulation of amplitude modulated ultrasonic waves · CPC title

• H04N21/439

  Processing of audio elementary streams · CPC title