Low-frequency effects haptic conversion system

Patent metadata

Field	Value
Publication number	US-9354704-B2
Application number	US-201514737730-A
Country	US
Kind code	B2
Filing date	Jun 12, 2015
Priority date	May 17, 2013
Publication date	May 31, 2016
Grant date	May 31, 2016

Abstract

A system is provided that produces haptic effects. The system receives an audio signal that includes a low-frequency effects audio signal. The system further extracts the low-frequency effects audio signal from the audio signal. The system further converts the low-frequency effects audio signal into a haptic signal by shifting frequencies of the low-frequency effects audio signal to frequencies within a target frequency range of a haptic output device. The system further sends the haptic signal to the haptic output device, where the haptic signal causes the haptic output device to output one or more haptic effects.

First claim

We claim:

1. A method comprising:
generating a low frequency information audio signal based on a multichannel audio signal;
synthesizing a haptic signal from the low frequency information audio signal;
providing one or more haptic effect parameters of the haptic signal to a user for adjusting the one or more haptic effect parameters;
receiving one or more user adjustments to at least one of the one or more haptic effect parameters;
adjusting the haptic signal based on the one or more user adjustments to obtain an adjusted haptic signal; and
embedding the adjusted haptic signal in a data stream that encodes at least the multichannel audio signal, wherein the adjusted haptic signal is encoded within the low frequency information audio signal.

2. The method of claim 1 , wherein generating the low frequency information audio signal comprises extracting a low frequency effects audio channel signal from the multichannel audio signal.

3. The method of claim 1 , wherein generating the low frequency information audio signal comprises generating a composite audio signal based on a right channel of the multichannel audio signal, a left channel of the multichannel audio signal, a left surround channel of the multichannel audio signal, a right surround channel of the multichannel audio signal, and a low frequency effects channel of the multichannel audio signal.

4. The method of claim 1 , wherein one of the one or more haptic effect parameters is frequency.

5. The method of claim 1 , wherein one of the one or more haptic effect parameters is magnitude.

6. The method of claim 1 , wherein one of the one or more haptic effect parameters is a frequency modulation synthesis haptic effect parameter that modifies the haptic signal based on one or more operators.

7. The method of claim 1 , wherein embedding the haptic signal comprises compressing the haptic signal to produce a compressed haptic signal and embedding the compressed haptic signal in a container or a streaming data format that supports haptic data encoding.

8. The method of claim 2 , wherein the haptic signal is encoded within the low frequency effects audio channel signal.

9. The method of claim 1 , wherein
the haptic signal is synthesized by applying a pitch-shift to the low frequency information audio signal.

10. The method of claim 9 , wherein one of the one or more haptic effect parameters is the pitch-shift.

11. The method of claim 1 , wherein the embedding comprises encoding the haptic signal in a low-frequency effects track of a Dolby Digital audio signal.

12. The method of claim 1 ,
wherein the haptic signal is synthesized by applying a frequency-shift to the low frequency information audio signal.

13. The method of claim 12 ,
wherein one of the one or more haptic effect parameters is the frequency-shift.

14. A non-transitory computer-readable medium storing instructions which, when executed by a processor, cause the processor to:
generate a low frequency information audio signal based on a multichannel audio signal;
synthesize a haptic signal from the low frequency information audio signal;
provide one or more haptic effect parameters of the haptic signal to a user for adjusting the one or more haptic effect parameters;
receive one or more user adjustments to at least one of the one or more haptic effect parameters;
adjust the haptic signal based on the one or more user adjustments to obtain an adjusted haptic signal; and
embed the adjusted haptic signal in a data stream that encodes at least the multichannel audio signal, wherein the adjusted haptic signal is encoded within the low frequency information audio signal.

15. A method comprising:
receiving a data stream that embeds both an adjusted haptic track and a multichannel audio signal, wherein the adjusted haptic track is generated based on a haptic track that is synthesized from a low frequency information audio signal of the multichannel audio signal and one or more user adjustments to at least one haptic effect parameter of the haptic track, wherein the adjusted haptic signal is encoded within the low frequency information audio signal;
decoding the data stream to produce the multichannel audio signal;
sending the multichannel audio signal to one or more audio output devices;
decoding the adjusted haptic track to produce a haptic signal; and
sending the third haptic signal to a haptic actuator.

16. A non-transitory computer-readable medium storing instructions which, when executed by a processor, cause the processor to:
receive a data stream that embeds both an adjusted haptic track and a multichannel audio signal, wherein the adjusted haptic track is generated based on a haptic track that is synthesized from a low frequency information audio signal of the multichannel audio signal and one or more user adjustments to at least one haptic effect parameter of the haptic track, wherein the adjusted haptic signal is encoded within the low frequency information audio signal;
decoding the data stream to produce the multichannel audio signal;
sending the multichannel audio signal to one or more audio output devices;
decoding the adjusted haptic track to produce a haptic signal; and
sending the haptic signal to a haptic actuator.

17. A computing device comprising:
a memory configured to store a low-frequency effects conversion module;
a processor configured to execute the low-frequency effects conversion module stored on the memory;
wherein the low-frequency effects conversion module is configured, when executed by the processor, to generate a low frequency information audio signal based on a multichannel audio signal;
wherein the low-frequency effects conversion module is further configured, when executed by the processor, to synthesize a haptic signal from the low frequency information audio signal;
wherein the low-frequency effects conversion module is further configured, when executed by the processor, to provide one or more haptic effect parameters of the haptic signal to a user for adjusting the one or more haptic effect parameters;
wherein the low-frequency effects conversion module is further configured, when executed by the processor, to receive one or more user adjustments to at least one of the one or more haptic effect parameters;
wherein the low-frequency effects conversion module is further configured, when executed by the processor, to adjust the haptic signal based on the one or more user adjustments to obtain an adjusted haptic signal; and
wherein the low-frequency effects conversion module is further configured, when executed by the processor, to embed the adjusted haptic signal in a data stream that encodes at least the multichannel audio signal, wherein the adjusted haptic signal is encoded within the low frequency information audio signal.

18. The computing device of claim 17 , wherein the low-frequency effects conversion module is further configured, when executed by the processor, to extract a low frequency effects audio channel signal from the multichannel audio signal.

19. The computing device of claim 17 , wherein the low-frequency effects conversion module is further configured, when executed by the processor, to generate a composite audio signal based on a right channel of the multichannel audio signal, a left channel of the multichannel audio signal, a left surround channel of the multichannel audio signal, a right surround channel of the multichannel audio signal, and a low frequency effects channel of the multichannel audio signal.

20. The compu

Assignees

• Immersion Corp

Inventors

• Lacroix Robert
• Bhatia Satvir Singh
• Birnbaum David
• Ullrich Christopher J
• Weddle Amaya Becvar
• Cruz-Hernandez Juan Manuel

Classifications

• H04R3/14

  Cross-over networks · CPC title

• G06F3/165

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• H04S7/307

  Frequency adjustment, e.g. tone control (H04S7/301 takes precedence) · CPC title

• G10L19/018 Primary

  Audio watermarking, i.e. embedding inaudible data in the audio signal · CPC title

• H04S2400/03

  Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1 (H04S2400/01 takes precedence) · CPC title