Systems and methods for generating haptic effects associated with audio signals

Patent metadata

Field	Value
Publication number	US-10388122-B2
Application number	US-201815918242-A
Country	US
Kind code	B2
Filing date	Mar 12, 2018
Priority date	Sep 6, 2013
Publication date	Aug 20, 2019
Grant date	Aug 20, 2019

Abstract

Systems and methods for generating haptic effects associated with audio signals are disclosed. One disclosed system for outputting haptic effects includes a processor configured to: receive an audio signal; determine a haptic effect based in part on the audio signal by: identifying one or more components in the audio signal; and determining a haptic effect associated with the one or more components; and output a haptic signal associated with the haptic effect.

First claim

What is claimed:

1. A system for identifying haptic effects from audio signals comprising:
a processor configured to:
receive an audio signal configured to be output by an audio output device to output an audible effect;
identify one or more audio components in the audio signal;
identify background noises in the audio signal;
determine a haptic effect to be output by a haptic output device, the haptic effect associated with the one or more audio components; and
store the haptic effect in a haptic track on a data store.

2. The system of claim 1 , wherein the processor is further configured to determine not to output a haptic effect associated with the background noises.

3. The system of claim 1 , wherein identifying one or more audio components of the audio signal comprises:
receiving a signal associated with one or more audio components;
dividing the audio signal into a plurality of segments;
analyzing one of the plurality of segments to determine if one or more of the components is present; and
classifying the segment based on a presence of one or more of the components.

4. The system of claim 3 , wherein analyzing one of the plurality of segments comprises implementing an acoustic event detection technique.

5. The system of claim 4 , wherein the acoustic event detection technique comprises automatic speech recognition.

6. The system of claim 3 , wherein classifying one of the plurality of segments comprises comparing the segment to a database of data associated with the one or more components.

7. The system of claim 3 , wherein determining a haptic effect comprises assigning a haptic effect based on the classification of the segment.

8. The system of claim 1 , wherein identifying one or more audio components of the audio signal comprises isolating speech in the audio signal.

9. The system of claim 1 , wherein identifying one or more audio components of the audio signal comprises isolating sounds associated with action effects in the audio signal.

10. The system of claim 1 , further comprising a haptic output device configured to receive the haptic signal and output the haptic effect.

11. A method for identifying haptic effects from audio signals comprising:
receiving an audio signal configured to be output by an audio output device to output an audible effect;
identifying one or more audio components in the audio signal;
identifying background noises in the audio signal;
determining a haptic effect to be output by a haptic output device, the haptic effect associated with the one or more audio components; and
storing the haptic effect in a haptic track on a data store.

12. The method of claim 11 , further comprising determining not to output a haptic effect associated with the background noises.

13. The method of claim 11 , wherein identifying one or more audio components of the audio signal comprises:
receiving a signal associated with one or more audio components;
dividing the audio signal into a plurality of segments;
analyzing one of the plurality of segments to determine if one or more of the components is present; and
classifying the segment based on a presence of one or more of the components.

14. The method of claim 13 , wherein analyzing one of the plurality of segments comprises implementing an acoustic event detection technique.

15. The method of claim 14 , wherein the acoustic event detection technique comprises automatic speech recognition.

16. The method of claim 13 , wherein classifying one of the plurality of segments comprises comparing the segment to a database of data associated with the one or more components.

17. The method of claim 13 , wherein determining a haptic effect comprises assigning a haptic effect based on the classification of the segment.

18. The method of claim 11 , wherein identifying one or more audio components of the audio signal comprises isolating speech in the audio signal.

19. The method of claim 11 , wherein identifying one or more audio components of the audio signal comprises isolating sounds associated with action effects in the audio signal.

20. A non-transitory computer readable medium comprising program code, which when executed by a processor, is configured to cause the processor to:
receive an audio signal configured to be output by an audio output device to output an audible effect;
identify one or more audio components in the audio signal;
identify background noises in the audio signal;
determine a haptic effect to be output by a haptic output device, the haptic effect associated with the one or more audio components; and
store the haptic effect in a haptic track on a data store.

21. The system of claim 1 , wherein the processor is further configured to output a haptic signal associated with the haptic effect to the haptic output device.

22. The method of claim 11 , further comprising outputting a haptic signal associated with the haptic effect to the haptic output device.

23. The non-transitory computer readable medium of claim 20 , further comprising program code, which when executed by the processor is configured to cause the processor to output a haptic signal associated with the haptic effect to the haptic output device.

Assignees

• Immersion Corp
• Immerson Corp

Inventors

• Cruz-Hernandez Juan Manuel
• Saboune Jamal
• Levesque Vincent
• Modarres Ali

Classifications

• G08B6/00 Primary

  Tactile signalling systems, e.g. tactile personal calling systems · CPC title

• G06F3/165

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• G06F3/016 Primary

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G10L15/26

  Speech to text systems (G10L15/08 takes precedence) · CPC title