Haptic effect conversion system using granular synthesis

Patent metadata

Field	Value
Publication number	US-9257022-B2
Application number	US-201414475857-A
Country	US
Kind code	B2
Filing date	Sep 3, 2014
Priority date	Jun 14, 2012
Publication date	Feb 9, 2016
Grant date	Feb 9, 2016

Abstract

A system is provided that converts an input, such as audio data, into one or more haptic effects. The system applies a granular synthesis algorithm to the input in order to generate a haptic signal. The system subsequently outputs the one or more haptic effects based on the generated haptic signal. The system can also shift a frequency of the input, and also filter the input, before the system applies the granular synthesis algorithm to the input.

First claim

We claim:

1. A computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor to convert an input into one or more haptic effects, the converting comprising:
receiving the input;
segmenting the input into a plurality of waveforms, wherein each waveform comprises at least a portion of the input;
combining each waveform with an envelope to generate a grain, wherein a plurality of grains are generated;
combining the plurality of grains to generate a cloud, wherein the cloud comprises a representation of the plurality of grains; and
generating the one or more haptic effects based on the cloud.

2. The computer-readable medium of claim 1 , further comprising shifting a frequency of the input, wherein the frequency shifting fails to maintain harmonic relationships between frequencies of the input.

3. The computer-readable medium of claim 1 , further comprising pitch-shifting a frequency of the input, wherein the pitch-shifting maintains harmonic relationships between frequencies of the input.

4. The computer-readable medium of claim 1 , further comprising modulating a magnitude of the one or more haptic effects based on an input pressure on a touchscreen.

5. The computer-readable medium of claim 1 , wherein the generation of one grain of the plurality of grains is triggered based on a position input of a touchscreen.

6. The computer-readable medium of claim 5 , wherein the plurality of grains is organized within a grain sequence and wherein each grain has a position within the grain sequence.

7. The computer-readable medium of claim 6 , wherein each grain is mapped to a position within the touchscreen.

8. The computer-readable medium of claim 7 , wherein the grain generated based on the position input maps to a particular position within the touchscreen.

9. A computer-implemented method for converting an input into one or more haptic effects, the computer-implemented method comprising:
receiving the input;
segmenting the input into a plurality of waveforms, wherein each waveform comprises at least a portion of the input;
combining each waveform with an envelope to generate a grain, wherein a plurality of grains are generated;
combining the plurality of grains to generate a cloud, wherein the cloud comprises a representation of the plurality of grains; and
generating the one or more haptic effects based on the cloud.

10. The computer-implemented method of claim 9 , further comprising modulating a magnitude of the one or more haptic effects based on an input pressure on a touchscreen.

11. The computer-implemented method of claim 9 , wherein the generation of one grain of the plurality of grains is triggered based on a position input of a touchscreen.

12. The computer-implemented method of claim 11 , wherein the plurality of grains is organized within a grain sequence and wherein each grain has a position within the grain sequence.

13. The computer-implemented method of claim 12 , wherein each grain is mapped to a position within the touchscreen.

14. The computer-implemented method of claim 13 , wherein the grain generated based on the position input maps to a particular position within the touchscreen.

15. A system for converting an input into one or more haptic effects, the system comprising:
a memory configured to store a haptic conversion module; and
a processor configured to execute the haptic conversion module stored on the memory;
wherein the haptic conversion module is configured to receive the input;
wherein the haptic conversion module is further configured to segment the input into a plurality of waveforms, wherein each waveform comprises at least a portion of the input;
wherein the haptic conversion module is further configured to combine each waveform with an envelope to generate a grain, wherein a plurality of grains are generated;
wherein the haptic conversion module is further configured to combine the plurality of grains to generate a cloud, wherein the cloud comprises a representation of the plurality of grains; and
wherein the haptic conversion module is further configured to generate the one or more haptic effects based on the cloud.

16. The computer-implemented method of claim 15 , further comprising modulating a magnitude of the one or more haptic effects based on an input pressure on a touchscreen.

17. The system of claim 15 , wherein the generation of one grain of the plurality of grains is triggered based on a position input of a touchscreen.

18. The system of claim 17 , wherein the plurality of grains is organized within a grain sequence and wherein each grain has a position within the grain sequence.

19. The system of claim 18 , wherein each grain is mapped to a position within the touchscreen.

20. The system of claim 19 , wherein the grain generated based on the position input maps to a particular position within the touchscreen.

Assignees

• Immersion Corp

Inventors

• Cruz-Hernandez Juan Manuel
• Modarres Ali
• Wu Liwen
• Birnbaum David

Classifications

• G06F3/016 Primary

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G08B6/00 Primary

  Tactile signalling systems, e.g. tactile personal calling systems · CPC title

• A63F13/424

  involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition · CPC title

• A63F13/285

  Generating tactile feedback signals via the game input device, e.g. force feedback · CPC title