Media driven haptics

Patent metadata

Field	Value
Publication number	US-10613628-B2
Application number	US-201514979309-A
Country	US
Kind code	B2
Filing date	Dec 22, 2015
Priority date	Dec 23, 2014
Publication date	Apr 7, 2020
Grant date	Apr 7, 2020

Abstract

The embodiments are directed toward techniques for modifying a haptic effect that is rendered based on a media stream. Upon receiving the media stream, a haptic drive signal is generated based on the media stream. The haptic drive signal is then applied to render the haptic effect at a haptic output device. Within a media editing application, the media stream may be modified. In response to the modification, a modified haptic drive signal may be generated based on the modification to the media stream. As a result, a modified haptic effect is rendered at the haptic output device.

First claim

We claim:

1. A method for generating a haptic effect that is rendered based on a media data stream originating from an application, the method comprising:
receiving the media data stream originating from the application;
receiving, within a media editing application, a modification to the media data stream to provide a modified media data stream, the modification including modifying a value of one or more characteristics of the media data stream;
generating a haptic drive signal based on the modified media data stream, wherein the modified media data stream does not comprise embedded haptic data; and
applying the haptic drive signal to render the haptic effect at a haptic output device.

2. The method according to claim 1 , wherein the media data stream includes an audio data stream.

3. The method according to claim 1 , wherein the media data stream includes audio and video data streams.

4. The method according to claim 1 , wherein the media data stream includes an interleaved multi-channel audio stream.

5. The method according to claim 1 , wherein the haptic output device is disposed at a peripheral device comprising a controller or gamepad.

6. The method according to claim 1 , wherein the haptic effect is rendered at a user input element of a peripheral device.

7. The method according to claim 1 , wherein the haptic effect is rendered at a trigger element of a peripheral device.

8. The method according to claim 1 , wherein the haptic drive signal is generated based on the modified media data stream using a offline haptic converter.

9. A device comprising:
a processor; and
a memory storing a program for execution by the processor, the program including instructions for:
receiving a media data stream originating from an application;
receiving, within a media editing application, a modification to the media data stream to provide a modified media data stream, the modification including modifying a value of one or more characteristics of the media data stream;
generating a haptic drive signal based on the modified media data stream, wherein the modified media data stream does not comprise embedded haptic data; and
applying the haptic drive signal to render a haptic effect at a haptic output device.

10. The device according to claim 9 , wherein the media data stream includes an audio data stream.

11. The device according to claim 9 , wherein the media data stream includes audio and video data streams.

12. The device according to claim 9 , wherein the media data stream includes an interleaved multi-channel audio stream.

13. The device according to claim 9 , wherein the haptic output device is disposed at a peripheral device comprising a controller or gamepad.

14. The device according to claim 9 , wherein the haptic effect is rendered at a user input element of a peripheral device.

15. The device according to claim 9 , wherein the haptic effect is rendered at a trigger element of a peripheral device.

16. The device according to claim 9 , wherein the haptic drive signal is generated based on the modified media data stream using a offline haptic converter.

17. A non-transitory computer readable storage medium storing a program configured to be executed by a processor, the program comprising instructions for:
receiving a media data stream originating from an application;
receiving, within a media editing application, a modification to the media data stream to provide a modified media data stream, the modification including modifying a value of one or more characteristics of the media data stream;
generating a haptic drive signal based on the modified media data stream, wherein the modified media data stream does not comprise embedded haptic data; and
applying the haptic drive signal to render a haptic effect at a haptic output device.

18. The non-transitory computer readable storage medium of claim 17 , wherein the media data stream includes an audio data stream.

19. The non-transitory computer readable storage medium of claim 17 , wherein the media data stream includes audio and video data streams.

20. The non-transitory computer readable storage medium of claim 17 , wherein the media data stream includes an interleaved multi-channel audio stream.

21. The non-transitory computer readable storage medium of claim 17 , wherein the haptic output device is disposed at a peripheral device comprising a controller or gamepad.

22. The non-transitory computer readable storage medium of claim 17 , wherein the haptic effect is rendered at a user input element of a peripheral device.

23. The non-transitory computer readable storage medium of claim 17 , wherein the haptic effect is rendered at a trigger element of a peripheral device.

24. The non-transitory computer readable storage medium of claim 17 , wherein the haptic drive signal is generated based on the modified media data stream using a offline haptic converter.

25. The method according to claim 1 , wherein the haptic drive signal is generated in real-time, or substantially real-time.

Assignees

• Immersion Corp

Inventors

• Venkatesan Srivatsav
• Shah Kaniyalal
• Rank Stephen
• Rihn William S

Classifications

• A63F13/285

  Generating tactile feedback signals via the game input device, e.g. force feedback · CPC title

• G06F3/016 Primary

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• A63F13/23 Primary

  for interfacing with the game device, e.g. specific interfaces between game controller and console · CPC title

• G06F2203/015

  Force feedback applied to a joystick · CPC title

• A63F13/42

  by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle · CPC title