Method and apparatus for encoding and decoding haptic information in multi-media files

Patent metadata

Field	Value
Publication number	US-9992491-B2
Application number	US-201313842912-A
Country	US
Kind code	B2
Filing date	Mar 15, 2013
Priority date	Mar 15, 2013
Publication date	Jun 5, 2018
Grant date	Jun 5, 2018

Abstract

A method for encoding haptic information inside a multi-media file having content includes changing a portion of the content in the multi-media file, and adding the haptic information to the changed portion of the content, the haptic information corresponding to a haptic signal for generating a haptic effect upon playback of the multi-media file. A method for decoding haptic information from inside a multi-media file having content includes locating the haptic information inside the multi-media file, and generating a haptic signal based on the located haptic information during playback of the content of the multi-media file. A method includes receiving a multi-media signal comprising an audio signal and a haptic signal with a receiver of a haptic device, and outputting a haptic effect with a haptic output device of the haptic device based on the haptic signal in the multi-media signal.

First claim

What is claimed is:

1. A method for encoding haptic information inside a multi-media file having content, the method comprising:
changing a portion of the content in the multi-media file, the content including an audio stream having a sampling frequency;
adding a haptic trigger mark to the audio stream, the haptic trigger mark corresponding to a haptic signal for generating a haptic effect upon playback of the multi-media file, the haptic trigger mark having an encoding frequency and a time duration,
wherein the sampling frequency divided by the encoding frequency is an integer number.

2. The method according to claim 1 , wherein the content of the multi-media file includes a video stream.

3. The method according to claim 1 , wherein the time duration is an integer multiple of the inverse of the encoding frequency.

4. The method according to claim 1 , wherein said changing comprises removing a portion of the audio stream from the multi-media file, and wherein the haptic trigger mark is added in place of the removed portion of the audio stream.

5. The method according to claim 4 , wherein said removing the portion of the audio stream from the multi-media file comprises filtering the audio stream within the multi-media file with a filter.

6. The method according to claim 5 , wherein the filter is a stop band filter having a center frequency corresponding to the encoding frequency of the haptic trigger mark.

7. The method according to claim 1 , wherein said changing comprises rearranging a portion of the audio stream in the multi-media file.

8. A haptic device method for decoding haptic information from inside a multi-media file having content, the method comprising:
locating a haptic trigger mark inside the content of the multi-media file, the content including an audio stream having a sampling frequency, the haptic trigger mark corresponding to a haptic signal for generating a haptic effect upon playback of the multi-media file, the haptic trigger mark having an encoding frequency and a time duration; and
generating a haptic signal based on the located haptic trigger mark during playback of the content of the multi-media file,
wherein the sampling frequency divided by the encoding frequency is an integer number.

9. The method according to claim 8 , wherein said locating the haptic trigger mark comprises filtering the content with a filter at the encoding frequency of the haptic trigger mark.

10. The method according to claim 8 , wherein the filter is a bandpass filter.

11. A haptic device comprising:
a media output device configured to output media content in a media file, the media content including an audio stream having a sampling frequency;
a processor configured to:
open the media file,
decode a haptic trigger mark encoded in the audio stream of the content of the media file, the haptic trigger mark corresponding to a haptic signal for generating a haptic effect upon playback of the media file, the haptic trigger mark having an encoding frequency and a time duration,
output a haptic signal based on the haptic trigger mark decoded from the media file; and

a haptic output device configured to output a haptic effect based on the haptic signal received from the processor,
wherein the sampling frequency divided by the encoding frequency is an integer number.

12. The haptic device according to claim 11 , wherein the time duration is an integer multiple of the inverse of the encoding frequency.

13. The haptic device according to claim 11 , wherein the content of the media file further comprises a video stream and the media output device is configured to display the video stream.

14. The haptic device according to claim 11 , wherein the media output device is configured to playback the audio stream.

15. The haptic device according to claim 11 , wherein the processor comprises a filter configured to filter the media content to determine a location of the haptic trigger mark within the media content, and wherein the processor is configured to synchronize the haptic signal with the media content so that the haptic effect output by the haptic output device and the media content output by the media output device are synchronized.

16. The haptic device according to claim 15 , wherein the filter is a bandpass filter.

17. The haptic device according to claim 11 , wherein the processor is further configured to encode the haptic trigger mark in the media file.

18. The haptic device according to claim 17 , wherein the processor comprises a filter configured to remove a portion of the media content from the media file.

19. The haptic device according to claim 18 , wherein the filter is a stop band filter having a center frequency corresponding to the encoding frequency of the haptic trigger mark.

Assignees

• Immersion Corp

Inventors

• Sen Arnab
• Ullrich Christopher J
• Cruz-Hernandez Juan Manuel
• Modarres Ali

Classifications

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• H04N9/87

  Regeneration of colour television signals (H04N9/80 takes precedence) · CPC title

• G06F3/165

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• H04N21/4394

  involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58) · CPC title

• H04N21/42203

  sound input device, e.g. microphone · CPC title