Haptic sensation recording and playback

Patent metadata

Field	Value
Publication number	US-9261960-B2
Application number	US-201313804692-A
Country	US
Kind code	B2
Filing date	Mar 14, 2013
Priority date	Jan 24, 2013
Publication date	Feb 16, 2016
Grant date	Feb 16, 2016

Abstract

A system includes a video recorder configured to record video data, a sensor configured to sense movement of an object and output sensor data representative of the movement of the object, a transformer configured to transform the sensor data into a haptic output signal, a haptic output device configured to generate a haptic effect to a user based on the haptic output signal, a display configured to display a video, and a processor configured to synchronize the video data and the haptic output signal, and output the video data to the display and the haptic output signal to the haptic output device so that the haptic effect is synchronized with the video displayed on the display.

First claim

What is claimed is:

1. A system comprising:
a video recorder configured to record video data;
a sensor configured to sense movement of an object and output sensor data representative of the movement of the object;
a transformer configured to transform the sensor data into a haptic output signal;
a haptic output device configured to generate a haptic effect to a user based on the haptic output signal;
a display configured to display a video; and
a processor configured to synchronize the video data and the haptic output signal, and output the video data to the display and the haptic output signal to the haptic output device so that the haptic effect is synchronized with the video displayed on the display,
wherein the sensor data comprises X-Y-Z acceleration components, wherein the transformer is configured to generate an acceleration magnitude signal based on the X-Y-Z acceleration components and filter the acceleration magnitude signal to filter out frequency content outside of a predetermined range, and wherein the haptic output signal is based on the filtered acceleration magnitude signal.

2. The system according to claim 1 , further comprising an audio recorder configured to record audio data, and a speaker configured to project sound, wherein the processor is further configured to receive the audio data, synchronize the audio data with the video data and the haptic output signal, and output the audio data to the speaker so that the sound is synchronized with the video displayed on the display and the haptic effect generated by the haptic output device.

3. The system according to claim 2 , wherein the video recorder, the audio recorder, and the sensor are part of the same electronic device.

4. The system according to claim 2 , wherein the haptic output device, the display, and the speaker are part of the same electronic device.

5. The system according to claim 2 , wherein the video recorder, audio recorder, the sensor, the haptic output device, the display, the speaker, and the processor are part of the same electronic device.

6. The system according to claim 1 , wherein the haptic output device and the display are part of the same electronic device.

7. The system according to claim 1 , wherein the processor comprises the transformer, and further comprises a decoder configured to synchronize the video data and the haptic output signal.

8. The system according to claim 1 , wherein the sensor is selected from the group consisting of: an accelerometer, a gyroscope, and a contact pressure sensor.

9. The system according to claim 1 , wherein the system comprises a plurality of sensors, and wherein the plurality of sensors are selected from the group consisting of: an accelerometer, a gyroscope, and a contact pressure sensor.

10. A system comprising:
a display configured to display a video;
a video recorder configured to record video data;
a sensor configured to sense movement of an object and output sensor data representative of the movement of the object;
a transformer configured to transform the sensor data into a haptic output signal; and
an electronic handheld device comprising
a haptic output device configured to generate a haptic effect to a user of the handheld device based on the haptic output signal; and
a processor configured to synchronize the video data and the haptic output signal, and output the video data to the display and the haptic output signal to the haptic output device so that the haptic effect is synchronized with the video displayed on the display,
wherein the sensor data comprises X-Y-Z acceleration components, wherein the transformer is configured to generate an acceleration magnitude signal based on the X-Y-Z acceleration components and filter the acceleration magnitude signal to filter out frequency content outside of a predetermined range, and wherein the haptic output signal is based on the filtered acceleration magnitude signal.

11. The system according to claim 10 , further comprising an audio recorder configured to record audio data, and a speaker configured to project sound, wherein the processor is further configured to receive the audio data, synchronize the audio data with the video data and the haptic output signal, and output the audio data to the speaker so that the sound is synchronized with the video displayed on the display and the haptic effect generated by the haptic output device.

12. A method comprising:
recording a video with a video recorder;
sensing movement of an object being recorded in the video with a sensor;
transforming the sensed movement into a haptic output signal; and
synchronizing the video and the haptic output signal,
wherein the sensing movement of the object being recorded in the video with the sensor comprises sensing X-Y-Z acceleration components, and
wherein the transforming the sensed movement into the haptic output signal comprises
generating an acceleration magnitude signal based on the X-Y-Z acceleration components; and
filtering the acceleration magnitude signal to filter out frequency content outside of a predetermined range, wherein the haptic output signal is based on the filtered acceleration magnitude signal.

13. The method according to claim 12 , further comprising:
generating at least one haptic effect based on the haptic output signal; and
displaying the video on a display in synchronization with the haptic effect.

14. The method according to claim 12 , further comprising recording audio with an audio recorder and synchronizing the audio with the video and the haptic output signal.

15. The method according to claim 14 , further comprising generating a haptic effect based on the haptic output signal, displaying the video on a display, and projecting the audio with a speaker so that the haptic effect is synchronized with the video displayed on the display and the audio projected by the speaker.

16. The method according to claim 12 , wherein the sensor is selected from the group consisting of: an accelerometer, a gyroscope, and a contact pressure sensor.

17. A system comprising:
a video recorder configured to record video data;
a sensor configured to sense movement of an object and output sensor data representative of the movement of the object;
a transformer configured to transform the sensor data into a haptic output signal;
a haptic output device configured to generate a haptic effect to a user based on the haptic output signal;
a display configured to display a video; and
a processor configured to synchronize the video data and the haptic output signal, and output the video data to the display and the haptic output signal to the haptic output device so that the haptic effect is synchronized with the video displayed on the display,
wherein the sensor data comprises X-Y-Z acceleration components, wherein the transformer is configured to translate the X-Y-Z acceleration components from a time-domain into a frequency domain, combine the X-Y-Z acceleration components in the frequency domain into a single acceleration signal, and translate the single acceleration signal from the frequency domain into the time-domain, and wherein the haptic output signal is based on the single acceleration signal in the time-domain.

18. The system according to claim 17 , wherein the transformer is further configured to up-sample the single acceleration signal from an original sampling rate to a higher sampling rate, and multiply the up-sampled single acceleration signal by sine waves with random frequencies, and wherein the haptic output signal is based on the mul

Assignees

• Immersion Corp

Inventors

• Lacroix Robert
• Cruz-Hernandez Juan Manuel
• Saboune Jamal

Classifications

• H04N21/435

  Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream · CPC title

• G06F3/016 Primary

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• H04N21/4131

  home appliance, e.g. lighting, air conditioning system, metering devices (home automation data switching networks exchanging configuration information on appliance services H04L12/2807) · CPC title

• H04N21/4223

  Cameras (H04N23/00 takes precedence) · CPC title

• H04N21/4334

  Recording operations (recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27) · CPC title