Systems and methods for recording haptic data for use with multi-media data

Patent metadata

Field	Value
Publication number	US-2016180879-A1
Application number	US-201414576589-A
Country	US
Kind code	A1
Filing date	Dec 19, 2014
Priority date	Dec 19, 2014
Publication date	Jun 23, 2016
Grant date	—

Abstract

A system includes a recorder configured to record audio and/or video of a subject of interest and output a recording of the subject of interest and a non-contact sensor associated with the recorder. The non-contact sensor is constructed and arranged to measure movement and/or vibration of the subject of interest from substantially the same perspective and at the same time as the recorder. The system includes a controller configured to transform the measured movement and/or vibration of the subject of interest measured by the non-contact sensor into a tactile data stream for sending to a haptic display device for playback with the recording of the subject of interest by the recorder and providing haptic effects corresponding to the measured movement and/or vibration to a user of the haptic display device in synchronization with the recording.

First claim

What is claimed is:

1 . A system comprising:
a recorder configured to record audio and/or video of a subject of interest and output a recording of the subject of interest; a non-contact sensor associated with the recorder, the non-contact sensor constructed and arranged to measure movement and/or vibration of the subject of interest from substantially the same perspective and at the same time as the recorder; and a controller configured to transform the measured movement and/or vibration of the subject of interest measured by the non-contact sensor into a tactile data stream for sending to a haptic display device for playback with the recording of the subject of interest by the recorder and providing haptic effects corresponding to the measured movement and/or vibration to a user of the haptic display device in synchronization with the recording.

2 . The system according to claim 1 , wherein the non-contact sensor comprises a laser vibrometer.

3 . The system according to claim 1 , wherein the non-contact sensor comprises a tracking device.

4 . The system according to claim 1 , wherein the non-contact sensor comprises video stream analysis algorithms.

5 . The system according to claim 1 , wherein the recorder and the non-contact sensor are co-located.

6 . The system according to claim 1 , further comprising a first servomechanism controlled by the controller and constructed and arranged to move the non-contact sensor to a position and/or orientation having substantially the same perspective as the recorder.

7 . The system according to claim 6 , further comprising a second servomechanism controlled by the controller and constructed and arranged to move the recorder, wherein the first servomechanism is synchronized with the second servomechanism so that movement of the non-contact sensor is synchronized with movement of the recorder.

8 . The system according to claim 1 , further comprising a second sensor constructed and arranged to be in contact with the subject being recorded by the recorder and to sense movement and/or vibration of the subject, wherein the controller is further configured to combine data received from the non-contact sensor and the second sensor and transform the combined data into the tactile data stream.

9 . The system according to claim 8 , wherein the controller comprises a transformer constructed and arranged to mix sensors signals having different sampling rates and/or sensitivity and output the transformed combined data.

10 . A method comprising:
recording audio and/or video of a subject of interest with a recorder; measuring movement and/or vibration of the subject of interest with a non-contact sensor associated with and having substantially the same perspective as the recorder; and transforming, with a controller, the measured movement and/or vibration into a tactile data stream for sending to a haptic display device for playback with the recording of the audio and/or video of the subject of interest and providing haptic effects corresponding to the measured movement and/or vibration to a user of the haptic display device in synchronization with the recording.

11 . The method according to claim 10 , further comprising moving the non-contact sensor, with a first servomechanism controlled by the controller, to a position having substantially the same perspective as the recorder as the recorder moves and changes perspective.

12 . The method according to claim 11 , further comprising moving the recorder, with a second servomechanism controlled by the controller, wherein the first servomechanism is synchronized with the second servomechanism so that movement of the non-contact sensor is synchronized with movement of the recorder.

13 . The method according to claim 10 , further comprising
sensing movement and/or vibration of the subject of interest with a second sensor in contact with the subject of interest; combining data received from the non-contact sensor and the second sensor; and transforming the combined data into the tactile data stream.

14 . The method according to claim 13 , further comprising transforming sensor signals having different sampling rates and/or sensitivity and outputting the transformed combined data.

Assignees

• Immersion Corp

Inventors

• Ullrich Christopher J
• Lacroix Robert

Classifications

• H04N9/8205

  involving the multiplexing of an additional signal and the colour video signal · CPC title

• G11B27/10

  Indexing; Addressing; Timing or synchronising; Measuring tape travel · CPC title

• H04N5/765 Primary

  Interface circuits between an apparatus for recording and another apparatus · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• H04N21/42201

  biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user (input arrangements for interaction with the human body based on nervous system activity detection G06F3/015) · CPC title