Using haptic technologies to provide enhanced media experiences

Patent metadata

Field	Value
Publication number	US-10013857-B2
Application number	US-201213594502-A
Country	US
Kind code	B2
Filing date	Aug 24, 2012
Priority date	Dec 21, 2011
Publication date	Jul 3, 2018
Grant date	Jul 3, 2018

Abstract

Methods, apparatuses, systems, and computer-readable media for using haptic technologies to provide enhanced media experiences are presented. According to one or more aspects of the disclosure, a computing device, such as a smart phone, tablet computer, or portable media player, may establish a connection with a local content receiver. Subsequently, the computing device may receive, from the local content receiver, a sensation data signal that specifies one or more haptic effects to be provided at a particular time relative to playback of a media content item received by the local content receiver. Thereafter, the computing device may provide the one or more haptic effects.

First claim

What is claimed is:

1. A method comprising:
establishing, by a computing device, a connection with a local content receiver providing a content stream for display;
receiving, by the computing device, from the local content receiver a sensation data signal associated with the content stream being provided for display, the sensation data signal including sensation data information that specifies one or more haptic effects to be provided while the content stream is displayed, wherein the sensation data information includes one or more markers within the content stream associating the one or more haptic effects with particular points of the content stream provided by the local content receiver;
detecting, by the computing device, that the content stream is being provided for display;
detecting, by the computing device, a particular portion of the content stream being provided for display while the content stream is being provided for display by the local content receiver, the particular portion being associated with the one or more haptic effects according to the sensation data information; and
providing, by the computing device, the one or more haptic effects in synchronization with the particular portion of the content stream.

2. The method of claim 1 , wherein establishing the connection with the local content receiver further includes:
detecting the local content receiver on a wireless area network; and
sending registration information to the local content receiver.

3. The method of claim 2 , wherein the registration information includes device capability information.

4. The method of claim 1 , further comprising:
notifying, by the computing device, the local content receiver of haptic feedback capabilities of the computing device; and
wherein detecting that the content stream is being provided for display occurs prior to receiving the sensation data signal and includes capturing audio data or video data corresponding to a playback of the content stream.

5. The method of claim 1 , further comprising:
prior to providing the one or more haptic effects, determining whether activity is detected.

6. The method of claim 5 , wherein determining whether activity is detected includes determining whether the computing device is in motion or at rest.

7. The method of claim 5 , wherein determining whether activity is detected includes determining whether the computing device is being held by a user.

8. The method of claim 1 , further comprising:
detecting a new content stream associated with a second media content item;
and
providing one or more additional haptic effects based on data received from the local content receiver.

9. The method of claim 8 , further comprising:
prior to providing the one or more additional haptic effects, waiting for a predetermined amount of time.

10. The method of claim 1 , wherein the one or more haptic effects have a logical relationship to associated images or associated audio of the content stream and are synchronized to occur during a display of the associated images of the content stream or a projection of the associated audio of the content stream.

11. At least one non-transitory computer-readable medium having computer-executable instructions stored thereon that, when executed, cause a computing device to:
establish, by a computing device, a connection with a local content receiver providing a content stream for display;
receive, by the computing device, from the local content receiver a sensation data signal associated with the content stream being provided for display, the sensation data signal including sensation data information that specifies one or more haptic effects to be provided while the content stream is displayed, wherein the sensation data information includes one or more markers within the content stream associating the one or more haptic effects with particular points of the content stream provided by the local content receiver;
detect, by the computing device, that the content stream is being provided for display;
detect, by the computing device, a particular portion of the content stream being provided for display while the content stream is being provided for display by the local content receiver, the particular portion being associated with the one or more haptic effects according to the sensation data information; and
provide, by the computing device, the one or more haptic effects in synchronization with the particular portion of the content stream.

12. The at least one non-transitory computer-readable medium of claim 11 , wherein establishing the connection with the local content receiver further includes:
detecting the local content receiver on a wireless area network; and
sending registration information to the local content receiver.

13. The at least one non-transitory computer-readable medium of claim 12 , wherein the registration information includes device capability information.

14. The at least one non-transitory computer-readable medium of claim 11 , further comprising:
notify, by the computing device, the local content receiver of haptic feedback capabilities of the computing device; and
wherein detecting that the content stream is being provided for display occurs prior to receiving the sensation data signal and includes capturing audio data or video data corresponding to a playback of the content stream.

15. The at least one non-transitory computer-readable medium of claim 11 , having additional computer-executable instructions stored thereon that, when executed, further cause the computing device to:
prior to providing the one or more haptic effects, determine whether activity is detected.

16. The at least one non-transitory computer-readable medium of claim 15 , wherein determining whether activity is detected includes determining whether the computing device is in motion or at rest.

17. The at least one non-transitory computer-readable medium of claim 15 , wherein determining whether activity is detected includes determining whether the computing device is being held by a user.

18. The at least one non-transitory computer-readable medium of claim 11 , having additional computer-executable instructions stored thereon that, when executed, further cause the computing device to:
detect a new content stream associated with a second media content item;
and
provide one or more additional haptic effects based on data received from the local content receiver.

19. The at least one non-transitory computer-readable medium of claim 18 , having additional computer-executable instructions stored thereon that, when executed, further cause the computing device to:
prior to providing the one or more additional haptic effects, wait for a predetermined amount of time.

20. The at least one non-transitory computer-readable medium of claim 11 , wherein the one or more haptic effects have a logical relationship to associated images or associated audio of the content stream and are synchronized to occur during a display of the associated images of the content stream or a projection of the associated audio of the content stream.

21. An apparatus comprising:
at least one processor; and
memory storing computer-readable instructions that, when executed by the at least one processor, cause the apparatus to:
establish, by a computing device, a connection with a local content receiver providing a content stream for display;
receive, by the computing device, from the local content receiver a sensation data signal associa

Assignees

• Sridhara Vinay
• Das Saumitra Mohan
• Sheynblat Leonid
• Qualcomm Inc

Inventors

• Sridhara Vinay
• Das Saumitra Mohan
• Sheynblat Leonid

Classifications

• H04N21/235

  Processing of additional data, e.g. scrambling of additional data or processing content descriptors · CPC title

• H04N21/435

  Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream · CPC title

• H04N21/8547

  involving timestamps for synchronizing content · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• H04N21/43637

  involving a wireless protocol, e.g. Bluetooth®, RF or wireless LAN [IEEE 802.11] (arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114) · CPC title