Systems and methods for haptically-enabled neural interfaces

Patent metadata

Field	Value
Publication number	US-10386924-B2
Application number	US-201816016824-A
Country	US
Kind code	B2
Filing date	Jun 25, 2018
Priority date	Jan 13, 2016
Publication date	Aug 20, 2019
Grant date	Aug 20, 2019

Abstract

One illustrative system disclosed herein includes a processor configured to receive a sensor signal from a neural interface configured to detect an electrical signal associated with a nervous system. The processor is also configured to determine an interaction in with a virtual object in a virtual environment based on the sensor signal. The processor is also configured to determine a haptic effect based at least in part on the interaction with the virtual object in the virtual environment. The processor is also configured to transmit a haptic signal associated with the haptic effect. The illustrative system further includes a haptic output device configured to receive the haptic signal and output the haptic effect.

First claim

What is claimed:

1. A computing device comprising:
a processor; and
a memory comprising program code that is executable by the processor to cause the processor to:
detect an interaction with a virtual object in a virtual environment;
determine that a user is to perceive a stimulus based on the interaction, wherein the stimulus is a taste, smell, or sound; and
cause a neural interface to stimulate a nervous system of the user in a manner configured to cause the user to perceive the stimulus.

2. The computing device of claim 1 , wherein the neural interface is configured to stimulate the nervous system of the user at least in part by applying an electromagnetic field or an electrical pulse to the nervous system.

3. The computing device of claim 2 , wherein the neural interface is configured to apply the electromagnetic field or the electrical pulse to the user's brain to cause the user to perceive the stimulus.

4. The computing device of claim 1 , wherein the virtual environment is a video game.

5. A computing device comprising:
a processor; and
a memory comprising program code that is executable by the processor to cause the processor to:
determine that a user perceived a stimulus based on a signal from a neural interface, the neural interface being configured to detect one or more electrical signals produced by a nervous system of the user and transmit the signal based on the one or more electrical signals;
determine a haptic effect based on the stimulus perceived by the user; and
cause a haptic output device to output the haptic effect.

6. The computing device of claim 5 , wherein the stimulus perceived by the user includes at least one of a smell, a taste, or a sound, and wherein the haptic output device is coupled to a remote computing device.

7. The computing device of claim 5 , wherein the memory further comprises program code that is executable by the processor to cause the processor to:
transmit information indicative of the stimulus to a remote computing device.

8. The computing device of claim 5 , wherein the memory further comprises program code that is executable by the processor to cause the processor to:
determine one or more characteristics of the signal; and
determine that the user perceived the stimulus by accessing a lookup table comprising relationships between stimuli and sensor-signal characteristics and identifying a correlation between the one or more characteristics of the signal and the stimulus.

9. A computing device comprising:
a processor; and
a memory comprising program code that is executable by the processor to cause the processor to:
determine that a user contacted a physical object based on one or more signals from a neural interface, the neural interface being configured to detect one or more electrical signals produced by a nervous system of the user and transmit the one or more signals based on the one or more electrical signals;
determine a texture of the physical object based on the one or more signals from the neural interface; and
determine a haptic effect based on the texture of the physical object; and
cause a haptic output device to produce the haptic effect.

10. The computing device of claim 9 , wherein the haptic effect is configured to manipulate how the texture of the physical object is perceived by the user.

11. A method comprising:
detecting, by a processor, an interaction with a virtual object in a virtual environment;
determining, by the processor, that a user is to perceive a stimulus based on the interaction, wherein the stimulus is a taste, smell, or sound; and
using, by the processor, a neural interface to stimulate a nervous system of the user in a manner configured to cause the user to perceive the stimulus.

12. The method of claim 11 , wherein the neural interface stimulates the nervous system of the user at least in part by applying an electromagnetic field or an electrical pulse to the nervous system.

13. The method of claim 12 , wherein the neural interface applies the electromagnetic field or the electrical pulse to the user's brain to cause the user to perceive the stimulus.

14. The method of claim 11 , wherein the virtual environment is a video game.

15. A method comprising:
determining, by a processor, that a user perceived a stimulus based on a signal from a neural interface, the neural interface being configured to detect one or more electrical signals produced by a nervous system of the user and transmit the signal based on the one or more electrical signals;
determining, by the processor, a haptic effect based on the stimulus perceived by the user; and
causing, by the processor, a haptic output device to output the haptic effect.

16. The method of claim 15 , wherein the stimulus perceived by the user includes at least one of a smell, a taste, or a sound.

17. The method of claim 15 , further comprising:
transmitting information indicative of the stimulus to a remote computing device.

18. The method of claim 15 , further comprising:
determining one or more characteristics of the signal; and
determining that the user perceived the stimulus by accessing a lookup table comprising relationships between stimuli and sensor-signal characteristics and identifying a correlation between the one or more characteristics of the signal and the stimulus.

19. A method comprising:
determining, by a processor, that a user contacted a physical object based on one or more signals from a neural interface, the neural interface being configured to detect one or more electrical signals produced by a nervous system of the user and transmit the one or more signals based on the one or more electrical signals;
determining, by the processor, a texture of the physical object based on the one or more signals from the neural interface; and
determining, by the processor, a haptic effect based on the texture of the physical object; and
causing, by the processor, a haptic output device to produce the haptic effect.

20. The method of claim 19 , wherein the haptic effect is configured to manipulate how the texture of the physical object is perceived by the user.

Assignees

• Immersion Corp

Inventors

• Cruz-Hernadez Juan Manuel

Classifications

• G06F3/015 Primary

  Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection · CPC title

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F2203/011

  Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns · CPC title

• G06F3/16

  Sound input; Sound output (speech processing G10L) · CPC title