Systems and Methods for Haptically-Enabled Neural Interfaces

Patent metadata

Field	Value
Publication number	US-2018341331-A1
Application number	US-201816016824-A
Country	US
Kind code	A1
Filing date	Jun 25, 2018
Priority date	Jan 13, 2016
Publication date	Nov 29, 2018
Grant date	—

Abstract

One illustrative system disclosed herein includes a processor configured to receive a sensor signal from a neural interface configured to detect an electrical signal associated with a nervous system. The processor is also configured to determine an interaction in with a virtual object in a virtual environment based on the sensor signal. The processor is also configured to determine a haptic effect based at least in part on the interaction with the virtual object in the virtual environment. The processor is also configured to transmit a haptic signal associated with the haptic effect. The illustrative system further includes a haptic output device configured to receive the haptic signal and output the haptic effect.

First claim

1 - 20 . (canceled)

21 . A computing device comprising:
a processor; and a memory comprising program code that is executable by the processor to cause the processor to:
detect an event in a virtual environment;
determine a haptic effect based on the event; and
transmit a haptic signal to a neural interface configured to detect one or more electrical signals produced by a nervous system, the haptic signal being configured to cause the neural interface to electrically stimulate at least a portion of the nervous system to produce the haptic effect.

22 . The computing device of claim 21 , wherein the virtual environment is a video game environment.

23 . The computing device of claim 21 , wherein the memory further comprises program code that is executable by the processor to cause the processor to:
detect an interaction with a virtual object in the virtual environment; determine that a user is to perceive a stimulus based on the interaction, wherein the stimulus is a taste, smell, or sound; and use the neural interface to electrically stimulate the nervous system with one or more electrical pulses configured to cause the user to perceive the stimulus.

24 . The computing device of claim 21 , wherein the haptic effect is a first haptic effect, and wherein the memory further comprises program code that is executable by the processor to cause the processor to:
determine that a user perceived a stimulus based on a signal from the neural interface; determine a second haptic effect based on the stimulus perceived by the user; and cause a haptic output device to output the second haptic effect.

25 . The computing device of claim 24 , wherein the stimulus perceived by the user includes at least one of a smell, a taste, or a sound, and wherein the haptic output device is coupled to a remote computing device.

26 . The computing device of claim 21 , wherein the memory further comprises program code that is executable by the processor to cause the processor to:
determine that a user perceived a stimulus based on a signal from the neural interface; and transmit information indicative of the stimulus to a remote computing device.

27 . The computing device of claim 21 , wherein the haptic effect is a first haptic effect, and wherein the memory further comprises program code that is executable by the processor to cause the processor to:
determine that a user contacted a physical object based on one or more signals from the neural interface; determine a texture of the physical object based on the one or more signals from the neural interface; and determine a second haptic effect based on the texture of the physical object; and cause a haptic output device to produce the second haptic effect.

28 . The computing device of claim 27 , wherein the second haptic effect is configured to manipulate how the texture of the physical object is perceived by the user.

29 . A method comprising:
detecting, by a processor, an event in a virtual environment; determining, by the processor, a haptic effect based on the event; and transmitting, by the processor, a haptic signal to a neural interface configured to detect one or more electrical signals produced by a nervous system, the haptic signal being configured to cause the neural interface to electrically stimulate at least a portion of the nervous system to produce the haptic effect.

30 . The method of claim 29 , further comprising:
detecting an interaction with a virtual object in the virtual environment; determining that a user is to perceive a stimulus based on the interaction, wherein the stimulus is a taste, smell, or sound; and using the neural interface to electrically stimulate the nervous system with one or more electrical pulses configured to cause the user to perceive the stimulus.

31 . The method of claim 29 , wherein the haptic effect is a first haptic effect, and further comprising:
determining that a user perceived a stimulus based on a signal from the neural interface; determining a second haptic effect based on the stimulus perceived by the user; and causing a haptic output device to output the second haptic effect.

32 . The method of claim 31 , wherein the stimulus perceived by the user includes at least one of a smell, a taste, or a sound.

33 . The method of claim 29 , further comprising:
determining that a user perceived a stimulus based on a signal from the neural interface; and transmitting information indicative of the stimulus to a remote computing device.

34 . The method of claim 29 , wherein the haptic effect is a first haptic effect, and further comprising:
determining that a user contacted a physical object based on one or more signals from the neural interface; determining a texture of the physical object based on the one or more signals from the neural interface; and determining a second haptic effect based on the texture of the physical object; and causing a haptic output device to produce the second haptic effect.

35 . The method of claim 34 , wherein the second haptic effect is configured to manipulate how the texture of the physical object is perceived by the user.

36 . A non-transitory computer-readable medium comprising program code that is executable by a processor to cause the processor to:
detect an event in a virtual environment; determine a haptic effect based on the event; and transmit a haptic signal to a neural interface configured to detect one or more electrical signals produced by a nervous system, the haptic signal being configured to cause the neural interface to electrically stimulate at least a portion of the nervous system to produce the haptic effect.

37 . The non-transitory computer-readable medium of claim 36 , further comprising program code that is executable by the processor to cause the processor to:
detect an interaction with a virtual object in the virtual environment; determine that a user is to perceive a stimulus based on the interaction, wherein the stimulus is a taste, smell, or sound; and use the neural interface to electrically stimulate the nervous system with one or more electrical pulses configured to cause the user to perceive the stimulus.

38 . The non-transitory computer-readable medium of claim 36 , wherein the haptic effect is a first haptic effect, and further comprising program code that is executable by the processor to cause the processor to:
determine that a user perceived a stimulus based on a signal from the neural interface; determine a second haptic effect based on the stimulus perceived by the user; and cause a haptic output device to output the second haptic effect.

39 . The non-transitory computer-readable medium of claim 38 , wherein the haptic output device is coupled to a remote computing device.

40 . The non-transitory computer-readable medium of claim 36 , further comprising program code that is executable by the processor to cause the processor to:
determine that a user perceived a stimulus based on a signal from the neural interface; and transmit information indicative of the stimulus to a remote computing device.

41 . The non-transitory computer-readable medium of claim 36 , wherein the haptic effect is a first haptic effect, and further comprising program code that is executable by the processor to cause the processor to:
determine that a user contacted a physical object based on one or more signals from the neural interface; determine a texture of the physical object

Assignees

• Immersion Corp

Inventors

• Cruz-Hernadez Juan Manuel

Classifications

• G06F3/015 Primary

  Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection · CPC title

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F2203/011

  Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns · CPC title

• G06F3/16

  Sound input; Sound output (speech processing G10L) · CPC title