Systems and Methods for Haptically-Enabled Neural Interfaces

Patent metadata

Field	Value
Publication number	US-2020057500-A1
Application number	US-201916520485-A
Country	US
Kind code	A1
Filing date	Jul 24, 2019
Priority date	Jan 13, 2016
Publication date	Feb 20, 2020
Grant date	—

Abstract

One illustrative system disclosed herein includes a processor configured to receive a sensor signal from a neural interface configured to detect an electrical signal associated with a nervous system. The processor is also configured to determine an interaction in with a virtual object in a virtual environment based on the sensor signal. The processor is also configured to determine a haptic effect based at least in part on the interaction with the virtual object in the virtual environment. The processor is also configured to transmit a haptic signal associated with the haptic effect. The illustrative system further includes a haptic output device configured to receive the haptic signal and output the haptic effect.

First claim

1 - 20 . (canceled)

21 . A system comprising:
a processor; and a memory comprising program code that is executable by the processor to cause the processor to:
receive a sensor signal from a neural interface configured to detect an electrical signal associated with a nervous system;
determine a manipulation of a virtual object in a virtual environment based on the sensor signal;
determine one or more haptic effects based in part on the manipulation of the virtual object in the virtual environment;
transmit a haptic signal associated with the one or more haptic effects to a haptic output device, the haptic signal being configured to cause the haptic output device to output the one or more haptic effects.

22 . The system of claim 1 , wherein the virtual environment comprises an augmented reality environment, a virtual reality environment, or a video game.

23 . The system of claim 1 , wherein the neural interface comprises the haptic output device, and the haptic output device is configured to output the one or more haptic effects by stimulating the nervous system using electrical signals.

24 . The system of claim 1 , wherein the manipulation of the virtual object comprises moving the virtual object in the virtual environment.

25 . The system of claim 1 , wherein the one or more haptic effects are configured to simulate a texture of the virtual object.

26 . The system of claim 1 , wherein the virtual object is a character in a video game.

27 . The system of claim 1 , wherein the memory further comprises program code that is executable by the processor to cause the processor to:
determine a function based at least in part on the manipulation of the virtual object in the virtual environment; and execute the function, wherein the function is configured to cause a user to perceive a sensation based at least in part on the manipulation of the virtual object in the virtual environment.

28 . A method comprising:
receiving, by the processor, a sensor signal from a neural interface configured to detect an electrical signal associated with a nervous system; determining, by the processor, a manipulation of a virtual object in a virtual environment based on the sensor signal; determining, by the processor, one or more haptic effects based in part on a manipulation of the virtual object in the virtual environment; transmitting, by a processor, a haptic signal associated with the one or more haptic effects to a haptic output device, the haptic signal being configured to cause the haptic output device to output the one or more haptic effects.

29 . The method of claim 8 , wherein the virtual environment comprises an augmented reality environment, a virtual reality environment, or a video game.

30 . The method of claim 8 , wherein the neural interface comprises the haptic output device, and the haptic output device is configured to output the one or more haptic effects by stimulating the nervous system using electrical signals.

31 . The method of claim 8 , wherein the manipulation of the virtual object comprises moving the virtual object in the virtual environment.

32 . The method of claim 8 , wherein the one or more haptic effects are configured to simulate a texture of the virtual object.

33 . The method of claim 8 , wherein the virtual object is a character in a video game.

34 . The method of claim 8 , wherein the neural interface is a first neural interface, the method further comprising:
determining, by the processor, a function based at least in part on the manipulation of the virtual object in the virtual environment; and executing, by the processor, the function, wherein the function is configured to cause a user to perceive a sensation based at least in part on the manipulation of the virtual object in the virtual environment.

35 . A non-transitory computer-readable medium comprising program code that is execute-able by a processor to cause the processor to:
receive a sensor signal from a neural interface configured to detect an electrical signal associated with a nervous system; determine a manipulation of a virtual object in a virtual environment based on the sensor signal; determine one or more haptic effects based in part on a manipulation of the virtual object in the virtual environment; transmit a haptic signal associated with the one or more haptic effects to a haptic output device, the haptic signal being configured to cause the haptic output device to output one or more haptic effects.

36 . The non-transitory computer-readable medium of claim 15 , wherein the virtual environment comprises an augmented reality environment, a virtual reality environment, or a video game.

37 . The non-transitory computer-readable medium of claim 15 , wherein the neural interface comprises the haptic output device, and the haptic output device is configured to output the one or more haptic effects by stimulating the nervous system using electrical signals.

38 . The non-transitory computer-readable medium of claim 15 , wherein the virtual object is a character in a video game, and wherein the manipulation of the virtual object comprises moving the virtual object in the virtual environment.

39 . The non-transitory computer-readable medium of claim 15 , wherein the one or more haptic effects are configured to simulate a texture of the virtual object.

40 . The non-transitory computer-readable medium of claim 15 , wherein the neural interface is a first neural interface, and the non-transitory computer-readable medium further comprises program code that is execute-able by the processor to cause the processor to:
determine a function based at least in part on the manipulation of the virtual object in the virtual environment; and execute the function, wherein the function is configured to cause a user to perceive a sensation based at least in part on the manipulation of the virtual object in the virtual environment.

Assignees

• Immersion Corp

Inventors

• Cruz-Hernandez Juan Manuel

Classifications

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F3/015 Primary

  Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection · CPC title

• G06F2203/011

  Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns · CPC title

• G06F3/16

  Sound input; Sound output (speech processing G10L) · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title