Mobile brain computer interface

Patent metadata

Field	Value
Publication number	US-12072686-B2
Application number	US-202318336342-A
Country	US
Kind code	B2
Filing date	Jun 16, 2023
Priority date	Mar 18, 2019
Publication date	Aug 27, 2024
Grant date	Aug 27, 2024

Abstract

A method includes receiving, by a mobile computing device from an electroencephalogram (EEG) monitoring headset, an incoming wireless communication signal including an EEG data stream. The method may further include processing, by an application running on the mobile computing device, the received EEG data stream to determine at least one actionable command for at least one peripheral device. The method may also include transmitting, by the mobile computing device to the at least one peripheral device, at least one outgoing wireless communication signal including the at least one determined actionable command.

First claim

What is claimed is:

1. A mobile computing device comprising:
at least one processor configured to execute instructions from one or more modules, the one or more modules comprising:
an EEG signal reading module configured to receive an incoming communication signal comprising an EEG data stream;
an external device control module configured to:
determine at least one actionable command;
transmit a first communication signal to a robotic device based on the at least one actionable command to cause active operation of the robotic device; and
transmit a second communication signal to a sensory feedback device to cause the sensory feedback device to provide tactile feedback during operation of the robotic device;

a feedback receiving module; and
an avatar generation module, and

a display.

2. The mobile computing device of claim 1 , wherein the incoming communication signal is a continuous representation of brain signals or an intermittent representation of brain signals of a user.

3. The mobile computing device of claim 1 , wherein the feedback receiving module is configured to receive an incoming signal from a sensor connected to a user.

4. The mobile computing device of claim 1 , wherein the EEG data stream is detected by an EEG headset worn by a user.

5. The mobile computing device of claim 4 , wherein the avatar generation module enables the mobile computing device to display an avatar on the display representing an expected motion of the robotic device based on the at least one actionable command.

6. The mobile computing device of claim 1 , wherein the feedback receiving module enables the mobile computing device to receive an incoming wireless communication signal from at least one peripheral device.

7. The mobile computing device of claim 6 , wherein the incoming wireless communication signal is sensor data from the robotic device.

8. The mobile computing device of claim 1 , wherein the one or more modules operate simultaneously.

9. The mobile computing device of claim 1 , wherein the robotic device is coupled to a paralyzed portion of a user and the sensory feedback device is coupled to a body part of the user that the user can feel.

10. A system comprising:
an EEG monitoring headset;
a robotic device;
a sensory feedback device;
a mobile computing device comprising:
a processor in communication with the EEG monitoring headset, the robotic device, and the sensory feedback device, the processor configured to:
determine an actionable command based on EEG data received from the EEG monitoring headset;
transmit a first signal to the robotic device to cause active operation of the robotic device; and
transmit a second signal to the sensory feedback device to cause the sensory feedback device to provide tactile feedback during operation of the robotic device; and

a display.

11. The system of claim 10 , wherein the EEG data comprises a continuous representation of brain signals or an intermittent representation of brain signals of a user of the EEG monitoring headset.

12. The system of claim 10 , wherein the robotic device and/or sensory feedback device comprise one or more sensors.

13. The system of claim 12 , wherein the one or more sensors are operable to provide feedback to the processor.

14. The system of claim 13 , wherein the sensory feedback device is a wrist-mounted vibrating device.

15. The system of claim 10 , wherein the robotic device is a robotic walking apparatus, a robotic cart, or a robotic arm.

16. The system of claim 10 , wherein the sensory feedback device provides an indication to a user of a motion of the robotic device.

17. The system of claim 16 , wherein the display is configured to display an avatar.

18. The system of claim 17 , wherein the avatar is simulated to match a motion of the robotic device.

19. The system of claim 10 , wherein the robotic device is coupled to a paralyzed portion of a user and the sensory feedback device is coupled to a body part of the user that the user can feel.

Assignees

• Univ Duke

Inventors

• Song Allen
• Petty Chris

Classifications

• B25J13/00

  Controls for manipulators (programme controls B25J9/16) · CPC title

• B25J9/1656 Primary

  characterised by programming, planning systems for manipulators · CPC title

• B25J9/0006

  Exoskeletons, i.e. resembling a human figure · CPC title

• G06F3/015

  Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection · CPC title

• G05B2219/39292

  Neural brain based controller based on simplified model of vertebrate nervous system · CPC title