Wireless input system based on steady-state visual-evoked potentials

Patent metadata

Field	Value
Publication number	US-9927872-B2
Application number	US-201515301043-A
Country	US
Kind code	B2
Filing date	Oct 27, 2015
Priority date	Jul 20, 2015
Publication date	Mar 27, 2018
Grant date	Mar 27, 2018

Abstract

A wireless BCI input system for mobile intelligent devices is described. The system may include an SSVEP keyboard for stimulating SSVEP signals and an EEG headband for acquiring EEG signals. The SSVEP keyboard may include sixteen virtual buttons and a mask that can be replaced to change functions of the virtual buttons. The EEG headband may include an EEG acquisition module, an EEG analysis module, and a Bluetooth communication module, which are used for acquiring EEG signals, determining the user's input intentions, and sending characters or controlling commands to a matched mobile intelligent device via Bluetooth connection.

First claim

What is claimed is:

1. A wireless brain computer interface (BCI) input system associated with a mobile intelligent device implementing steady-state visual evoked potentials (SSVEP), the system comprising;
a SSVEP keyboard configured to represent characters and stimulate SSVEP signals such that the mobile intelligent device is controlled by a user via a virtual button; and
an EEG headband configured to acquire EEG signals, extract SSVEP signals, analyze the EEG signals, identify user intention, and communicate with the mobile intelligent device via Bluetooth connection, wherein:
the SSVEP keyboard comprises:
a flash light generator configured to generate flash light,
a casing configured to isolate light sources, and
a mask configured to represent characters, wherein:
the flash light generator comprising a NE555 chip, resistances, and capacitances,
the flash light generator generates a square wave with a constant frequency to drive light-emitting diode (LED) flashing,
LEDs are isolated with opaque plastic materials, the mask is a translucent mask covering on the LEDs, and
the translucent mask is located below a top window and above a bottom window of the casing of the SSVEP keyboard and is replaceable;

the EEG headband comprises:
an EEG acquisition module configured to acquire a user scalp EEG signal by amplification, filtration, and AD-conversion,
an EEG analysis module configured to extract SSVEP signals and to perform classification,
a communication module configured to transfer classification results to the mobile intelligent device, and
a headband on which the EEG acquisition module, the EEG analysis module and the communication module are fixed, wherein:
the EEG acquisition module comprises:
three electrodes consisting of a frontal electrode that is attached to a forehead of the user, an occipital electrode that is attached to an occipital area of the user, and an ear-clip electrode that is clipped to the left ear lobe of the user, and
an electric circuitry that comprises a two-stage amplifier with magnification of 1000 times of the original voltage, a band-pass filter with passband of about 5-40 Hz and an AD-converter with a rate of 512 Hz,

the EEG analysis module comprises:
a single-chip computer that runs an analysis program configured to buffer data, remove DC components, eliminate baseline drift, execute time-frequency transformation, extract features, identify none-control state, and perform classification,
the communication module comprises:
a Bluetooth module, and
an antenna, wherein the communication module is configured to send characters or control commands to the mobile intelligent device via Bluetooth communication protocols.

2. The system of claim 1 , wherein the EEG headband is placed on a head of the user, the SSVEP keyboard is placed in front of the user, and the EEG headband is matched with the mobile intelligent device via the Bluetooth connection such that user input the mobile intelligence device by looking at the virtual buttons on the SSVEP keyboard;
the LEDs on the bottom of the SSVEP keyboard is configured to flash based on predefined frequencies, the mask is made of translucent material to filter the light of the LEDs and to protect eyes of the user, a window on top of the casing is made of transparent material, and the other parts of the casing are made of opaque materials;
a frontal electrode and an occipital electrode are embedded in the headband; the EEG acquisition module, EEG analysis module, and communication module are assembled in a plastic casing, the headband of the system is adjustable to ensure frontal electrodes and occipital electrode cling on frontal skin and an occipital scalp of the user, respectively when using this system, and an ear-clip electrode is clipped to a left ear lobe of the user; and
the EEG signals are acquired by electrodes via the amplifier, the band-pass filter and an AD converter step-by-step such that the EEG signals are converted into a digital format and are then analyzed by the EEG analysis module, and characters and control commands resulting from the analysis program are transferred to the mobile intelligent device via the communication module.

3. The system of claim 1 , wherein the EEG signals are segmented into 1 second pieces, and each piece of data is analyzed separately.

4. The system of claim 1 , wherein each virtual button is customized by setting the EEG headband to a custom mode via a hardware switch such as to:
turn the Bluetooth module on standby when the system is set to custom mode and after which the system is connected to a smartphone or tablet PC;
send custom commands to the system via Bluetooth serial port protocols, wherein customized characters are a string or AT (Attention) command from a standard Bluetooth communication protocol; and
replace the mask to match the customized function of virtual buttons.

Assignees

• Univ Beijing Technology

Inventors

• Yang Chunlan
• Nie Yingnan
• Li Wan
• Wu Shuicai

Classifications

• H04W4/008

  Electricity · mapped topic

• G06F3/04886

  by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F3/015 Primary

  Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection · CPC title

• G06F3/0236

  using selection techniques to select from displayed items · CPC title