Wearable device, signal processing method and device

Patent metadata

Field	Value
Publication number	US-2020237221-A1
Application number	US-201916549071-A
Country	US
Kind code	A1
Filing date	Aug 23, 2019
Priority date	Jan 29, 2019
Publication date	Jul 30, 2020
Grant date	—

Abstract

A wearable device, a signal processing method and a signal processing device are disclosed. The wearable device includes a processor and a signal collector electrically connected to the processor. The signal collector includes at least one electroencephalogram sensor configured to collect an electroencephalogram signal and at least one electrooculogram sensor configured to collect an electrooculogram signal. The processor is configured to generate a control signal based on the electroencephalogram signal and the electrooculogram signal, and the electroencephalogram sensor and the electrooculogram sensor are different sensors.

First claim

What is claimed is:

1 . A wearable device, comprising a processor and a signal collector electrically connected to the processor,
wherein the signal collector comprises at least one electroencephalogram sensor configured to collect an electroencephalogram signal and at least one electrooculogram sensor configured to collect an electrooculogram signal; and wherein the processor is configured to generate a control signal based on the electroencephalogram signal and the electrooculogram signal, wherein the electroencephalogram sensor and the electrooculogram sensor are different sensors.

2 . The wearable device according to claim 1 , wherein the electroencephalogram signal is collected from a steady-state visual evoked potential (SSVEP) channel.

3 . The wearable device according to claim 2 , wherein the electroencephalogram sensor comprises one or more of an O1 sensor, an O2 sensor, an Oz sensor or a Pz sensor.

4 . The wearable device according to claim 3 , wherein the electroencephalogram sensor comprises an O1 sensor, an O2 sensor, an Oz sensor, and a Pz sensor.

5 . The wearable device according to claim 3 , further comprising a stimulation generator configured to provide a stimulation signal of which a refresh frequency is not lower than 4 Hz.

6 . The wearable device according to claim 5 , wherein the stimulation generator comprises a display panel or a light-emitting element.

7 . The wearable device according to claim 1 , wherein the signal collector further comprises at least one reference sensor configured to collect a reference signal.

8 . The wearable device according to claim 1 , wherein the electrooculogram sensor comprises at least two horizontal sensors, each of which is configured to collect a signal of a horizontal movement of an eyeball, and at least two vertical sensors, each of which is configured to collect a signal of a vertical movement of the eyeball.

9 . The wearable device according to claim 1 , wherein the signal collector further comprises a signal amplifier, a digital to analog converter, and a filter, which are connected to the electroencephalogram sensor and the electrooculogram sensor.

10 . A signal processing method applied to the wearable device according to claim 1 , comprising:
collecting, by the electroencephalogram sensor, the electroencephalogram signal, and collecting, by the electrooculogram sensor, the electrooculogram signal; and processing, by the processor, the electroencephalogram signal and the electrooculogram signal to obtain an electroencephalogram control signal and an electrooculogram control signal, respectively.

11 . The signal processing method according to claim 10 , further comprising, before collecting, by the electroencephalogram sensor, the electroencephalogram signal, and collecting, by the electrooculogram sensor, the electrooculogram signal:
collecting a first electroencephalogram signal while a preset operation corresponding to the electroencephalogram signal being executed and a first electrooculogram signal while a preset operation corresponding to the electrooculogram signal being executed, and fitting the first electroencephalogram signal to a template signal of the electroencephalogram signal and the first electrooculogram signal to a template signal of the electrooculogram signal; and extracting an electroencephalogram eigenvector for signal classification from the template signal of the electroencephalogram signal and an electrooculogram eigenvector for signal classification from the template signal of the electrooculogram signal.

12 . The signal processing method according to claim 11 , wherein the processing, by the processor, the electroencephalogram signal and the electrooculogram signal to obtain an electroencephalogram control signal and an electrooculogram control signal, respectively, comprises:
classifying the electroencephalogram signal to obtain the electroencephalogram control signal based on the electroencephalogram eigenvector; and classifying the electrooculogram signal to obtain the electrooculogram control signal based on the electrooculogram eigenvector.

13 . The signal processing method according to claim 11 , wherein the extracting an electroencephalogram eigenvector for signal classification from the template signal of the electroencephalogram signal and an electrooculogram eigenvector for signal classification from the template signal of the electrooculogram signal comprises:
converting the template signal of the electroencephalogram signal into a frequency-domain electroencephalogram signal through Fourier transform and the template signal of the electrooculogram signal into a frequency-domain electrooculogram signal through Fourier transform; and extracting an amplitude of fundamental energy of the frequency-domain electroencephalogram signal as the electroencephalogram eigenvector and an amplitude of fundamental energy of the frequency-domain electrooculogram signal as the electrooculogram eigenvector.

14 . The signal processing method according to claim 11 , wherein the fitting the first electroencephalogram signal to a template signal of the electroencephalogram signal and the first electrooculogram signal to a template signal of the electrooculogram signal comprises:
fitting the first electroencephalogram signal to the template signal of the electroencephalogram signal and the first electrooculogram signal to the template signal of the electrooculogram signal through canonical correlation analysis (CCA), wherein the template signal of the electroencephalogram signal and the template signal of the electrooculogram signal each consist of a sine wave signal and a cosine wave signal.

15 . A signal processing device arranged in the wearable device according to claim 1 , comprising:
the signal collector, configured to collect the electroencephalogram signal through the electroencephalogram sensor and collect the electrooculogram signal through the electrooculogram sensor; and a signal processor, configured to process the electroencephalogram signal and the electrooculogram signal by the processor to obtain an electroencephalogram control signal and an electrooculogram control signal, respectively.

16 . The signal processing device according to claim 15 , wherein the signal processor comprises:
a fitting sub-circuit, configured, before the signal collector collecting the electroencephalogram signal and the electrooculogram signal, to collect a first electroencephalogram signal while a preset operation corresponding to the electroencephalogram signal being executed and a first the electrooculogram signal while a preset operation corresponding to the electrooculogram signal being executed, and fit the first electroencephalogram signal to a template signal of the electroencephalogram signal and the first electrooculogram signal to a template signal of the electrooculogram signal; and an extraction sub-circuit, configured to extract an electroencephalogram eigenvector for signal classification from the template signal of the electroencephalogram signal and an electrooculogram eigenvector for signal classification from the template signal of the electrooculogram signal.

17 . The signal processing device according to claim 16 , wherein the signal processor further comprises:
a classification sub-circuit, configured to classify the electroencephalogram signal to obtain the electroencephalogram control signal based on the electroencephalogram eigenvector and the electrooculogram signal to obtain the electrooculogram control signal based on the electrooculog

Assignees

• Beijing Boe Optoelectronics Tech Co Ltd
• Boe Technology Group Co Ltd

Inventors

• He Huidong
• Zhang Hao
• Chen Lili
• Lei Yu
• Han Peng
• Lu Yuanjie
• Sun Yukun
• Fan Qingwen
• Zhang Shuo
• Xue Yachong

Classifications

• A61B5/398

  Electrooculography [EOG], e.g. detecting nystagmus; Electroretinography [ERG] · CPC title

• A61B5/369

  Electroencephalography [EEG] · CPC title

• A61B5/378

  Visual stimuli · CPC title

• A61B5/6803

  Head-worn items, e.g. helmets, masks, headphones or goggles · CPC title

• G06F1/163 Primary

  Wearable computers, e.g. on a belt · CPC title