System and method of controlling robot by brain electrical signals

Patent metadata

Field	Value
Publication number	US-9962837-B2
Application number	US-201615076677-A
Country	US
Kind code	B2
Filing date	Mar 22, 2016
Priority date	Jan 22, 2016
Publication date	May 8, 2018
Grant date	May 8, 2018

Abstract

A system for controlling a robot by brain electrical signal, includes a screen, an electronic signal detection device, and a host computer. The screen shows a plurality of icons thereon, and the plurality of icons flashes at different frequencies. The electrical signal detection device detects brain electrical signal when one of the plurality of icons is stared. The host computer stores a plurality of personal reference parameters corresponding to the plurality of icons of the screen. The host computer processes the brain electrical signal to get parameters of use, and compares the parameters of use with the plurality of personal reference parameters to choose and execute the icon which is stared.

First claim

What is claimed is:

1. A system for controlling a robot by brain electrical signal, comprising:
a screen to show a plurality of icons thereon, and the plurality of icons being configured to flash at different frequencies,
an electrical signal detection device to detect brain electrical signal of an operator when one of the plurality of icons is stared at by the operator;
an host computer storing a plurality of personal reference parameters corresponding to the plurality of icons of the screen, the host computer being configured to process the brain electrical signal to get parameters of use, and comparing the parameters of use with the plurality of personal reference parameters to choose the icon which is stared at and to control the robot to execute works represented by the icon.

2. The system as claimed in claim 1 , further comprising a desk, a manipulator, and a dinner plate, wherein the manipulator and the dinner plate are mounted on the desk, the dinner plate comprises a plurality of food receiving areas which receive a plurality of different foods therein, the screen shows a plurality of food icons, and the manipulator fetches one food when a corresponding food icon is chosen.

3. The system as claimed in claim 2 , further comprising a camera, wherein the camera captures an image of the user, the host computer determines an elevation of a mouth of the user according to the image, and controls the manipulator to present the food to the mouth.

4. The system as claimed in claim 1 , wherein the brain electrical signal detection device is communicated with the host computer via wireless manner.

5. The system as claimed in claim 1 , wherein the brain electrical signal detection device comprises a plurality of head contact devices, each head contact device comprises a plurality of separate probes, and the probes is configured to contact scalp through a covering of hair.

6. The system as claimed in claim 1 , wherein the host computer comprises a brain electrical signal character capture module, and the brain electrical signal character capture module is configured to process the brain electrical signal by filtering the brain electrical signal, transforming the brain electrical signal by a Fourier transform, and calculating energy of the brain electrical signal.

7. The system as claimed in claim 1 , wherein the screen shows a plurality of video icons, and each of the plurality of video icons corresponds to different video contents.

8. The system as claimed in claim 1 , wherein the screen shows a plurality of notice icons, and the host computer is configured to broadcast a notice content when one notice icon is chosen.

9. The system as claimed in claim 1 , wherein the screen shows a plurality of call icons, and each of the plurality of call icons corresponds to one contact person.

10. A method of controlling a robot by brain electrical signal, comprising:
showing a plurality of icons, which correspond to different works, on a screen;
detecting brain electrical signal of an operator by an electrical signal detection device when one of the plurality of icons is stared at by the operator; and
comparing a parameter of the brain electrical signal with a plurality of personal reference parameters corresponding to the plurality of icons of the screen stored in a host computer to choose a the icon which is stared and controlling the robot to execute works represented by the icon.

11. The method as claimed in claim 10 , wherein a manipulator and a dinner plate is mounted on a desk, the dinner plate comprises a plurality of food receiving areas which receive a plurality of different foods therein, the screen shows a plurality of food icons, and the manipulator fetches one food when a corresponding food icon is chosen.

12. The method as claimed in claim 11 , wherein the camera captures an image of the user, the host computer determines an elevation of a mouth of the user according to the image, and controls the manipulator to present the food to the mouth.

13. The method as claimed in claim 10 , wherein the brain electrical signal detection device is communicated with the host computer via wireless manner.

14. The method as claimed in claim 10 , wherein the brain electrical signal detection device comprises a plurality of head contact devices, each head contact device comprises a plurality of separate probes, and the probes is configured to contact scalp through a covering of hair.

15. The method as claimed in claim 10 , wherein the host computer comprises a brain electrical signal character capture module, and the brain electrical signal character capture module is configured to process the brain electrical signal by filtering the brain electrical signal, transforming the brain electrical signal by a Fourier transform, and calculating energy of the brain electrical signal.

16. The method as claimed in claim 10 , wherein the screen shows a plurality of video icons, and each of the plurality of video icons corresponds to different video contents.

17. The method as claimed in claim 10 , wherein the screen shows a plurality of notice icons, and the host computer is configured to broadcast a notice content when one notice icon is chosen.

18. The method as claimed in claim 10 , wherein the screen shows a plurality of call icons, and each of the plurality of call icons corresponds to one contact person.

Assignees

• Hongfujin Prec Ind Wuhan
• Hon Hai Prec Ind Co Ltd
• Hong Fu Jin Prec Industry Wuhan Co I

Inventors

• Chen Tsung-Han
• Chung Shou-Han
• Lin Chin-Teng
• Ko Li-Wei
• Chen Shi-An

Classifications

• B25J9/1694 Primary

  characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion · CPC title

• A61F4/00

  Methods or devices enabling patients or disabled persons to operate an apparatus or a device not forming part of the body · CPC title

• G06F3/015

  Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection · CPC title

• G05B2219/45111

  Meal, food assistance · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title