Bioelectricity-based control method and apparatus, and bioelectricity-based controller

Patent metadata

Field	Value
Publication number	US-2018188809-A1
Application number	US-201815908179-A
Country	US
Kind code	A1
Filing date	Feb 28, 2018
Priority date	Aug 28, 2015
Publication date	Jul 5, 2018
Grant date	—

Abstract

The present invention relates to the field of natural human-computer interaction technologies, and discloses a bioelectricity-based control method and apparatus, and a bioelectricity-based controller, so as to improve naturalness of human-computer interaction. The method is as follows: performing characteristic extraction on a collected surface electromyography signal generated when a user performs a finger press operation, so as to obtain characteristic information; determining, according to a pre-created finger type recognition template, a finger type that is used to perform the finger press operation and that is corresponding to the obtained characteristic information; and mapping the determined finger type used to perform the finger press operation to a corresponding first instruction, and controlling a controlled device according to the first instruction. In this way, the controlled device may be controlled in a more harmonious and natural human-computer interaction manner.

First claim

What is claimed is:

1 . A bioelectricity-based control method, comprising:
collecting a surface electromyography signal generated when a user performs a finger press operation; performing characteristic extraction on the collected surface electromyography signal, so as to obtain characteristic information; determining, according to a pre-created finger type recognition template, a finger type that is used to perform the finger press operation and that is corresponding to the obtained characteristic information, wherein the finger type recognition template comprises a correspondence between each finger type and characteristic information of a surface electromyography signal corresponding to each finger type when a finger press operation is performed; and mapping the determined finger type used to perform the finger press operation to a corresponding first instruction, and controlling a controlled device according to the first instruction.

2 . The method according to claim 1 , before the performing characteristic extraction on the collected surface electromyography signal, further comprising:
performing preprocessing and sampling processing on the collected surface electromyography signal, wherein the preprocessing comprises signal amplification and interference suppression.

3 . The method according to claim 1 , after the determining a finger type used to perform the finger press operation, further comprising:
determining, based on an amplitude of the collected surface electromyography signal and a pre-created correlation function corresponding to a finger type, pressing force corresponding to the finger press operation, wherein the correlation function corresponding to a finger type comprises a function relationship between pressing force and an amplitude of a surface electromyography signal generated when a finger press operation is performed based on each finger type; and mapping the determined finger type together with the pressing force corresponding to the finger press operation to a corresponding second instruction, and controlling the controlled device according to the second instruction.

4 . The method according to claim 3 , wherein the surface electromyography signal comprises multiple channel sub-signals; and
the amplitude of the surface electromyography signal is determined in the following manner: performing cumulative average calculation on signal amplitudes of all channel sub-signals comprised in the collected surface electromyography signal, so as to obtain an average signal amplitude of the surface electromyography signal, and using the average signal amplitude as the amplitude of the surface electromyography signal.

5 . A bioelectricity-based control apparatus, comprising:
a collection unit, configured to collect a surface electromyography signal generated when a user performs a finger press operation; a characteristic extraction unit, configured to perform characteristic extraction on the surface electromyography signal collected by the collection unit, so as to obtain characteristic information; a determining unit, configured to determine, according to a pre-created finger type recognition template, a finger type that is used to perform the finger press operation and that is corresponding to the characteristic information obtained by the characteristic extraction unit, wherein the finger type recognition template comprises a correspondence between each finger type and characteristic information of a surface electromyography signal corresponding to each finger type when a finger press operation is performed; and a control unit, configured to map the finger type that is used to perform the finger press operation and that is determined by the determining unit to a corresponding first instruction, and control a controlled device according to the first instruction.

6 . The apparatus according to claim 5 , wherein the apparatus further comprises:
a preparing unit, configured to: before the characteristic extraction unit performs the characteristic extraction on the surface electromyography signal collected by the collection unit, perform preprocessing and sampling processing on the collected surface electromyography signal, wherein the preprocessing comprises signal amplification and interference suppression.

7 . The apparatus according to claim 5 , wherein the determining unit is further configured to:
determine, based on an amplitude of the surface electromyography signal collected by the collection unit and a pre-created correlation function corresponding to a finger type, pressing force corresponding to the finger press operation, wherein the correlation function corresponding to a finger type comprises a function relationship between pressing force and an amplitude of a surface electromyography signal generated when a finger press operation is performed based on each finger type; and the control unit is further configured to map the finger type determined by the determining unit together with the pressing force corresponding to the finger press operation to a corresponding second instruction, and control the controlled device according to the second instruction.

8 . The apparatus according to claim 7 , wherein the surface electromyography signal comprises multiple channel sub-signals; and
the determining unit is specifically configured to determine the amplitude of the surface electromyography signal in the following manner: performing cumulative average calculation on signal amplitudes of all channel sub-signals comprised in the collected surface electromyography signal, so as to obtain an average signal amplitude of the surface electromyography signal, and using the average signal amplitude as the amplitude of the surface electromyography signal.

9 . A bioelectricity-based controller, comprising a sensor, a processor, and a transceiver, wherein
the sensor is configured to be in contact with an arm muscle surface of a user, so as to collect a surface electromyography signal generated when the user performs a finger press operation; the processor is configured to invoke a set of program code, and perform the following operations according to the program code: performing characteristic extraction on the surface electromyography signal collected by the sensor, so as to obtain characteristic information; determining, according to a pre-created finger type recognition template, a finger type that is used to perform the finger press operation and that is corresponding to the obtained characteristic information; and mapping the determined finger type used to perform the finger press operation to a corresponding first instruction, wherein the first instruction is used to control a controlled device, and the finger type recognition template comprises a correspondence between each finger type and characteristic information of a surface electromyography signal corresponding to each finger type when a finger press operation is performed; and the transceiver is configured to send the first instruction obtained by the processor to the controlled device.

10 . The bioelectricity-based controller according to claim 9 , further comprising:
a memory, configured to store the program code executed by the processor.

11 . The bioelectricity-based controller according to claim 9 , wherein the processor is further configured to:
before performing the characteristic extraction on the collected surface electromyography signal, perform preprocessing and sampling processing on the collected surface electromyography signal, wherein the preprocessing comprises signal amplification and interference suppression.

12 . The bioelectricity-ba

Assignees

• Huawei Tech Co Ltd

Inventors

• Ding Qiang
• Zhang Can
• Zhang Liyao

Classifications

• A61B5/0488

  Human Necessities · mapped topic

• G06F3/015 Primary

  Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• A61B5/389

  Electromyography [EMG] · CPC title