Gesture recognition method, gesture recognition system, terminal device and wearable device

Patent metadata

Field	Value
Publication number	US-9671872-B2
Application number	US-201514801953-A
Country	US
Kind code	B2
Filing date	Jul 17, 2015
Priority date	Jan 9, 2015
Publication date	Jun 6, 2017
Grant date	Jun 6, 2017

Abstract

The present disclosure provides a gesture recognition method, a gesture recognition system, a terminal device and a wearable device. The gesture recognition method includes: collecting action information about a user; recognizing the action information; inquiring an action instruction corresponding to the recognized action information from a personal action database of the user, a correspondence between the action information about the user and the action instruction being stored in the personal action database of the user; and executing an operation corresponding to the inquired action instruction.

First claim

What is claimed is:

1. A gesture recognition method, comprising:
a collection step of collecting action information about a user;
a gesture recognition step of recognizing the action information;
an inquisition step of inquiring an action instruction corresponding to the recognized action information from a personal action database of the user, a correspondence between the action information about the user and the action instruction being stored in the personal action database of the user; and
an execution step of executing an operation corresponding to the inquired action instruction,
wherein information about an application type is stored in the personal action database of the user,
the gesture recognition method further comprises, prior to the inquisition step, a step of acquiring the information about the application type, the information about the application type indicating a type of an application used by the user, and
the inquisition step further comprises inquiring the action instruction corresponding to the recognized action information from the personal action database of the user in accordance with the information about the application type.

2. The gesture recognition method according to claim 1 , further comprising, prior to the inquisition step, a step of creating the personal action database of the user.

3. The gesture recognition method according to claim 1 , wherein for different application types, the same action information about the user corresponds to different action instructions.

4. The gesture recognition method according to claim 1 , wherein the personal action database of the user is stored in a wearable device, and the inquisition step is executed by the wearable device.

5. The gesture recognition method according to claim 4 , wherein the collection step, the gesture recognition step and the execution step are executed by a terminal device,
subsequent to the gesture recognition step and prior to the inquisition step, the gesture recognition method further comprises transmitting by the terminal device the recognized action information to the wearable device, and
subsequent to the inquisition step and prior to the execution step, the gesture recognition method further comprises transmitting by the wearable device the inquired action instruction to the terminal device.

6. A gesture recognition system, comprising:
a plurality of processors; and
a memory storing instructions, the instructions when executed by the plurality of processors, causing the plurality of processors to perform a gesture recognition method, the gesture recognition method comprising:
a collection step of collecting action information about a user;
a gesture recognition step of recognizing the action information;
an inquisition step of inquiring an action instruction corresponding to the recognized action information from a personal action database of the user, a correspondence between the action information about the user and the action instruction being stored in the personal action database of the user; and
an execution step of executing an operation corresponding to the inquired action instruction,
wherein information about an application type is stored in the personal action database of the user,
the gesture recognition method further comprises, prior to the inquisition step, a step of acquiring the information about the application type, the information about the application type indicating a type of an application used by the user, and
the inquisition step further comprises inquiring the action instruction corresponding to the recognized action information from the personal action database of the user in accordance with the information about the application type.

7. The gesture recognition system according to claim 6 , the gesture recognition method further comprising, prior to the inquisition step, a step of creating the personal action database of the user.

8. The gesture recognition system according to claim 6 , wherein for different application types, the same action information about the user corresponds to different action instructions.

9. The gesture recognition system according to claim 6 , wherein a first processor of the plurality of processors is arranged in a wearable device, and the inquisition step is performed by the first processor.

10. The gesture recognition system according to claim 9 , wherein a second processor of the plurality of processors is arranged in a terminal device, and the collection step, gesture recognition step and execution step are performed by the second processor,
the second processor is further configured to transmit the recognized action information to the first processor, and
the first processor is further configured to receive the recognized action information from the second processor and transmit the inquired action instruction to the second processor.

11. The gesture recognition system according to claim 6 , wherein a first processor of the plurality of processors is arranged in a wearable device, and the inquisition step and collection step are performed by the first processor.

12. The gesture recognition system according to claim 11 , wherein a second processor of the plurality of processors is arranged in a terminal device, and the gesture recognition step and execution step are performed by the second processor,
the second processor is further configured to receive the action information from the first processor, transmit the recognized action information to the first processor, and receive the inquired action instruction from the first processor, and
the first processor is further configured to transmit the collected action information to the second processor, receive the recognized action information from the second processor, and transmit the inquired action instruction to the second processor.

13. The gesture recognition system according to claim 6 , wherein a first processor of the plurality of processors is arranged in a wearable device, and the collection step, inquisition step and collection step are performed by the first processor.

14. The gesture recognition system according to claim 13 , wherein a second processor of the plurality of processors is arranged in a terminal device, and the execution step is performed by the second processor,
the second processor is further configured to receive the action information from the first processor, and
the first processor is further configured to transmit the inquired action instruction to the second processor.

15. A terminal device, comprising:
a processor; and
a memory storing instructions, the instructions when executed by the processor, causing the processor to perform operations comprising:
collecting action information about a user;
recognizing the action information;
transmitting the recognized action information to a wearable device worn by the user so as to enable the wearable device to inquire an action instruction corresponding to the recognized action information from a personal action database of the user, a correspondence between the action information about the user and the action instruction being stored in the personal action database of the user; and
receiving the inquired action instruction from the wearable device, and executing an operation corresponding to the action instruction,
wherein information about an application type is further stored in the personal action database of the user,
the wearable device is further configure to acquire the information about the application type, the information about the application type indicating a type of an application us

Assignees

• Boe Technology Group Co Ltd

Inventors

• Bai Jinglu
• Zhao Xingxing

Classifications

• G06F1/163

  Wearable computers, e.g. on a belt · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06V40/28 Primary

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title

• G06F16/90335

  Query processing · CPC title