Gesture control method for wearable system and wearable system

Patent metadata

Field	Value
Publication number	US-10948994-B2
Application number	US-201616080589-A
Country	US
Kind code	B2
Filing date	Feb 29, 2016
Priority date	Feb 29, 2016
Publication date	Mar 16, 2021
Grant date	Mar 16, 2021

Abstract

When a location of a wearable system changes, the wearable system can ensure that a gesture working region always remains in a field of view of the wearable system. Therefore, the wearable system can still collect and recognize a gesture image and implement gesture control. The solution provided in this application is as follows: The wearable system creates a gesture working region and a region of interest, where the region of interest is within a shooting area of a first camera, and the first camera is included in a wearable device; obtains a location parameter of the wearable system; adjusts the region of interest according to the location parameter, so that the region of interest covers the gesture working region; collects a gesture image within the gesture working region; recognizes the gesture image to obtain a gesture instruction; and performs a corresponding operation according to the gesture instruction.

First claim

What is claimed is:

1. A gesture control method for a wearable system, the method comprising:
creating, by a wearable system, a gesture working region and a region of interest, wherein the region of interest is within a shooting area of a first camera, and the first camera is comprised in the wearable system;
obtaining, by the wearable system, a location parameter of the wearable system;
adjusting, by the wearable system, the region of interest according to the location parameter, so that the region of interest overlaps with the gesture working region, wherein adjusting the region of interest comprises:
calculating, by the wearable system, a first adjustment angle of the first camera by using a first relation, wherein the first relation is determined by the wearable system according to a first coordinate system, a second coordinate system, and a third coordinate system, the first coordinate system is created by the wearable system according to the gesture working region, the second coordinate system is created by the wearable system according to the region of interest, and the third coordinate system is created by the wearable system according to the wearable system itself, and
adjusting, by the wearable system according to the first adjustment angle, the first camera so as to adjust the region of interest;

collecting, by the wearable system, a gesture image within the gesture working region, wherein the gesture image comprises a static hand posture and/or a dynamic gesture motion;
recognizing, by the wearable system, the gesture image to obtain a gesture instruction; and
performing, by the wearable system, an operation according to the gesture instruction.

2. The gesture control method for a wearable system according to claim 1 , wherein adjusting the region of interest comprises:
obtaining, by the wearable system, a deviation angle of the wearable system according to the location parameter;
calculating, by the wearable system according to the deviation angle, the first adjustment angle of the first camera by using a first relation; and
adjusting, by the wearable system according to the first adjustment angle, an angle of a reflex mirror, and/or a shooting angle of the first camera by using a rotary motor, so as to adjust the region of interest, wherein the reflex mirror is configured to reflect an image in the region of interest into the shooting area of the first camera.

3. The gesture control method for a wearable system according to claim 2 , wherein collecting the gesture image comprises:
transmitting, by the wearable system by using an infrared light transmitter of the wearable system, infrared light to cover the gesture working region;
performing, by the wearable system by using an infrared cut-off filter, filtering to obtain infrared light reflected from the gesture working region, and receiving the reflected infrared light by using the first camera and a second camera, wherein the second camera is comprised in the wearable system;
generating, by the wearable system, a first gesture image by using the first camera, and generating a second gesture image by using the second camera; and
performing, by the wearable system, calculation on the first gesture image and the second gesture image to obtain the gesture image.

4. The gesture control method for a wearable system according to claim 2 , wherein the first relation comprises:

X

c
⁡

(

i
-
1

)

⁢
sin
⁢

⁢
α
⁢

⁢
sin
⁢

⁢
β

+

Y

c
⁡

(

i
-
1

)

⁢
cos
⁢

⁢
α

+

Z

c
⁡

(

i
-
1

)

⁢
sin
⁢

⁢
α
⁢

⁢
cos
⁢

⁢
β

X

c
⁡

(

i
-
1

)

Assignees

• Huawei Tech Co Ltd

Inventors

• Zhang Liyao
• Ding Qiang
• Jiang Hongrui

Classifications

• G06V40/113

  Recognition of static hand signs · CPC title

• G06V10/25

  Determination of region of interest [ROI] or a volume of interest [VOI] · CPC title

• G06V40/28

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/01

  Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) · CPC title