Computing device and method for generating gestures

Patent metadata

Field	Value
Publication number	US-9804680-B2
Application number	US-201514927474-A
Country	US
Kind code	B2
Filing date	Oct 30, 2015
Priority date	Nov 7, 2014
Publication date	Oct 31, 2017
Grant date	Oct 31, 2017

Abstract

Precise analysis and description of movement and gestures by a human or other object are carried out by a computing device assisted by camera and distance sensors. The same gestures and movements of an object in different locations and in different orientations may be identified according to coordinates and offsets applied to coordinates, and gesture-making areas projected so as to surround the object. The techniques can accurately identify actions of movements of the human or other object.

First claim

What is claimed is:

1. A computing device for generating a gesture event, comprising:
at least one processor;
a non-transitory storage system coupled to the at least one processor and configured to store one or more programs that are executed by the at least one processor, the one or more programs comprising instructions for:
obtaining coordinates of an object;
calculating a gesture-making area and coordinates of a center point of the gesture-making area according to the coordinates of the object;
calculating offset coordinates;
compensating, to correct the gesture-making area, the coordinate of the center point of the gesture-making area according to the offset coordinates, to correct the gesture-making area; and
generating the gesture event according to the offset coordinates and the corrected gesture-making area;
wherein the coordinates of the object comprises: a head coordinate, a left shoulder coordinate, a right shoulder coordinate, a left elbow coordinate, a right elbow coordinate, a left wrist coordinate, a right wrist coordinate, a left leg joint coordinate, and/or a right leg joint coordinate;
wherein the gesture-making area comprises a right gesture-making area, the coordinate of the center point of the gesture-making area is a coordinate of a center point of the right gesture-making area, and the calculation of the coordinate of the center point of the right gesture-making area further comprises: C1(x, y, z)=P1(x, y, z)+d1(x, y, z), wherein the C1(x, y, z) is the coordinate of the center point of the right gesture-making area, the P1(x, y, z) is the right shoulder coordinate, the d1(x, y, z) is an arbitrary coordinate that is configured to |d1(x, y, z)|<D11, the D11 is a maximum distance between the right shoulder coordinate and the head coordinate, a distance between a left edge of the right gesture-making area and the center point of the right gesture-making area is S1, S1=k1*D12, the k1 is a real number, and the D12 is a distance between the right elbow coordinate and the right wrist coordinate.

2. The computing device of claim 1 , wherein the offset coordinate comprises a right offset coordinate, the calculation of the right offset coordinate further comprises:
(a2) calculating x-axis, y-axis, or z-axis test distance between the center point of the left gesture-making area and the computing device;
(b2) calculating difference value between test distance and an actual distance; wherein the actual distance, measured with tool, is a x-axis, y-axis, or z-axis distance between the object and the computing device;
repeating (a2)-(b2) while the position of the object is changed, to obtain a plurality of difference values between the test distance and the actual distance, which are correspond to a plurality of positions of the object;
calculating an average value of the plurality of difference values, the average value is the x-axis, y-axis or z-axis coordinate value of the right offset coordinate.

3. The device of claim 1 , wherein the generation of the gesture event comprises:
generating an upward gesture event when the y-axis coordinate value of the right wrist coordinate is greater than the y-axis coordinate value of a top edge of the right gesture-making area;
generating a downward gesture event when the y-axis coordinate value of the right wrist coordinate is less than the y-axis coordinate value of a bottom edge of the right gesture-making area;
generating a leftward gesture event when the x-axis coordinate value of the right wrist coordinate is greater than the x-axis coordinate value of a left edge of the right gesture-making area;
generating a rightward gesture event when the x-axis coordinate value of the right wrist coordinate is less than the x-axis coordinate value of a right edge of the right gesture-making area;
generating a forward gesture event when the z-axis coordinate value of the right wrist coordinate is greater than the z-axis coordinate value of a front edge of the right gesture-making area;
generating a clockwise-rotation gesture event when the right wrist coordinate satisfies to generate a first group of gestures in a predetermined time, wherein the first group of gestures comprises:
in a first order, a downward gesture, a leftward gesture and an upward gesture;
in a second order, a leftward gesture, an upward gesture and a rightward gesture;
in a third order, an upward gesture, a rightward gesture and a downward gesture; or
in a fourth order, a rightward gesture, a downward gesture and a leftward gesture; and

generating an anticlockwise-rotation gesture event when the right wrist coordinate satisfies to generate a second group of gesture events in a predetermined time, wherein the second group of gesture events comprises:
in a fifth order, a downward gesture, a rightward gesture and an upward gesture;
in a sixth order, a rightward gesture, an upward gesture and a leftward gesture;
in a seventh order, an upward gesture, a leftward gesture and a downward gesture; or
in a eighth order, a leftward gesture, a downward gesture and a rightward gesture.

4. The computing device of claim 1 , wherein the gesture-making area comprises a left gesture-making area, the coordinate of the center point of the gesture-making area is a coordinate of a center point of the left gesture-making area, and the calculation of the coordinate of the center point of the left gesture-making area further comprises: C(x, y, z)=P(x, y, z)+d(x, y, z), wherein the C(x, y, z) is the coordinate of the center point of the left gesture-making area, the P(x, y, z) is the left shoulder coordinate, the d(x, y, z) is an arbitrary coordinate that is configured to |d(x, y, z)|<D1, the D1 is a maximum distance between the left shoulder coordinate and the head coordinate, a distance between a left edge of the left gesture-making area and the center point of the left gesture-making area is S, S=k*D2, the k is a real number, and the D2 is a distance between the left elbow coordinate and the left wrist coordinate.

5. The computing device of claim 4 , wherein the offset coordinate comprises a left offset coordinate, the calculation of the left offset coordinate further comprises:
(a1) calculating x-axis, y-axis, or z-axis test distance between the center point of the left gesture-making area and the computing device;
(b1) calculating difference value between the test distance and an actual distance; wherein the actual distance, measured with tool, is a x-axis, y-axis, or z-axis distance between the object and the computing device;
repeating (a1)-(b1) while the position of the object is changed, to obtain a plurality of difference values between the test distance and the actual distance, which are correspond to a plurality of positions of the object; and
calculating an average value of the plurality of difference values, the average value is the x-axis, y-axis or z-axis coordinate value of the left offset coordinate.

6. The computing device of claim 4 , wherein the generation of the gesture event comprises:
generating an upward gesture event when the y-axis coordinate value of the left wrist coordinate is greater than the y-axis coordinate value of a top edge of the left gesture-making area;
generating a downward gesture event when the y-axis coordinate value of the left wrist coordinate is less than the y-axis coordinate value of a bottom edge of the left gesture-making area;
generating a leftward gesture event when the x-axis coordinate value of the left wrist coordinate is greater than the x-axis coordinate value of a left edge of the left gesture-making area;
generating a rightward gesture event when the x-axis coordinate value of the left wrist coordinate is less than the x-axis coordinate value of a right edge of the left gesture-making area;
generating a forward

Assignees

• Hong Fu Jin Prec Ind (Shenzhen) Co Ltd
• Hon Hai Prec Ind Co Ltd
• Hon Hai Prec Ind Co Ltd

Inventors

• Charng Jen-Hsiung
• Kao Ming-Chuan
• Chiou Shih-Hung
• Chen Chih-Yu
• Yang Hsiung-Yi

Classifications

• G06V10/42

  Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06K9/52

  Physics · mapped topic

• G06K9/4604

  Physics · mapped topic