Gesture-based object measurement method and apparatus

Patent metadata

Field	Value
Publication number	US-10262197-B2
Application number	US-201615344218-A
Country	US
Kind code	B2
Filing date	Nov 4, 2016
Priority date	Nov 17, 2015
Publication date	Apr 16, 2019
Grant date	Apr 16, 2019

Abstract

In the field of man-machine interaction technologies, a gesture-based object measurement method and apparatus, which are used to improve measurement efficiency. According to this method, after image information is collected, contour information of a to-be-measured object is automatically extracted and partitioned off, and a measurement parameter value such as a length, an area, or a volume is calculated on this basis. In this way, not only real-time online measurement is implemented, a measurement process is simpler, and more convenient, visual, and effective, and augmented reality (AR) measurement efficiency can be improved, but also the measurement process is more harmonious and natural, and closer to a human intention, and a measurement result is more accurate.

First claim

What is claimed is:

1. A gesture-based object measurement method, comprising:
collecting image information of a to-be-measured object and a gesture;
extracting contour information of the to-be-measured object from the collected image information;
determining, according to the gesture, a target measurement area that is in the image information and in which the user is interested when the gesture meets a set condition;
partitioning contour information of the target measurement area off the extracted contour information;
obtaining three-dimensional coordinate values obtained after each endpoint comprised in the partitioned-off contour information is mapped to three-dimensional space; and
calculating, according to the obtained three-dimensional coordinate values, a measurement parameter value of the to-be-measured object corresponding to the contour information of the target measurement area.

2. The method according to claim 1 , wherein the gesture meets a set condition when a duration during which the gesture is held at a relative position in the image information exceeds a preset duration threshold.

3. The method according to claim 1 , wherein the gesture meets a set condition when a distance in which the gesture is translated in a direction perpendicular to a two-dimensional plane to which the image information is mapped exceeds a set step, and a relative position of the gesture remains unchanged in the translation process on the two-dimensional plane to which the image information is mapped.

4. The method according to claim 1 , wherein the measurement parameter value comprises at least one of a length value, an area value, a volume value, or a distance to an image information collection device.

5. The method according to claim 1 , further comprising:
determining a gesture type of the gesture;
searching a preset correspondence between a gesture type and a measurement parameter for a measurement parameter corresponding to the determined gesture type; and
using the measurement parameter in calculating the measurement parameter value.

6. The method according to claim 1 , further comprising displaying the measurement parameter value.

7. A gesture-based object measurement apparatus, comprising:
a display;
a sensor configured to collect image information of a to-be-measured object and a gesture;
a processor coupled to the sensor and configured to:
determine a measurement positioning point of the to-be-measured object according to the gesture when the gesture collected by the sensor meets a set condition;
obtain three-dimensional coordinate values obtained after the measurement positioning point is mapped to three-dimensional space;
determine a measurement parameter of the to-be-measured object; and
calculate a value of the measurement parameter of the to-be-measured object according to the measurement parameter and the three-dimensional coordinate values; and

a transceiver coupled to the processor and configured to send the value of the measurement parameter to the display, the display being configured to display the received parameter value.

8. The apparatus according to claim 7 , wherein the processor is further configured to:
determine a gesture type of the gesture;
search a preset correspondence between a gesture type and a measurement parameter for a measurement parameter corresponding to the determined gesture type; and
use the measurement parameter as the measurement parameter of the to-be-measured object.

9. The apparatus according to claim 7 , wherein the gesture meets a set condition when a duration during which the gesture is held at a relative position in the image information exceeds a preset duration threshold.

10. The apparatus according to claim 7 , further comprising a memory configured to store the programs executed by the processor.

11. The apparatus according to claim 7 , wherein the measurement parameter value comprises at least one of a length value, an area value, a volume value, or a distance to an image information collection device.

12. The apparatus according to claim 7 , wherein the gesture meets a set condition when a distance in which the gesture is translated in a direction perpendicular to a two-dimensional plane to which the image information is mapped exceeds a set step, and a relative position of the gesture remains unchanged in the translation process on the two-dimensional plane to which the image information is mapped.

13. The apparatus according to claim 7 , further comprising a wearable device comprising the display and the sensor.

14. A gesture-based object measurement apparatus, comprising:
a display;
a sensor configured to:
collect image information of a to-be-measured object and a gesture,

a processor coupled to the sensor and configured to:
extract contour information of the to-be-measured object from the image information collected by the sensor;
determine, according to the gesture, a target measurement area that is in the image information and in which the user is interested when the gesture collected by the sensor meets a set condition;
partition contour information of the target measurement area off the extracted contour information;
obtain three-dimensional coordinate values obtained after each endpoint comprised in the partitioned-off contour information is mapped to three-dimensional space; and
calculate, according to the obtained three-dimensional coordinate values, a measurement parameter value of the to-be-measured object corresponding to the contour information of the target measurement area; and

a transceiver coupled to the processor and configured to send the measurement parameter value to the display, the display being configured to display the received measurement parameter value.

15. The apparatus according to claim 14 , wherein the gesture meets a set condition when a duration during which the gesture is held at a relative position in the image information exceeds a preset duration threshold.

16. The apparatus according to claim 14 , wherein the gesture meets a set condition when a distance in which the gesture is translated in a direction perpendicular to a two-dimensional plane to which the image information is mapped exceeds a set step, and a relative position of the gesture remains unchanged in the translation process on the two-dimensional plane to which the image information is mapped.

17. The apparatus according to claim 14 , further comprising a memory, configured to store the programs executed by the processor.

18. The apparatus according to claim 14 , wherein the gesture meets a set condition when a duration during which the gesture is held at a relative position in the image information exceeds a preset duration threshold.

19. The apparatus according to claim 14 , wherein the measurement parameter value comprises at least one of a length value, an area value, a volume value, or a distance to an image information collection device.

20. The apparatus according to claim 14 , further comprising a wearable device comprising the display and the sensor.

Assignees

• Huawei Tech Co Ltd

Inventors

• Lin Yimin
• Lian Shiguo

Classifications

• G06F1/163 Primary

  Wearable computers, e.g. on a belt · CPC title

• G06V40/28

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title

• G01B11/00

  Measuring arrangements characterised by the use of optical techniques · CPC title

• G01B11/285

  using photoelectric detection means · CPC title

• G01B11/24

  for measuring contours or curvatures · CPC title