Method and device of labeling laser point cloud

Patent metadata

Field	Value
Publication number	US-11455772-B2
Application number	US-202017013150-A
Country	US
Kind code	B2
Filing date	Sep 4, 2020
Priority date	Apr 20, 2017
Publication date	Sep 27, 2022
Grant date	Sep 27, 2022

Abstract

The present application discloses a method and device of labeling laser point cloud. The method comprises: receiving data of a laser point cloud; constructing a 3D scene and establishing a 3D coordinate system corresponding to the 3D scene; converting a coordinate of each laser point in the laser point cloud into a 3D coordinate in the 3D coordinate system; mapping laser points included in the laser point cloud into the 3D scene respectively according to the 3D coordinate of the laser points; labeling the laser points in the 3D scene.

First claim

What is claimed is:

1. A method of labeling a laser point cloud, comprising:
receiving, by a device for labeling laser point clouds, data of the laser point cloud;
constructing a 3D scene and establishing a 3D coordinate system corresponding to the 3D scene;
converting a coordinate of each laser point in the laser point cloud into a 3D coordinate in the 3D coordinate system;
mapping laser points in the laser point cloud into the 3D scene respectively according to using the 3D coordinates of the laser points; and
labeling the laser points in the 3D scene, in which labeling the laser points in the 3D scene comprises:
determining types to which the laser points in the 3D scene belong according to a first mode or a second mode:
wherein the first mode comprises:
generating a 3D selecting box according to first size information set by a user;
moving a position of the 3D selecting box in the 3D scene according to a first moving instruction input by the user; and
when receiving a labeling instruction carrying a target type, taking laser points currently falling within the 3D selecting box as target laser points and taking the target type in the labeling instruction as a type to which the target laser points belong; and

wherein the second mode comprises:
generating a ray by taking the position of a camera of at least one camera as a start point and taking a screen position point selected by the user as an end point;
taking laser points meeting the following conditions as target laser points: a distance of a laser point from the start point is between a first distance threshold and a second distance threshold, and a vertical distance of the laser point from the ray is less than or equal to a third distance threshold; and
when receiving a labeling instruction carrying a target type, taking the target type in the labeling instruction as a type to which the target laser points belong; and

labeling the laser points by using labeling manners corresponding to the types to which the laser points belong, wherein different types correspond to different labeling manners.

2. The method according to claim 1 , wherein after constructing the 3D scene, the method further comprises constructing at least one camera in the 3D scene, to adjust an angle and a range of viewing the laser point cloud in the 3D scene by adjusting a position and a direction of the at least one camera in the 3D scene, during the process of labeling the laser points in the 3D scene.

3. The method according to claim 2 , wherein labeling the laser point according to the labeling manner corresponding to the type to which the laser points belong comprises:
determining a labeling color corresponding to the type to which the laser points belong according to a preset correspondence between types and labeling colors, and setting a color of the laser points to be the labeling color corresponding to the type to which the laser points belong; or
determining a labeling box pattern corresponding to the type to which the laser points belong according to a preset correspondence between types and labeling box patterns, generating a 3D labeling box according to the labeling box pattern corresponding to the type to which the laser points belong, and labeling the laser points by using the 3D labeling box.

4. The method according to claim 1 , wherein the labeling instruction contains a labeling color corresponding to the target type and labeling the laser points according to the labeling manners corresponding to the type to which the laser points belong comprises:
setting a color of the target laser points to be the labeling color in the labeling instruction, wherein different target types correspond to different labeling colors.

5. The method according to claim 4 , wherein setting the color of the target laser points to be the labeling color in the labeling instruction comprises:
generating a 3D coloring box according to second size information set by the user;
moving the 3D coloring box according to a second moving instruction input by the user, to paint the color of the target laser points falling within the 3D coloring box during the moving process into the labeling color in the labeling instruction.

6. The method according to claim 5 further comprising:
setting the 3D coloring box with an eraser attribute according to an erasure instruction input by the user;
moving the 3D coloring box according to a third moving instruction input by the user, to erase the color of the laser points falling within the 3D coloring box during the moving process.

7. The method according to claim 1 , wherein the labeling instruction further contains a labeling box pattern corresponding to the target type, and labeling the laser points according to the labeling manner corresponding to the type to which the laser points belong comprises:
generating a 3D labeling box according to the labeling box pattern, and
labeling each target laser point respectively by using the 3D labeling box, wherein different target types correspond to different labeling box patterns.

8. A device for labeling laser point clouds, comprising:
a receiving unit configured to receive data of a laser point cloud;
a constructing unit configured to construct a 3D scene and establish a 3D coordinate system corresponding to the 3D scene;
a converting unit configured to convert a coordinate of each laser point in the laser point cloud into a 3D coordinate in the 3D coordinate system;
a mapping unit configured to map the laser points included in the laser point cloud into the 3D scene using the 3D coordinates of the laser points;
a labeling unit configured to label the laser points in the 3D scene, the labeling unit comprising:
a determining subunit configured to determine types to which the laser points in the 3D scene belong; and
a labeling subunit configured to label the laser points by using labeling manners corresponding to the types to which the laser points belong, by:
determining a labeling box pattern corresponding to the type to which the laser points belong according to a preset correspondence between types and labeling box patterns, including:
selecting the labeling box pattern from a list of labeling box patterns with different colors according to the type to which the laser points belong;

generating a 3D labeling box according to the selected labeling box pattern corresponding to the type to which the laser points belong; and
labelling the laser points by using the 3D labeling box, wherein different types correspond to different labeling manners.

9. The device according to claim 8 , the device further comprising:
a camera constructing unit configured to construct at least one camera in the 3D scene, to adjust an angle and a range of viewing the laser point cloud in the 3D scene by adjusting a position and a direction of the at least one camera in the 3D scene during the process of labeling the laser points in the 3D scene.

10. The device according to claim 9 , wherein the determining subunit is specifically configured to determine types to which the laser points in the 3D scene belong according to a first mode or a second mode.

11. The device according to claim 10 , wherein:
the first mode comprises:
generating a 3D selecting box according to first size information set by a user;
moving a position of the 3D selecting box in the 3D scene according to a first moving instruction input by the user; and
when receiving a labeling instruction carrying a target type, taking laser points currently falling within the 3D selecting box as target laser points and taking the target type in the labeling instruction as a type to which the target laser points belong; an

Assignees

• Beijing Tusen Zhitu Tech Co Ltd

Inventors

• Wang Zhimeng
• Li Jieshu
• Zheng He

Classifications

• G06T17/05 Primary

  Geographic models · CPC title

• G01S17/89

  for mapping or imaging · CPC title

• G06T2219/2012

  Colour editing, changing, or manipulating; Use of colour codes · CPC title

• G06T19/003

  Navigation within 3D models or images · CPC title

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title