Systems, methods, and media for generating point cloud frame training data

Patent metadata

Field	Value
Publication number	US-2025356577-A1
Application number	US-202519281163-A
Country	US
Kind code	A1
Filing date	Jul 25, 2025
Priority date	Jan 28, 2023
Publication date	Nov 20, 2025
Grant date	—

Abstract

Methods, systems, and media for generating point cloud frame training data are provided. First domain point cloud data comprising a point cloud frame corresponding to a first LiDAR sensor configuration is obtained. For each ray, a pixel of a range image is generated by selecting a set of points from the first domain point cloud data based on a certain threshold distance of the points to the ray, a first peak of the pixel is identified as a subset of the set of points based on a distance value of each point in the subset, and the subset of points is processed using an averaging function to generate estimated reflectance data for the ray. The estimated reflectance data of each ray of the plurality of rays is processed to generate simulated second domain point cloud data comprising a point cloud frame corresponding to the second LiDAR sensor configuration.

First claim

1 . A method for generating point cloud frame training data, comprising:
obtaining first domain point cloud data comprising a point cloud frame corresponding to a first LiDAR sensor configuration; generating a plurality of rays representative of laser trajectories of a second LiDAR sensor configuration; for each ray:
generating a pixel of a range image by selecting a set of points from the first domain point cloud data based on a certain threshold distance of the points to the ray;
identifying a first peak of the pixel as a subset of the set of points based on a distance value of each point in the subset; and
processing the subset of points, using an averaging function, to generate estimated reflectance data for the ray; and
processing the estimated reflectance data of each ray of the plurality of rays to generate simulated second domain point cloud data comprising a point cloud frame corresponding to the second LiDAR sensor configuration.

2 . The method of claim 1 , wherein the point cloud frame of the first domain point cloud data is a dense point cloud frame, and wherein obtaining the first domain point cloud data comprises:
obtaining raw first domain point cloud data comprising a raw point cloud frame corresponding to a first LiDAR sensor configuration; and densifying the raw first domain point cloud data to generate the first domain point cloud data.

3 . The method of claim 2 , wherein densifying the raw first domain point cloud data comprises constructing a 3D environment based on the raw first domain point cloud data.

4 . The method of claim 1 , wherein identifying the first peak comprises:
identifying a first point based on the proximity of the first point to the ray and the distance value of the first point; and identifying a last point of the first peak based on the proximity of the last point to the ray and the distance value of the last point.

5 . The method of claim 1 , wherein the averaging function comprises a weighted average function based on an inverse distance weighting function wherein each point in the subset is associated with a weight inversely correlated with the proximity of the point to the ray.

6 . The method of claim 1 , further comprising:
processing the first domain point cloud data and the simulated second domain point cloud data to generate voxelized data comprising coordinate values and intensity values for each point of the first domain point cloud data and each point of the simulated second domain point cloud data found in each of a plurality of voxels; obtaining, for each voxel, a retained point ratio comprising the ratio of points in the first domain point cloud data to the points in the simulated second domain point cloud data; and generating a refined simulated point cloud frame comprising a plurality of points of the simulated second domain point cloud data gathered from voxels having a retained point ratio higher than a pre-determined threshold.

7 . The method of claim 6 , wherein the coordinate values comprise an angle value and a distance value for each point, and the surface reflectance values comprise an intensity value for each point.

8 . The method of claim 6 , wherein processing the first domain point cloud data and the simulated second domain point cloud data to generate the voxelized data comprises projecting the points from the first domain point cloud data and the points from the simulated second domain point cloud data into an input parameter space, wherein the parameter space comprises possible parameter values that define a mathematical model.

9 . The method of claim 8 , wherein processing the first domain point cloud data and the simulated second domain point cloud data to generate the voxelized data further comprises voxelizing the input parameter space.

10 . The method of claim 6 , wherein generating the refined simulated point cloud frame comprises approximating a distribution of a retained point ratio of each voxel by a multi-layer perceptron.

11 . The method of claim 10 , wherein the approximated distribution of the retained point ratio comprises only voxels that have a number of LiDAR simulated point cloud points above a pre-determined threshold.

12 . A method for generating point cloud frame training data, comprising:
obtaining a real LiDAR point cloud and a simulated LiDAR point cloud, each comprising coordinate values and surface reflectance values for each of a plurality of points; processing the real LiDAR point cloud and the simulated LiDAR point cloud to generate voxelized data comprising coordinate values and intensity values for each point of the real LiDAR point cloud and each point of the simulated LiDAR point cloud found in each of a plurality of voxels; obtaining, for each voxel, a retained point ratio comprising the ratio of points in the real LiDAR point cloud frame to the points in the simulated LiDAR point cloud frame; and generating a refined simulated LiDAR simulation point cloud frame comprising a plurality of points of the simulated point cloud frame gathered from voxels having a retained point ratio higher than a pre-determined threshold.

13 . The method of claim 12 , wherein the coordinate values comprise an angle value and a distance value for each point, and the surface reflectance values comprise an intensity value for each point.

14 . The method of claim 12 , wherein processing the real LiDAR point cloud and the simulated LiDAR point cloud to generate the voxelized data comprises projecting the points from the real LiDAR point cloud and the points from the simulated LiDAR point cloud into an input parameter space, wherein the parameter space comprises possible parameter values that define a mathematical model.

15 . The method of claim 14 , wherein processing the real LiDAR point cloud and the simulated LiDAR point cloud to generate the voxelized data further comprises voxelizing the input parameter space.

16 . The method of claim 12 , wherein generating the refined simulated LiDAR simulation point cloud frame comprises approximating a distribution of a retained point ratio of each voxel by a multi-layer perceptron.

17 . The method of claim 16 , wherein the approximated distribution of the retained point ratio comprises only voxels that have a number of LiDAR simulated point cloud points above a pre-determined threshold.

18 . A system for generating point cloud frame training data, comprising:
one or more processors; and a memory storing an initial point cloud, and machine-executable instructions which, when executed by the one or more processors, cause the system to:
obtain first domain point cloud data comprising a point cloud frame corresponding to a first LiDAR sensor configuration;
generate a plurality of rays representative of laser trajectories of a second LiDAR sensor configuration;
for each ray:
generate a pixel of a range image by selecting a set of points from the first domain point cloud data based on a certain threshold distance of the points to the ray;
identify a first peak of the pixel as a subset of the set of points based on a distance value of each point in the subset; and
process the subset of points, using an averaging function, to generate estimated reflectance data for the ray; and

process the estimated reflectance data of each ray of the plurality of rays to generate simulated second domain point cloud data comprising a point cloud frame corresponding to the second LiDAR sensor configuration.

19 . The system of claim 18 , wherein the point cloud frame of the first domain p

Assignees

• Huawei Tech Co Ltd

Inventors

• Ren Yuan
• Li Chenqi
• Liu Bingbing

Classifications

• G06T2210/56

  Particle system, point based geometry or rendering · CPC title

• G06T15/06

  Ray-tracing · CPC title

• G06T2207/20081

  Training; Learning · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G06T7/521

  from laser ranging, e.g. using interferometry; from the projection of structured light · CPC title