Processing device, processing method, and computerreadable medium

Patent metadata

Field	Value
Publication number	US-2022343629-A1
Application number	US-201917641175-A
Country	US
Kind code	A1
Filing date	Sep 20, 2019
Priority date	Sep 20, 2019
Publication date	Oct 27, 2022
Grant date	—

Abstract

A processing device (10) includes a classification means (12) for classifying three-dimensional point cloud data acquired based on reflected light from a plurality of reinforcing steel bars irradiated with light in a bar arrangement inspection into clusters, which are shape units corresponding to the plurality of reinforcing steel bars, based on position information at each point in the three-dimensional point cloud data, a smoothing means (13) for smoothing the contours of the classified clusters, and a cluster association means (14) for determining whether a first cluster and a second cluster contained in the smoothed clusters correspond to the same reinforcing steel bar based on positional relation between the smoothed clusters.

First claim

What is claimed is:

1 . A processing device comprising:
at least one memory storing instructions, and at least one processor configured to execute the instructions to; classify three-dimensional point cloud data acquired based on reflected light from a plurality of reinforcing steel bars irradiated with light in a bar arrangement inspection into clusters, the clusters being shape units corresponding to the plurality of reinforcing steel bars, based on position information at each point in the three-dimensional point cloud data; smooth contours of the classified clusters; and determine whether a first cluster and a second cluster contained in the smoothed clusters correspond to the same reinforcing steel bar based on a positional relation between the smoothed clusters.

2 . The processing device according to claim 1 , wherein the at least one processor detects a longest direction, in which a largest number of points are lined, of each of the smoothed clusters, extracts clusters whose longest directions each have a length equal to or longer than a predetermined length as reference clusters from among the smoothed clusters, uses an arbitrary cluster among the reference clusters as the first cluster, and uses an arbitrary cluster among clusters whose longest directions coincide with the longest direction of the first cluster among the smoothed clusters as the second cluster.

3 . The processing device according to claim 1 , the at least one processor configured to execute the instructions to:
extract, as a plane decision cluster, clusters having the same longest direction from clusters corresponding to reinforcing steel bars located at a position where there is no obstruction in front of a three-dimensional sensor configured to irradiate the plurality of reinforcing steel bars with light; and decide a first reference plane containing the plane decision cluster, a second reference plane perpendicular to the first reference plane and horizontal to the longest direction of the plane decision cluster, and a third reference plane perpendicular to the first reference plane and the second reference plane, wherein the at least one processor smooths clusters having longest directions horizontal to any of the first reference plane, the second reference plane, and the third reference plane.

4 . The processing device according to claim 1 , the at least one processor configured to execute the instructions to:
decide a first reference direction having the highest frequency of the longest direction of each of the classified clusters, a second reference direction having the next highest frequency after the first reference direction, and a third reference direction that is a direction of an outer product of the first reference direction and the second reference direction, wherein the at least one processor smooths clusters having longest directions parallel to any of the first reference direction, the second reference direction, and the third reference direction.

5 . A processing method comprising the steps of:
classifying three-dimensional point cloud data acquired based on reflected light from a plurality of reinforcing steel bars irradiated with light in a bar arrangement inspection into clusters, the clusters being shape units corresponding to the plurality of reinforcing steel bars, based on position information at each point in the three-dimensional point cloud data; smoothing contours of the classified clusters; and determining whether a first cluster and a second cluster contained in the classified clusters correspond to the same reinforcing steel bar based on a positional relation between the smoothed clusters.

6 . A non-transitory computer-readable medium storing a program causing a computer to execute the steps of:
classifying three-dimensional point cloud data acquired based on reflected light from a plurality of reinforcing steel bars irradiated with light in a bar arrangement inspection into clusters, the clusters being shape units corresponding to the plurality of reinforcing steel bars, based on position information at each point in the three-dimensional point cloud data; smoothing contours of classified clusters; and determining whether a first cluster and a second cluster contained in the classified clusters correspond to the same reinforcing steel bar based on a positional relation between the smoothed clusters.

Assignees

• Nec Corp

Inventors

• Ono Yoshimasa
• Tsuji Akira
• Abe Junichi

Classifications

• G06V2201/06

  Recognition of objects for industrial automation · CPC title

• G06V10/762 Primary

  using clustering, e.g. of similar faces in social networks · CPC title

• G06V2201/12

  Acquisition of 3D measurements of objects · CPC title

• G06V10/764 Primary

  using classification, e.g. of video objects · CPC title

• G06T7/00

  Image analysis · CPC title