Guide display device and crane equipped with same

Patent metadata

Field	Value
Publication number	US-12215001-B2
Application number	US-202117911049-A
Country	US
Kind code	B2
Filing date	Mar 23, 2021
Priority date	Mar 26, 2020
Publication date	Feb 4, 2025
Grant date	Feb 4, 2025

Abstract

The present invention provides a guide display device capable of recognizing a feature in a work area while distinguishing whether the feature is a moving body or not. In a guide display device of a crane, 3D maps are created for continuous frames; an altitude value for each grid in a 3D map that is created at time closest to the current time is obtained as a first altitude value; altitude values for respective corresponding grids in a predetermined number of 3D maps other than the 3D map that is created at time closest to the current time are obtained, and the average of the altitude values is calculated as a second altitude value; and it is determined that the feature is a moving body when the difference between the first altitude value and the second altitude value exceeds a predetermined threshold.

First claim

The invention claimed is:

1. A guide display device of a crane, comprising:
a data processing section configured to calculate a representative point for each grid cell by using point group data acquired with a laser scanner by scanning a lifting cargo, a ground surface and a ground object from above the lifting cargo and create a three-dimensional map based on the representative point,
wherein the data processing section creates the three-dimensional map for each frame that is generated successively based on the point cloud data acquired at each time,
wherein the data processing section labels each grid cell of the three-dimensional map with either the lifting cargo, the ground surface, or the ground object based on a height of the representative point of each grid cell,
wherein the data processing section acquires an altitude value of each grid cell as a first altitude value for the three-dimensional map created at a time closest to a current time,
wherein the data processing section acquires an altitude value of each grid cell for a predetermined number of other three-dimensional maps excluding the three-dimensional map created at the time closest to the current time, and calculates an average of the altitude value as a second altitude value,
wherein the data processing section calculates a difference between the first altitude value and the second altitude value for each corresponding grid of the three-dimensional map, and determines that the ground object is a moving object when the difference exceeds a predetermined threshold value, and
wherein the data processing section associates the three-dimensional map with an image captured by a camera from above the lifting cargo and creates a guide frame diagram for the ground object identified on the three-dimensional map, and displays the guide frame diagram by superimposing it on the image, the guide frame diagram being set so that it is possible for an operator to distinguish whether the ground object is the moving object or not.

2. A crane comprising the guide display device according to claim 1 .

3. A guide display device of a crane, comprising:
a data processing section configured to calculate a representative point for each grid cell by using point group data acquired with a laser scanner by scanning a lifting cargo, a ground surface and a ground object from above the lifting cargo and create a three-dimensional map based on the representative point,
wherein the data processing section creates the three-dimensional map for each frame that is generated successively based on the point cloud data acquired at each time,
wherein the data processing section labels each grid cell of the three-dimensional map with either the lifting cargo, the ground surface, or the ground object based on a height of the representative point of each grid cell,
wherein the data processing section acquires an altitude value of each grid cell for a predetermined number of the three-dimensional maps including the three-dimensional map created at a time closest to a current time, and calculates an average of the altitude value as a first average value,
wherein the data processing section acquires an altitude value of each grid cell for a predetermined number of other three-dimensional maps excluding the three-dimensional map created at the time closest to the current time, and calculates an average of the altitude value as a second average value,
wherein the data processing section calculates a difference between the first altitude value and the second altitude value for each corresponding grid of the three-dimensional map, and determines that the ground object is a moving object when the difference exceeds a predetermined threshold value, and
wherein the data processing section associates the three-dimensional map with an image captured by a camera from above the lifting cargo and creates a guide frame diagram for the ground object identified on the three-dimensional map, and displays the guide frame diagram by superimposing it on the image, the guide frame diagram being set so that it is possible for an operator to distinguish whether the ground object is the moving object or not.

4. A guide display device of a crane, comprising:
a data processing section configured to calculate a representative point for each grid cell by using point group data acquired with a laser scanner by scanning a lifting cargo, a ground surface and a ground object from above the lifting cargo and create a three-dimensional map based on the representative point,
wherein the data processing section creates the three-dimensional map for each frame that is generated successively based on the point cloud data acquired at each time,
wherein the data processing section provides a label value for each grid cell of the three-dimensional map with either the lifting cargo, the ground surface, or the ground object based on a height of the representative point of each grid cell,
wherein the data processing section acquires the label value of each grid cell as a first label value for the three-dimensional map created at a time closest to a current time,
wherein the data processing section acquires the label value of each grid cell for a predetermined number of other three-dimensional maps excluding the three-dimensional map created at the time closest to the current time, and calculates an average of the label value as a second label value,
wherein the data processing section calculates a difference between the first altitude value and the second altitude value for each corresponding grid of the three-dimensional map, and determines that the ground object is a moving object when the difference exceeds a predetermined threshold value, and
wherein the data processing section associates the three-dimensional map with an image captured by a camera from above the lifting cargo and creates a guide frame diagram for the ground object identified on the three-dimensional map, and displays the guide frame diagram by superimposing it on the image, the guide frame diagram being set so that it is possible for an operator to distinguish whether the ground object is the moving object or not.

5. A guide display device of a crane, comprising:
a data processing section configured to calculate a representative point for each grid cell by using point group data acquired with a laser scanner by scanning a lifting cargo, a ground surface and a ground object from above the lifting cargo and create a three-dimensional map based on the representative point,
wherein the data processing section creates the three-dimensional map for each frame that is generated successively based on the point cloud data acquired at each time,
wherein the data processing section labels each grid cell of the three-dimensional map with either the lifting cargo, the ground surface, or the ground object based on a height of the representative point of each grid cell,
wherein the data processing section acquires, as a first ground object position, a position of the ground object in the three-dimensional map created at a time closest to a current time,
wherein the data processing section acquires, as a second ground object position, the position of the ground object in another three-dimensional map excluding the three-dimensional map created at a time closest to a current time,
wherein the data processing section calculates a difference between the first altitude value and the second altitude value for each corresponding grid of the three-dimensional map, and determines that the ground object is a moving object when the difference exceeds a predetermined threshold value, and
wherein the data processing section associates the three-dimensional map with an image captured by a camera from above the lifting cargo and creates a guide frame diagram for the ground ob

Assignees

• Tadano Ltd
• The School Corporation Kansai Univ

Inventors

• Ishikawa Iwao
• Kosaka Takayuki
• Mashima Keita
• Kubota Satoshi
• Tanaka Shigenori
• NAKAHARA Masaya
• Nakahata Koki

Classifications

• G01S17/89 Primary

  for mapping or imaging · CPC title

• G06V20/70

  Labelling scene content, e.g. deriving syntactic or semantic representations · CPC title

• G06V10/762

  using clustering, e.g. of similar faces in social networks · CPC title

• G06V10/25

  Determination of region of interest [ROI] or a volume of interest [VOI] · CPC title

• G06V20/64

  Three-dimensional [3D] objects · CPC title