Loading of a load with a crane system

Patent metadata

Field	Value
Publication number	US-2020391981-A1
Application number	US-202016898042-A
Country	US
Kind code	A1
Filing date	Jun 10, 2020
Priority date	Jun 11, 2019
Publication date	Dec 17, 2020
Grant date	—

Abstract

For the automated loading of a load by a crane system, a camera system of the crane system generates at least one image data stream. The at least one image data stream is analyzed by a computer unit with the assistance of an artificial neural network. On the basis of the analysis, a first marker and a second marker are recognized by the computer unit in respective single images of the at least one image data stream. Positions of the markers are determined, and the load is loaded automatically by a lifting device of the crane system dependent upon the positions of the markers.

First claim

What is claimed as new and desired to be protected by Letters Patent is set forth in the appended claims and includes equivalents of the elements recited therein:

1 . A method for loading of a load with a crane system, said method comprising:
generating at least one image data stream by a camera system of the crane system; analyzing the at least one image data stream by a computer unit of the crane system on the basis of an artificial neural network; in response to the analysis of the at least one image data stream by the computer unit, recognizing a first marker in a first single image of the at least one image data stream and recognizing a second marker in a second single image of the at least one image data stream; determining by the computer unit a position of the first marker and a position of the second marker; and automatically loading the load by a lifting device of the crane system dependent upon the positions of the first and second markers.

2 . The method of claim 1 , wherein the camera system is moved along a longitudinal direction of a transport vehicle as the at least one image data stream is generated.

3 . The method of claim 1 , wherein the position of the first marker is determined by the computer unit dependent upon a first momentary position of the camera system when the first marker has been recognized, and wherein the position of the second marker is determined by the computer unit dependent upon a second momentary position of the camera system when the second marker has been recognized.

4 . The method of claim 3 , wherein generating the at least one image data stream includes generating a first image data stream by a first camera of the camera system, which first camera is arranged at a first end of the lifting device, with the first image data stream being analyzed by the computer unit with the assistance of the artificial neural network, wherein the first marker is recognized by the computer unit based on the analysis of the first image data stream, and wherein the first momentary position corresponds to a momentary position of the first camera.

5 . The method of claim 4 , wherein generating the at least one image data stream includes generating a second image data stream by a second camera of the camera system, which second camera is arranged at a second end of the lifting device in opposition to the first end of the lifting device, with the second image data stream being analyzed by the computer unit with the assistance of the artificial neural network, wherein the second marker is recognized by the computer unit based on the analysis of the second image data stream, and wherein the second momentary position corresponds to a momentary position of the second camera.

6 . The method of claim 2 , further comprising in response to the analysis of the at least one image data stream, recognizing a buffer and/or a load fixing means of the transport vehicle as the first marker; and recognizing a further buffer and/or a further load fixing means of the transport vehicle as the second marker.

7 . The method of claim 1 , wherein the position of the first marker is determined by the computer unit dependent upon an arrangement of the first marker in the first single image, and wherein the position of the second marker is determined by the computer unit dependent upon an arrangement of the second marker in the second single image.

8 . The method of claim 1 , further comprising determining a spacing of the first and second markers from one another based on the positions of the first and second markers as determined by the computer unit, wherein the load is loaded by the lifting device dependent upon the spacing.

9 . The method of claim 1 , further comprising setting by a control system of the crane system an operating parameter of the lifting device or the crane system in dependence on the positions of the first and second markers for automatically loading the load.

10 . A crane system, comprising:
a lifting device; a camera system configured to generate at least one image data stream; a computer unit including an artificial neural network, said computer unit being configured to analyze the at least one image data stream with the assistance of the artificial neural network, in response to the analysis to recognize a first marker in a first single image of the at least one image data stream and to recognize a second marker in a second single image of the at least one image data stream, and to determine a position of the first marker and a position of the second marker; and a control system configured to operate the lifting device dependent upon the positions of the first and second markers for loading a load automatically.

11 . The crane system of claim 10 , wherein the control system is configured to move the camera system along a longitudinal direction of a transport vehicle as the at least one image data stream is generated, said computer unit determining the position of the first marker dependent upon a first momentary position of the camera system when the first marker has been recognized, and determining the position of the second marker dependent upon a second momentary position of the camera system when the second marker has been recognized.

12 . The crane system of claim 11 , wherein the camera system includes a first camera arranged at a first end of the lifting device for generating a first image data stream of the at least one image data stream, said computer unit analyzing the first image data stream with the assistance of the artificial neural network and recognizing the first marker based on the analysis of the first image data stream, with the first momentary position corresponding to a momentary position of the first camera.

13 . The crane system of claim 12 , wherein the camera system includes a second camera arranged at a second end of the lifting device in opposition to the first end of the lifting device for generating a second image data stream of the at least one image data stream, said computer unit analyzing the second image data stream with the assistance of the artificial neural network and recognizing the second marker based on the analysis of the second image data stream, with the second momentary position corresponding to a momentary position of the second camera.

14 . The crane system of claim 13 , wherein the camera system includes a third camera arranged at the first end of the lifting device for generating a third image data stream of the at least one image data stream, and a fourth camera arranged at the second end of the lifting device for generating a fourth image data stream of the at least one image data stream, said computer unit analyzing the third image data stream and the fourth image data stream with the assistance of the artificial neural network, recognizing a third marker in a third single image of the third image data stream based on the analysis of the third image data stream, recognizing a fourth marker in a fourth single image of the fourth image data stream based on the analysis of the fourth image data stream, determining a position of the third marker dependent upon a third momentary position of the third camera when the third marker has been recognized, and determining a position of the fourth marker dependent upon a fourth momentary position of the fourth camera when the fourth marker has been recognized, said control system configured to operate the lifting device dependent upon the positions of the third and fourth markers for loading a load automatically.

15 . The crane system of claim 13 , wherein the lifting device has a substant

Assignees

• Siemens Ag

Inventors

• Dobler Thomas
• Vogel Julian

Classifications

• B66C13/48 Primary

  Automatic control of crane drives for producing a single or repeated working cycle; Program control · CPC title

• B66C13/085 Primary

  electrical · CPC title

• G06F18/214

  Generating training patterns; Bootstrap methods, e.g. bagging or boosting · CPC title

• B65G2203/041

  Camera · CPC title

• G06N3/04

  Architecture, e.g. interconnection topology · CPC title