Camera-assisted crane safety

Patent metadata

Field	Value
Publication number	US-11618655-B2
Application number	US-201916367326-A
Country	US
Kind code	B2
Filing date	Mar 28, 2019
Priority date	Mar 28, 2019
Publication date	Apr 4, 2023
Grant date	Apr 4, 2023

Abstract

Aspects of this disclosure relate to a system that uses images of a load handled by a crane as captured by cameras to monitor the load. The images may include different sets of outer perimeters of the load. The system may identify the outer perimeters and then define a safety zone that extends beyond these outer perimeters. In response to identifying an object within the safety zone, the system may execute a remedial action.

First claim

What is claimed is:

1. A method comprising:
receiving a first image of a load of a crane from a first camera secured to the crane, wherein the first image depicts the load and a vicinity of the load adjacent a first set of perimeters of the load that are visible from the first camera;
receiving a second image of the load from a second camera secured to the crane, wherein the second image depicts the load and the vicinity of the load adjacent a second set of perimeters of the load visible from the second camera, wherein the second set of perimeters includes at least one additional perimeter in comparison to the first set of perimeters;
identifying, by a processor, the first and second sets of perimeters of the load by analyzing the first and second images using visual recognition techniques;
defining, by the processor, a three-dimensional safety zone of the load that extends beyond perimeters of the first and second set of perimeters;
determining, by the processor, a direction of movement of the load and subsequently shrinking the safety zone along one or more perimeters of the first and second set of perimeters that face away from the direction of movement;
identifying, by the processor analyzing the first and second image, a first object in the safety zone;
disregarding the first object in response to identifying the first object as something that does not pose a notable safety concern as a result of being in the safety zone;
identifying, by the processor analyzing the first and second image, a second object in the safety zone; and
executing, by the processor, a remedial action in response to identifying the second object in the safety zone, wherein the remedial action includes autonomously overriding manual operation of the crane to stop movement of the load into the safety zone in response to detecting the second object in the safety zone.

2. The method of claim 1 , wherein the first camera is a wide-area camera affixed to a hoist of the crane.

3. The method of claim 1 , wherein the second camera is a wide-area camera affixed to a cabin of the crane.

4. The method of claim 1 , wherein the remedial action includes generating an alarm.

5. The method of claim 4 , wherein the alarm includes visual or audible stimuli within a cabin of the crane.

6. The method of claim 4 , wherein the alarm includes visual or audible stimuli near the load.

7. The method of claim 1 , wherein the remedial action includes overriding manual operation of the crane to autonomously stop the crane from moving as manual operation is calling for the crane to move.

8. The method of claim 1 , wherein the remedial action includes overriding manual operation of the crane to stop movement of the load in response to detecting the second object in the safety zone.

9. The method of claim 1 , further comprising the processor extending the safety zone along one or more perimeters of the first and second set of perimeters that are facing the direction of movement.

10. The method of claim 1 , further comprising the processor determining a current direction of movement of the second object and extending the safety zone along one or more perimeters of the first and second set of perimeters that are facing the direction of movement of the second object.

11. The method of claim 1 , further comprising identify a feature of the first and second images within the safety zone and not executing the remedial action in response to determining that the feature does not indicate a safety concern.

12. A system comprising:
a processor; and
a memory in communication with the processor, the memory containing program instructions that, when executed by the processor, are configured to cause the processor to:
receive a first image of a load of a crane from a first camera secured to the crane, wherein the first image depicts the load and a vicinity of the load adjacent a first set of perimeters of the load that are visible from the first camera;

receive a second image of the load from a second camera secured to the crane, wherein the second image depicts the load and the vicinity of the load adjacent a second set of perimeters of the load visible from the second camera, wherein the second set of perimeters includes at least one additional perimeter in comparison to the first set of perimeters;
identify the first and second sets of perimeters of the load by analyzing the first and second images using visual recognition techniques;
define a three-dimensional safety zone of the load that extends beyond perimeters of the first and second set of perimeters;
determine a direction of movement of the load and subsequently shrinking the safety zone along one or more perimeters of the first and second set of perimeters that face away from the direction of movement;
identify a first object in the safety zone by analyzing the first and second image;
disregard the first object in response to identifying the first object as something that does not pose a notable safety concern as a result of being in the safety zone;
identify a second object in the safety zone by analyzing the first and second image; and
execute a remedial action in response to identifying the second object in the safety zone, wherein the remedial action includes autonomously overriding manual operation of the crane to stop movement of the load into the safety zone in response to detecting the second object in the safety zone.

13. The system of claim 12 , wherein the first camera is a wide-area camera affixed to a hoist secured to an end of a jib of the crane.

14. The system of claim 12 , wherein the second camera is a wide-area camera affixed to a cabin of the crane.

15. The system of claim 12 , wherein the remedial action includes generating an alarm that includes visual or audible stimuli.

16. The system of claim 12 , wherein the remedial action includes overriding manual operation of the crane to autonomously move the load in a first direction as a crane operator is sending a command for the load to move in a second direction.

17. The system of claim 12 , wherein the remedial action includes overriding manual operation of the crane to stop movement of the load in response to detecting the second object in the safety zone.

18. The system of claim 12 , the memory further comprising instructions configured to cause the processor to extend the safety zone along one or more perimeters of the first and second set of perimeters that are facing the direction of movement.

19. The system of claim 12 , the memory further comprising instructions configured to cause the processor to determine a current direction of movement of the second object and extending the safety zone along one or more perimeters of the first and second set of perimeters that are facing the direction of movement.

20. A computer program product, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to:
receive a first image of a load of a crane from a first camera secured to the crane, wherein the first image depicts the load and a vicinity of the load adjacent a first set of perimeters of the load that are visible from the first camera;
receive a second image of the load from a second camera secured to the crane, wherein the second image depicts the load and the vicinity of the load adjacent a second set of perimeters of the load visible from the second camera, wherein the second set of perimeters includes

Assignees

• IBM

Inventors

• Pinel Florian
• Coldicott Peter Alan
• Bobbitt Russell Patrick

Classifications

• B66C13/46 Primary

  Position indicators for suspended loads or for crane elements · CPC title

• B66C15/045

  electrical · CPC title

• B66C23/905

  electrical · CPC title

• B66C13/16

  Applications of indicating, registering, or weighing devices (in crane hooks B66C1/40; in safety gear B66C15/00; weighing-apparatus G01G; remote indicating in general G08) · CPC title