Object detection system and method

Patent metadata

Field	Value
Publication number	US-11293165-B2
Application number	US-201916502710-A
Country	US
Kind code	B2
Filing date	Jul 3, 2019
Priority date	Dec 1, 2015
Publication date	Apr 5, 2022
Grant date	Apr 5, 2022

Abstract

A detection system used to alert an operator of a work machine of humans or objects dangerously close to the machine or a work tool attached to the machine. The detection system uses one or more cameras to capture images of an area surrounding the machine. The captured images are displayed on an interface electronically connected to a processor. Prior to operation, one or more zones surrounding the work tool or work machine are defined and projected on the images displayed on the interface. The processor analyzes the images captured by the cameras and determines if a characteristic of a predetermined object is within one or more of the identified zones. If the processor determines the characteristic of the predetermined object is within one of the zones, the processor will identify the object on the display and trigger a warning system to alert to the operator to take necessary precautions.

First claim

The invention claimed is:

1. A system comprising:
a work machine positionable at ground level;
one or more cameras configured to capture images of areas surrounding the work machine; and
a processor configured to analyze the images captured by one or more of the cameras and determine whether any captured image includes a characteristic of one or more objects that are situated within a previously-defined three-dimensional zone within one or more of the areas, in which a lower boundary of the three-dimensional zone is above ground level;
a monitor configured to display one or more of the captured images in combination with a rendering of the boundaries of any portion of the three-dimensional zone contained within the image or images; and

a safeguard system controlled by the processor that sends one or more hazard signals if the characteristic of any one or more of the objects is within the three-dimensional zone.

2. The system of claim 1 , further comprising:
an interface in communication with the processor and configured to receive human input designating each boundary of the three-dimensional zone.

3. The system of claim 2 in which the interface permits designation of the lower boundary of the three-dimensional zone spaced above ground level.

4. The system of claim 1 in which the processor is configured to cause the monitor to display highlighting of any characteristic of the one or more objects that are situated within the three-dimensional zone.

5. The system of claim 1 in which a field of view of the one or more cameras extends outside one or more of the boundaries displayed on the monitor.

6. The system of claim 1 in which the three-dimensional zone comprises non-overlapping first and second sections, and in which the safeguard system is configured to send hazard signals that differ depending upon which section the characteristic of any one or more of the objects is within.

7. The system of claim 6 in which the second section is fully surrounded by the first section.

8. The system of claim 6 in which the hazard signal associated with the first section comprises a warning signal to the operator.

9. The system of claim 6 , further comprising:
a shutdown system that stops operation of the work machine in response to transmission of a shutdown signal by the safeguard system; and

in which the hazard signal associated with the second section comprises a shutdown signal.

10. The system of claim 1 in which the processor is configured to stop the safeguard system from sending the one or more hazard signals if the processor determines that the characteristic of any one or more of the objects is no longer within the three-dimensional zone.

11. The system of claim 1 in which the processor is configured to permit reactivation of the work machine if the processor determines that the characteristic of any one or more of the objects is no longer within the three-dimensional zone.

12. The system of claim 1 in which the one or more hazard signals comprise a warning signal to the operator.

13. The system of claim 1 in which the three-dimensional zone does not include an area immediately surrounding a work tool attached to the work machine.

14. The system of claim 1 in which the one or more of the cameras are supported on the work machine.

15. The system of claim 1 , further comprising:
a shutdown system that stops operation of the work machine in response to transmission of a shutdown signal by the safeguard system; and
in which the hazard signal comprises the shutdown signal.

16. The system of claim 1 in which the one or more objects are moving objects.

17. The system of claim 1 in which the three-dimensional zone has the shape of a parallelepiped.

18. The system of claim 1 in which the work machine carries a work tool, in which the one or more cameras are configured to capture images of areas surrounding the work tool, and further comprising:
a shutdown system that stops operation of the work tool in response to transmission of a shutdown signal by the safeguard system; and

in which the hazard signal comprises the shutdown signal.

19. A system comprising:
a work machine;
one or more cameras configured to capture images of areas surrounding the work machine;
a processor configured to analyze the images captured by one or more of the cameras and determine whether any captured image includes a characteristic of one or more objects that are situated within a three-dimensional zone within one or more of the areas, in which the work machine is positionable at ground level and a lower boundary of the three-dimensional zone is above ground level; and

a safeguard system controlled by the processor that sends one or more hazard signals if the characteristic of any one or more of the objects is within the three-dimensional zone.

Assignees

• Charles Machine Works

Inventors

• Sharp Richard F
• Avitabile Michael
• Chilton Ryan
• Hastings Benjamin
• Conner David C

Classifications

• E02F9/262

  with follow-up actions to control the work tool, e.g. controller · CPC title

• E02F9/2033

  Limiting the movement of frames or implements, e.g. to avoid collision between implements and the cabin (sub-groups of E02F3/431 of E02F3/435 take precedence; for turntables E02F9/123) · CPC title

• E02F9/261

  Surveying the work-site to be treated · CPC title

• E02F9/24

  Safety devices {, e.g. for preventing overload (E02F9/226 takes precedence)} · CPC title

• E02F5/06

  with digging elements mounted on an endless chain {(E02F5/109 takes precedence; with digging elements mounted on an endless chain per se E02F3/08)} · CPC title