Systems for detecting and picking up a waste receptacle

Patent metadata

Field	Value
Publication number	US-2024359908-A1
Application number	US-202418642328-A
Country	US
Kind code	A1
Filing date	Apr 22, 2024
Priority date	Apr 28, 2023
Publication date	Oct 31, 2024
Grant date	—

Abstract

An intermediate container system for detecting a waste receptacle includes an intermediate container and a processor. The intermediate container includes a container, an extension arm coupled to the container, a manipulator coupled to a distal end of the extension arm, and a camera configured to obtain image data associated with a target area proximate the intermediate container. The processor is configured to generate, based on the image data, a pose candidate located within the target area. The processor is also configured to verify if the pose candidate matches a template representation corresponding to the waste receptacle. Responsive to the pose candidate matching the template representation, the processor is also configured to determine a location of the waste receptacle. The processor is also configured to operate at least one of the extension arm or the manipulator to move the manipulator based on the location of the waste receptacle.

First claim

1 . An intermediate container system for detecting and engaging a waste receptacle, the intermediate container system comprising:
an intermediate container configured to couple to a refuse vehicle, the intermediate container comprising:
a container defining an internal cavity configured to receive refuse from the waste receptacle;
an extension arm coupled to the container, the extension arm configured to extend from the container;
a manipulator coupled to a distal end of the extension arm, the manipulator configured to engage the waste receptacle; and
a camera configured to obtain image data associated with a target area proximate the intermediate container; and
a processor configured to:
generate, based on the image data, a pose candidate located within the target area;
verify if the pose candidate matches a template representation corresponding to the waste receptacle;
responsive to the pose candidate matching the template representation, determine a location of the waste receptacle; and
operate at least one of the extension arm or the manipulator to move the manipulator based on the location of the waste receptacle.

2 . The intermediate container system of claim 1 , wherein responsive to the pose candidate not matching the template representation, the processor is further configured to limit operation of at least one of the extension arm or the manipulator.

3 . The intermediate container system of claim 1 , wherein operation of the at least one of the extension arm or the manipulator includes operating the at least one of the extension arm or the manipulator to move the manipulator to an engagement position, grasp the waste receptacle with the manipulator, lift the waste receptacle, empty contents of the waste receptacle into the internal cavity of the container, lower the waste receptacle, and release the waste receptacle, wherein the manipulator is positioned to grasp the waste receptacle when the manipulator is in the engagement position.

4 . The intermediate container system of claim 3 , wherein prior to operating the manipulator to grasp the waste receptacle, the processor is further configured to:
determine, based on the image data, if the manipulator is in the engagement position; and responsive to the manipulator not being in the engagement position, further operate the at least one of the extension arm or the manipulator to move the manipulator to the engagement position.

5 . The intermediate container system of claim 1 , wherein:
the camera is a first camera; and the intermediate container further comprises a second camera configured to obtain the image data associated with the target area proximate the intermediate container.

6 . The intermediate container system of claim 5 , wherein the pose candidate is a first pose candidate generated based on the image data of the first camera; and
wherein the processor is further configured to:
generate, based on the image data of the second camera, a second pose candidate located within the target area;
verify if the second pose candidate matches the template representation corresponding to the waste receptacle; and
responsive to the second pose candidate matching the template representation, determine the location of the waste receptacle using the image data obtained by the first camera and the second camera to triangulate the location of the waste receptacle.

7 . The intermediate container system of claim 6 , wherein the first camera is coupled to the container and the second camera is coupled to the extension arm, wherein the second camera is configured to extend from the container with the extension arm.

8 . The intermediate container system of claim 5 , wherein the pose candidate is a first pose candidate generated based on the image data of the first camera; and
wherein the processor is further configured to:
determine a first pose location of the first pose candidate;
generate, based on the image data of the second camera, a second pose candidate located within the target area;
verify if the second pose candidate matches the template representation corresponding to the waste receptacle;
responsive to the second pose candidate matching the template representation, determine a second pose location of the second pose candidate; and
responsive to a difference between the first pose location and the second pose location being less than a location error threshold, determine that the location of the waste receptacle is at least one of the first pose location, the second pose location, or an average of the first pose location and the second pose location.

9 . The intermediate container system of claim 1 , wherein the pose candidate is a first pose candidate generated based on the image data of the camera when the camera is in a first position; and
wherein the processor is further configured to:
determine a first pose location of the first pose candidate;
generate, based on the image data of the camera when the camera is in a second position, a second pose candidate located within the target area;
verify if the second pose candidate matches the template representation corresponding to the waste receptacle;
responsive to the second pose candidate matching the template representation, determine a second pose location of the second pose candidate; and
responsive to a difference between the first pose location and the second pose location being less than a location error threshold, determine that the location of the waste receptacle is at least one of the first pose location, the second pose location, or an average of the first pose location and the second pose location.

10 . A refuse vehicle comprising:
a lift assembly; an intermediate container coupled to the lift assembly, the intermediate container comprising:
a container defining an internal cavity configured to receive refuse from a waste receptacle;
an extension arm coupled to the container, the extension arm configured to extend from the container in a direction transverse a direction of travel of the refuse vehicle;
a manipulator coupled to a distal end of the extension arm, the manipulator configured to engage the waste receptacle; and
a camera configured to obtain image data associated with a target area proximate the intermediate container; and
a processor configured to:
generate, based on the image data, a pose candidate located within the target area;
verify if the pose candidate matches a template representation corresponding to the waste receptacle;
responsive to the pose candidate matching the template representation, determine a location of the waste receptacle; and
operate at least one of the extension arm or the manipulator to move the manipulator based on the location of the waste receptacle.

11 . The refuse vehicle of claim 10 , wherein responsive to the pose candidate not matching the template representation, the processor is further configured to limit operation of at least one of the extension arm or the manipulator.

12 . The refuse vehicle of claim 10 , wherein operation of the at least one of the extension arm or the manipulator includes operating the at least one of the extension arm or the manipulator to move the manipulator to an engagement position, grasp the waste receptacle with the manipulator, lift the waste receptacle, empty contents of the waste receptacle into the internal cavity of the container, lower the waste receptacle, and release the waste receptacle, wherein the manipulator is positioned to grasp the waste receptacle when the manipulator is in the engagement position.

13 . The refuse vehicle of claim 12 , wherein prior to operating the manipu

Assignees

• Oshkosh Corp

Inventors

• Van Kampen Leo
• Patel Umang
• Solberg Jake
• Meyer Jeff
• Codega Eric
• Bualat Jamsel

Classifications

• B65F3/0213

  Means for facilitating the separation of discharging means from collecting vehicles · CPC title

• B65F1/1452

  Lifting, hoisting, elevating mechanisms or the like for refuse receptacles (lifting in general B66) · CPC title

• B65F1/122 Primary

  Features allowing the receptacle to be lifted and subsequently tipped by associated means on a vehicle · CPC title

• B65F2003/0279

  the discharging means mounted at the front of the vehicle · CPC title

• B65F2003/023

  Gripper arms for embracing the receptacle · CPC title