Robotic system to control multiple robots to perform a task cooperatively

Patent metadata

Field	Value
Publication number	US-12138807-B2
Application number	US-202318234825-A
Country	US
Kind code	B2
Filing date	Aug 16, 2023
Priority date	Nov 1, 2021
Publication date	Nov 12, 2024
Grant date	Nov 12, 2024

Abstract

A robotic system to control multiple robots to perform a task cooperatively is disclosed. A first robot determines to perform a task cooperatively with a second robot, moves independently to a first grasp position to grasp an object associated with the task, receives an indication that the second robot is prepared to perform the task cooperatively, and moves the object independently of the second robot in a leader mode along a trajectory determined by the first robot. The second robot assists the first robot in performing the task cooperatively, at least in part by moving independently to a second grasp position, grasping the object, and cooperating with the first robot to move the object, at least in part by operating in a follower mode of operation to maintain engagement with the object as the first robot moves the object along the trajectory.

First claim

What is claimed is:

1. A system, comprising:
a communication interface associated with a first robot having a first end effector, the communication interface configured to:
receive from a second robot an indication to begin a cooperative task of moving an object in a follower mode of operation; and
receive from the second robot an end effector position and orientation of a second end effector associated with the second robot relative to the object associated with the cooperative task; and

a processor associated with the first robot coupled to the communication interface and configured to:
determine a first grasp point for the object based on a second grasp point at which the second robot has indicated it will grasp the object;
cause a robotic arm of the first robot having the first end effector to move to the first grasp point to grasp the object; and
compute a new target position and orientation for the first end effector based in part on the received end effector position and the received orientation information of the second end effector of the second robot relative to the object associated with the cooperative task and information about the object associated with the cooperative task.

2. The system of claim 1 , wherein the second robot is in a leader mode of operation.

3. The system of claim 1 , wherein the processor is further configured to plan a trajectory to move the first end effector to the first grasp point.

4. The system of claim 1 , wherein the first grasp point is on an opposite side of the object from a side at which the second robot has indicated it will grasp the object.

5. The system of claim 1 , wherein the information about the object associated with the cooperative task includes a size of the object in a dimension that separates the second end effector and the first end effector.

6. The system of claim 1 , wherein the processor is further configured to cause torque to be applied to one or more motors based on the computed new target position and orientation for the first end effector.

7. The system of claim 6 , wherein the applied torque minimizes a difference between a current position and/or orientation of the first end effector, and the new target position and orientation.

8. The system of claim 1 , wherein the processor is further configured to provide to the second robot an indication that the object has been grasped and the first end effector is ready to maintain its position relative to the second end effector associated with the second robot.

9. The system of claim 1 , wherein the communication interface is further configured to receive from the second robot an indication that the cooperative task of moving the object has been completed.

10. The system of claim 1 , wherein the processor is further configured to cause the grasp of the object to be released in response to receiving the indication that the cooperative task of moving the object has been completed.

11. The system of claim 1 , wherein the first end effector is a suction type end effector.

12. The system of claim 1 , wherein the first end effector is a gripper type end effector.

13. The system of claim 1 , wherein the processor is further configured to compute a transform to be applied to the received end effector position and the received orientation.

14. The system of claim 1 , wherein the processor is further configured to use velocity control to match a corresponding velocity of the second end effector associated with the second robot.

15. The system of claim 1 , wherein the processor is further configured to use force control to maintain engagement of the first end effector with the object as the object is moved through a trajectory.

16. A method, comprising:
receiving by a first robot from a second robot an indication to begin a cooperative task of moving an object in a follower mode of operation;
determining a first grasp point for the object based on a second grasp point at which the second robot has indicated it will grasp the object;
moving a robotic arm associated with the first robot having a first end effector to the first grasp point to grasp the object;
receiving from the second robot an end effector position and orientation of a second end effector associated with the second robot relative to the object associated with the cooperative task; and
computing a new target position and orientation for the first end effector associated with the first robot based in part on the received end effector position and the received orientation information of the second end effector associated with the second robot relative to the object associated with the cooperative task and information about the object associated with the cooperative task.

17. The method of claim 16 , wherein the second robot is in a leader mode of operation.

18. The method of claim 16 , further comprising planning a trajectory to move the first end effector associated with the first robot to the first grasp point.

19. The method of claim 16 , wherein the first grasp point is on an opposite side of the object from a side at which the second robot has indicated it will grasp the object.

20. A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions for:
receiving by a first robot from a second robot an indication to begin a cooperative task of moving an object in a follower mode of operation;
determining a first grasp point for the object based on a second grasp point at which the second robot has indicated it will grasp the object;
moving a robotic arm associated with the first robot having a first end effector to the first grasp point to grasp the object;
receiving from the second robot an end effector position and orientation of a second end effector associated with the second robot relative to the object associated with the cooperative task; and
computing a new target position and orientation for the first end effector associated with the first robot based in part on the received end effector position and the received orientation information of the second end effector associated with the second robot relative to the object associated with the cooperative task and information about the object associated with the cooperative task.

Assignees

• Dexterity Inc

Inventors

• Sun Zhouwen
• Morris-Downing Talbot
• Su Harry Zhe
• Kulkarni Rohun
• Chavez Kevin Jose
• Menon Samir
• Baker Toby Leonard
• Tondreau Iii David Leo
• Holmberg Robert

Classifications

• B25J19/023

  including video camera means · CPC title

• G05B2219/39109

  Dual arm, multiarm manipulation, object handled in cooperation · CPC title

• B25J9/0084 Primary

  comprising a plurality of manipulators · CPC title

• B25J9/1697

  Vision controlled systems · CPC title

• B25J9/0087

  Dual arms (double SCARA arms B25J9/043) · CPC title