Accurate position control for fixtureless assembly

Patent metadata

Field	Value
Publication number	US-2022176564-A1
Application number	US-202017111739-A
Country	US
Kind code	A1
Filing date	Dec 4, 2020
Priority date	Dec 4, 2020
Publication date	Jun 9, 2022
Grant date	—

Abstract

A part manufacturing system and a method of manufacturing are provided. The system includes one or more part-moving robots, each having an end effector that grips a part. An operation robot performs an operation on the part while the part-moving robot holds the part. A fixed vision system is located apart from the robots and has at least one fixed vision sensor that senses an absolute location of the part and/or the end effector and generates a fixed vision signal representative of the absolute location. A controller collects the fixed vision signal and compares the absolute location with a predetermined desired location of the part and/or the end effector. The controller sends a repositioning signal to the part-moving robot if the absolute location varies from the predetermined desired location by at least a predetermined threshold, and the part-moving robot is configured to move the part upon receiving the repositioning signal.

First claim

What is claimed is:

1 . A part assembly system comprising:
a first robot having a first end effector configured to grip a first part and to move the first part; a second robot having a second end effector configured to grip a second part and to move the second part; a third robot configured to perform an operation on the first and second parts, the first and second robots being configured to hold the first and second parts while the third robot performs the operation; a remote vision system located apart from the first, second, and third robots, the remote vision system having at least one remote vision sensor configured to sense a first absolute location of at least one of the first part and the first end effector and to generate a first remote vision signal representative of the first absolute location, the at least one remote vision sensor being configured to sense a second absolute location of at least one of the second part and the second end effector and to generate a second remote vision signal representative of the second absolute location; and a controller configured to collect the first remote vision signal and the second remote vision signal, the controller being further configured to compare the first absolute location with a first predetermined desired location of at least one of the first part and the first end effector, the controller being configured to send a first repositioning signal to the first robot if the first absolute location varies from the first predetermined desired location by at least a first threshold, and the controller being further configured to compare the second absolute location with a second predetermined desired location of at least one of the second part and the second end effector, the controller being configured to send a second repositioning signal to the second robot if the second absolute location varies from the second predetermined desired location by at least a second threshold, the first robot being configured to move the first part upon receiving the first repositioning signal, and the second robot being configured to move the second part upon receiving the second repositioning signal.

2 . The part assembly system of claim 1 , the remote vision system comprising a remote end effector vision system, the at least one remote vision sensor being part of the remote end effector vision system and including at least one photogrammetry sensor configured to determine the first absolute position and the second absolute position, the first absolute position being a position of the first end effector, and the second absolute position being a position of the second end effector.

3 . The part assembly system of claim 2 , the remote vision system comprising a remote part vision system configured to determine a part location of each of the first and second parts based on at least one part feature on each of the first and second parts.

4 . The part assembly system of claim 3 , the remote part vision system including a laser radar sensor configured to determine a position of at least one of the part features.

5 . The part assembly system of claim 4 , the first robot having a first local vision sensor located on a movable portion of the first robot and configured to sense a relative location of the first part and generate a first robot local vision signal representative of the relative location of the first part, the second robot having a second local vision sensor located on a movable portion of the second robot and configured to sense a relative location of the second part and generate a second robot local vision signal representative of the relative location of the second part.

6 . The part assembly system of claim 5 , wherein the controller includes a control logic configured to define a shared coordinate system between the first local vision sensor, the second local vision sensor, and the at least one remote vision sensor to define the first and second absolute locations and the first and second predetermined desired locations on the shared coordinate system.

7 . The part assembly system of claim 6 , the third robot being configured to perform a welding operation on the first and second parts to join the first and second parts together, the first and second end effectors being configured to hold the first and second parts in contact with one another while the third robot performs the welding operation.

8 . The part assembly system of claim 4 , the first robot further having a first force sensor configured to sense force between the first part and the second part.

9 . A method of performing a manufacturing operation, the method comprising:
moving a part to a relative position via an end effector on a robot based on a local vision signal generated by a local vision sensor located on a movable part of the robot; sensing an absolute location of one of the part and the end effector via at least one remote vision sensor of a remote fixed vision system located apart from the robot and the end effector; generating a remote vision signal representative of the absolute location; comparing the absolute location with a predetermined desired location of at least one of the part and the end effector; repositioning the end effector and the part if the absolute location varies from the predetermined desired location by at least a threshold until the absolute location is within the threshold of the predetermined desired location; and performing an operation on the part when the absolute location is within the threshold of the predetermined desired location.

10 . The method of claim 9 , the step of sensing the absolution location of one of the part and the end effector including sensing the absolute location of the end effector.

11 . The method of claim 10 , further comprising sensing a part feature on the part via a remote part vision system after the step of performing the operation, and determining a part location based on the part feature.

12 . The method of claim 11 , the step of sensing the part feature including using laser radar to sense the part feature.

13 . The method of claim 12 , further comprising defining a shared coordinate system for comparing the relative position of the part, the absolute location of the end effector, the predetermined desired location of the end effector, and the part location.

14 . The method of claim 13 , the part being a first part, the relative position being a first relative position, the end effector being a first end effector, the robot being a first robot, the absolute position being a first absolute position, the remote vision signal being a first remote vision signal, the predetermined desired location being a first predetermined desired location, and the threshold being a first threshold, the method further comprising:
moving a second part to a second relative position via a second end effector on a second robot based on a local vision signal generated by a second local vision sensor located on the second end effector; sensing a second absolute location of the second end effector via the at least one remote vision sensor, the at least one remote vision sensor being located apart from the second robot and the second end effector; generating a second remote vision signal representative of the second absolute location; comparing the second absolute location with a second predetermined desired location of the second end effector; and repositioning the second end effector and the second part if the second absolute location varies from the second predetermined desired location by at least a second threshold until the absolute location is within the

Assignees

• Gm Global Tech Operations Llc

Inventors

• Saez Miguel A
• Spicer John P
• Wells James W

Classifications

• G05B2219/45064

  Assembly robot · CPC title

• G05B2219/40607

  Fixed camera to observe workspace, object, workpiece, global · CPC title

• G05B2219/39149

  To assemble two objects, objects manipulation · CPC title

• G05B2219/39109

  Dual arm, multiarm manipulation, object handled in cooperation · CPC title

• G05B2219/31031

  Assembly, manipulator cell · CPC title