Method of programming an industrial robot

Patent metadata

Field	Value
Publication number	US-11833697-B2
Application number	US-202117172098-A
Country	US
Kind code	B2
Filing date	Feb 10, 2021
Priority date	Aug 13, 2018
Publication date	Dec 5, 2023
Grant date	Dec 5, 2023

Abstract

A method of programming an industrial robot includes: providing the robot, the robot having a robot arm with an end-effector mounted thereto which is controlled by a robot control unit to manipulate a workpiece which is arranged in a workplace of the robot; associating a target coordinate system with the workplace; taking an image of the workplace and the workpiece by an image capturing device; transmitting the image to a computing device having a human-machine-interface to generate control code for controlling the robot, which is transmitted to the robot control unit; capturing an image of the workplace and the workpiece to be manipulated by the robot; transferring the captured image to the computing device and displaying the captured image on a display associated with the computing device; and displaying the workpiece on the display; marking the workpiece with a marker-object on the display.

First claim

What is claimed is:

1. A method of programming an industrial robot, comprising:
providing the robot, the robot having a robot arm with an end-effector mounted thereto which is controlled by a robot control unit to manipulate a workpiece which is arranged in a workplace of the robot;
associating a target coordinate system with the workplace;
capturing an image of the workplace and the workpiece by an image capturing device;
transmitting the image to a computing device having a human-machine-interface to generate control code for controlling the robot, which is transmitted to the robot control unit;
displaying the image on a display associated with the computing device;
displaying the workpiece on the display;
marking the workpiece with a marker-object on the display;
manipulating the marker-object in a sequence of at least two subsequent manipulating steps which are associated with robot commands on the display by means of the human-machine-interface, the sequence of manipulating steps including positions of the marker-object in a coordinate system for displaying the marker-object on the display;
transforming the positions of the marker-object in the sequence of manipulating steps to positions of the workpiece in the target coordinate system;
generating control code for controlling the robot from the transformed positions and associated robot commands;
measuring a first distance value between a reference point which is located above the workpiece and a first measuring location on the workpiece;
measuring a second distance value between the reference point and a second measuring location on the workplace;
determining a workpiece height value associated with the workpiece as a difference between the measured first distance value and the measured second distance value; and
generating the control code and associated robot commands for controlling the robot based on the workpiece height value;
wherein the image capturing device comprises a 3D-camera which captures the image of the workplace together with measured distance values associated with at least some of the pixels of the captured image;
wherein the first distance value used in determining the workpiece height value is associated with a first pixel of the captured image, the first pixel being located at the first measuring location, and the second distance value used in determining the workpiece height value is associated with a second pixel of the captured image, the second pixel being located at the second measuring location;
wherein the first measuring location is located within the marker-object after marking the workpiece;
wherein the second measuring location is located outside of and adjacent to the marker-object; and
wherein the first pixel and/or the second pixel are selectable by the human-machine-interface on the display.

2. The method of claim 1 , wherein a workpiece grasping height value is determined from the workpiece height value as a value which is smaller.

3. The method of claim 2 , wherein the sequence of manipulating steps includes:
providing two parallel bars on the display;
moving the two parallel bars to the marker-object by using the human-machine-interface;
rotating the parallel bars and moving the parallel bars towards and away from each other in order to define a grasping position of gripper bars at which the workpiece is grasped by the robot;
storing the grasping position together with the associated workpiece grasping height value;
transforming the grasping position and the associated workpiece grasping height value to a transformed grasping position and an associated workpiece grasping height value of the workpiece in the target coordinate system; and
generating the control code for controlling the robot based on the transformed grasping position and the grasping height value.

4. The method according to claim 1 , further comprising:
determining a third distance value between the reference point and a third measuring location on the workplace, the third measuring location corresponding to a target position of the workpiece on the workplace after performing the sequence of manipulating steps;
determining a workpiece positioning height value associated with the workpiece in the target position as a difference between the measured third distance value and the measured second distance value; and
generating the control code and associated robot commands for controlling the robot based on the workpiece-positioning height value.

5. The method of claim 1 , wherein the image capturing device captures the image of the workplace together with the associated measured distance values for a plurality of predetermined pixels which are located at positions distributed all over the captured image,
wherein for each of the predetermined pixels an obstacle height value is determined as a calculated difference between the first measured distance value associated with the first pixel on the workplace and a corresponding measured distance value associated with a predetermined pixel, and
wherein pixels of the plurality of predetermined pixels for which the obstacle height value exceeds a predetermined value for a maximum lifting-height of the end-effector are marked and displayed in the captured image on the display as colliding objects.

6. The method according to claim 5 , wherein based on the determined obstacle height values, the computing device generates a proposed path for moving the workpiece around the marked pixels or clusters of marked pixels in the captured image which are displayed on the display.

7. The method according to claim 1 , wherein the image capturing device captures the image of the workplace together with the associated measured distance values for a plurality of predetermined pixels which are located at positions distributed all over the captured image,
wherein each of the predetermined pixels for which the calculated difference between the first measured distance value associated with the first pixel on the workplace and a corresponding measured distance value associated with a predetermined pixel is larger than the grasping-height value, is marked and displayed in the captured image on the display as a graspable object.

8. The method according to claim 1 , wherein the computing device comprises a handheld device having a touchscreen display with the 3D-camera integrated therein or mechanically attached thereto.

9. The method of claim 2 , wherein the workpiece grasping height value is 50% smaller than the workpiece height value.

10. A method of programming an industrial robot, comprising:
providing the robot, the robot having a robot arm with an end-effector mounted thereto which is controlled by a robot control unit to manipulate a workpiece which is arranged in a workplace of the robot;
associating a target coordinate system with the workplace;
capturing an image of the workplace and the workpiece by an image capturing device;
transmitting the image to a computing device having a human-machine-interface to generate control code for controlling the robot, which is transmitted to the robot control unit;
displaying the image on a display associated with the computing device;
displaying the workpiece on the display;
marking the workpiece with a marker-object on the display;
manipulating the marker-object in a sequence of at least two subsequent manipulating steps which are associated with robot commands on the display by means of the human-machine-interface, the sequence of manipulating steps including positions of the marker-object in a coordinate system for displaying the marker-object on the display;
transforming the positions of the marker-object in the sequence of manipulating steps

Assignees

• Abb Schweiz Ag

Inventors

• Clever Debora
• Dai Fan

Classifications

• B25J9/1697 Primary

  Vision controlled systems · CPC title

• B25J9/161

  Hardware, e.g. neural networks, fuzzy logic, interfaces, processor · CPC title

• B25J9/1605

  Simulation of manipulator lay-out, design, modelling of manipulator · CPC title

• B25J9/1666

  Avoiding collision or forbidden zones · CPC title

• B25J13/089

  Determining the position of the robot with reference to its environment · CPC title