Robot teach device with 3-D display

Patent metadata

Field	Value
Publication number	US-9415509-B2
Application number	US-201213667348-A
Country	US
Kind code	B2
Filing date	Nov 2, 2012
Priority date	Nov 4, 2011
Publication date	Aug 16, 2016
Grant date	Aug 16, 2016

Abstract

A method and an apparatus for displaying three-dimensional workcell data includes a hand-held pendant that is provided with 3-D workcell data representing a model of a machine and associated components in a workcell. The hand-held pendant has a display that generates a 3-D visual representation of the workcell data. The pendant can be operated by a user to manipulate the visual representation to change a user viewpoint and to show motion of the machine with associated process information.

First claim

What is claimed is:

1. A method for displaying three-dimensional workcell data comprising the steps of:
providing from a data source 3-D workcell data representing a model of a robot and associated components in a workcell;
providing a hand-held display device and placing the display device in data communication with the data source;
communicating the workcell data from the data source to the display device;
generating a 3-D visual representation of the workcell data on the display device, including displaying the visual representation of
a position of the robot based on a value of a program or a non-program representation of robot position within a software program for controlling the robot,
an aggregate space occupied by the robot through movement of an associated part of the robot about at least one axis of rotation of the robot throughout execution of at least a portion of the software program, and
an interference visualization image of the aggregate space that includes an image of a plane transverse to the axis of rotation; and

operating the display device to manipulate the visual representation.

2. The method according to claim 1 wherein the display device has jog keys and including displaying a direction the robot will take if moved in response to actuation of the jog keys.

3. The method according to claim 1 including plotting process information in conjunction with TCP trace of the software program.

4. The method according to claim 1 including storing data from a series of the robot positions and associated secondary information and replaying a progression of the robot positions with the associated secondary information as the visual representation.

5. The method according to claim 1 including using color and transparency to differentiate various elements in the visual representation.

6. The method according to claim 1 including incorporating in the visual representation an area not visible to a user of the hand-held display device for restricting or limiting travel of the robot during an operation of the robot.

7. The method according to claim 1 including incorporating in the visual representation video data from a view point of a camera in the workcell.

8. The method according to claim 1 including showing movement of elements of the robot in the visual representation.

9. The method according to claim 1 including selecting a 3-D element of the visual display and automatically indicating or displaying a corresponding 2-D item on the display device.

10. The method according to claim 1 including changing the visual representation to provide different user viewpoints.

11. The method according to claim 1 including operating the display device to display at least one of a menu and robot text data in a semi-transparent window with 3-D elements visible below and manipulating the transparency from invisible to opaque.

12. The method according to claim 1 including displaying multiple 3-D views in the visual representation as a split screen or a picture-in-picture.

13. The method according to claim 1 including presenting the visual representation as separate images for each eye of a user wherein the separate images are different for a 3-D movie effect or are the same.

14. A hand-held pendant for communicating with a robot controller comprising:
a display having a resolution high enough to show 3-D graphical images;
an input/output port for receiving from a data source 3-D workcell data representing a model of a robot and associated components in a workcell;
a data storage device for storing the 3-D workcell data and a pendant operating program; and
a processor connected to the display, the input/output port and the data storage device for running the operating program to generate a 3-D visual representation of the 3-D workcell data on the display and being responsive to user input to manipulate the visual representation, the visual representation including
a position of the robot based on a value of a program or a non-program representation of robot position within a software program for controlling the robot,
an aggregate space occupied by the robot through movement of an associated part of the robot about at least one axis of rotation of the robot throughout execution of at least the portion of the software program, and
an interference visualization image of the aggregate space that includes an image of a plane transverse to the axis of rotation.

15. The pendant according to claim 14 wherein the data source is the robot controller, the 3-D workcell data is related to a robot operating program being run by the controller and visual representation includes graphical images of the robot moving in response to instructions in the robot operating program.

16. A method for displaying three-dimensional workcell data comprising the steps of:
providing from a data source 3-D workcell data representing a model of a machine and associated components in a workcell;
providing a hand-held display device and placing the display device in data communication with the data source;
communicating the workcell data from the data source to the display device;
selecting a 2-D item on the display device and automatically indicating or displaying a corresponding 3-D element on the visual display of the display device;
generating a 3-D visual representation of the workcell data on the display device; and
operating the display device to manipulate the visual representation.

17. A method for displaying three-dimensional workcell data comprising the steps of:
providing from a data source 3-D workcell data representing a model of a machine and associated components in a workcell;
providing a hand-held display device and placing the display device in data communication with the data source;
communicating the workcell data from the data source to the display device;
generating a 3-D visual representation of the workcell data on the display device;
operating the display device to manipulate the visual representation; and
using the display device to create an adjusted view of the machine, associating the adjusted view with an original scene of the machine, and automatically recording the adjusted view with the original scene.

18. A method for displaying three-dimensional workcell data comprising the steps of:
providing from a data source 3-D workcell data representing a model of a machine and associated components in a workcell;
providing a hand-held display device and placing the display device in data communication with the data source;
communicating the workcell data from the data source to the display device;
generating a 3-D visual representation of the workcell data on the display device;
operating the display device to manipulate the visual representation; and
using the display device to preview a movement of the machine by engaging a movement key of the display device, wherein the display device displays the movement graphically prior to actual movement of the machine.

Assignees

• Fanuc Robotics America Corp
• Fanuc America Corp

Inventors

• Krause Kenneth W
• Niederquell Bradley O
• Geheb Gordon
• Kalbavi Ganesh
• Dinsmoor Claude
• Dreslinski Scott M
• Strybis Charles R
• Mcgee H Dean
• Nowak Glenn
• Evans Judy
• Wunderlich Rick E

Classifications

• G05B19/409 Primary

  characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters (G05B19/408, G05B19/4093 take precedence) · CPC title

• G05B2219/35318

  3-D display of workpiece, workspace, tool track · CPC title

• G05B2219/39449

  Pendant, pda displaying camera images overlayed with graphics, augmented reality · CPC title

• B25J9/1605 Primary

  Simulation of manipulator lay-out, design, modelling of manipulator · CPC title