Robot system having augmented reality-compatible display

Patent metadata

Field	Value
Publication number	US-2016158937-A1
Application number	US-201514937883-A
Country	US
Kind code	A1
Filing date	Nov 11, 2015
Priority date	Dec 8, 2014
Publication date	Jun 9, 2016
Grant date	—

Abstract

A robot system using an augmented reality-compatible display, capable of providing information on the status and/or an operation guide of a robot added to an actual image or actual environment, to a user of the robot, so as to improve the efficiency of operations carried out by the user. The robot system includes an actual robot, a controller which controls the actual robot, and an image capturing-displaying device connected to the controller by a wire or by radio. The image capturing-displaying device has a function for capturing an image of a scene including the actual robot and a function for displaying the captured image in real-time. The user can obtain a scene including the actual robot in real-time by directing a camera arranged on the image capturing-displaying device toward the actual robot, and can monitor an augmented reality image.

First claim

1 . A robot system comprising:
a robot; a controller which controls the robot; an image capturing-displaying device connected to the controller, and having a function for capturing an image of a scene including the robot and a function for displaying the image in real-time; and a measuring part which measures relative position and angle between the robot and the image capturing-displaying device, based on the image displayed in real-time on the image capturing-displaying device, wherein the image capturing-displaying device has a display on which additional information representing a status or an operation guide of the robot is overlapped with the image displayed on the image capturing-displaying device in real-time, based on the relative position and angle measured by the measuring part.

2 . The robot system as set forth in claim 1 , wherein the image capturing-displaying device has a display for displaying a video image of an actual scene, and the additional information is overlapped with an actual image of the robot included in the video image.

3 . The robot system as set forth in claim 1 , wherein the image capturing-displaying device has a display for displaying a transmissive image of an actual scene, and the additional information is overlapped with an actual image of the robot of the transmissive image.

4 . The robot system as set forth in claim 1 , wherein the image capturing-displaying device is a teaching pendant connected to the controller.

5 . The robot system as set forth in claim 1 , wherein the additional information is an image representing a direction in which the robot is capable of being moved by manual operation.

6 . The robot system as set forth in claim 1 , wherein the additional information is a luminescent image, a luminescence intensity of which corresponds to a present value of a velocity override of the robot.

7 . The robot system as set forth in claim 1 , wherein the additional information is a luminescent image of an apparatus in which an abnormality is detected.

Assignees

• Fanuc Corp

Inventors

• Kamoi Toshiaki
• Inaba Gou

Classifications

• B25J9/1671 Primary

  characterised by simulation, either to verify existing program or to create and verify new program, CAD/CAM oriented, graphic oriented programming systems · CPC title

• G05B2219/39451

  Augmented reality for robot programming · CPC title

• B25J9/1605

  Simulation of manipulator lay-out, design, modelling of manipulator · CPC title

• B25J9/1697

  Vision controlled systems · CPC title

• Y10S901/05

  Machine driven lead through · CPC title