Control device, control method, and storage medium

Patent metadata

Field	Value
Publication number	US-2024131711-A1
Application number	US-202118287119-A
Country	US
Kind code	A1
Filing date	Apr 23, 2021
Priority date	Apr 23, 2021
Publication date	Apr 25, 2024
Grant date	—

Abstract

A control device 1X mainly includes an operation planning means 17Y, a display control means 15Y, and a correction receiving means 16Y. The operation planning means 17Y determines a first operation plan of a robot which executes a task in which an object is used. The display control means 15Y displays trajectory information regarding a trajectory of the object based on the first operation plan. The correction receiving means 16Y receives a correction relating to the trajectory information based on an external input. Then, the operation planning means 17Y determines a second operation plan of the robot based on the correction received by the correction receiving means 16Y.

First claim

What is claimed is:

1 . A control device comprising:
at least one memory configured to store instructions; and at least one processor configured to execute the instructions to: determine a first operation plan of a robot which executes a task in which an object is used; display trajectory information regarding a trajectory of the object based on the first operation plan; receive a correction relating to the trajectory information based on an external input; and determine a second operation plan of the robot based on the correction.

2 . The control device according to claim 1 ,
wherein the at least one processor is configured to execute the instructions to determine the second operation plan obtained by modifying the first operation plan to realize a state of the object specified by the correction.

3 . The control device according to claim 1 ,
wherein the at least one processor is configured to execute the instructions to receive the correction relating to at least one of a position and/or posture of the object on the trajectory.

4 . The control device according to claim 3 ,
wherein the at least one processor is configured to execute the instructions to display virtual objects of the object which represent states of the object at intervals of a predetermined time, and wherein the at least one processor is configured to execute the instructions to receive the correction relating to a state of the object on the trajectory, based on the external input of modifying a state of the virtual object.

5 . The control device according to claim 1 ,
wherein the at least one processor is configured to execute the instructions to display, as the trajectory information, information relating to a position at which the robot grasps the object, a grasping direction, or a posture of an end effector of the robot, and wherein the at least one processor is configured to execute the instructions to receive the correction relating to the position at which the robot grasps the object, the grasping direction, or the posture of the end effector.

6 . The control device according to claim 1 ,
wherein the at least one processor is configured to execute the instructions to receive the correction indicating addition of an operation of the robot to change a grasping portion of the object, and wherein the at least one processor is configured to execute the instructions to determine the second operation plan in which the operation of the robot to change the grasping portion of the object is included.

7 . The control device according to claim 1 ,
wherein the at least one processor is configured to execute the instructions to display, as the trajectory information, a trajectory of the robot together with the trajectory of the object.

8 . The control device according to claim 1 ,
wherein the at least one processor is configured to further execute the instructions to control the robot based on the second operation plan if the second operation plan satisfies a constraint condition set in the first operation plan.

9 . The control device according to claim 1 ,
wherein the at least one processor is configured to execute the instructions to:
convert the task to be executed by the robot into a logical formula based on a temporal logic;
generate a time step logical formula that is a logical formula indicating state for each time step to execute the task; and
generate a sequence of subtasks to be executed by the robot, based on the time step logical formula.

10 . A control method executed by a computer, the control method comprising:
determining a first operation plan of a robot which executes a task in which an object is used; displaying trajectory information regarding a trajectory of the object based on the first operation plan; receiving a correction relating to the trajectory information based on an external input; and determining a second operation plan of the robot based on the correction.

11 . A non-transitory computer readable storage medium storing a program executed by a computer, the program causing the computer to:
determine a first operation plan of a robot which executes a task in which an object is used; display trajectory information regarding a trajectory of the object based on the first operation plan; receive a correction relating to the trajectory information based on an external input; and determine a second operation plan of the robot based on the correction.

Assignees

• Nec Corp

Inventors

• Itou Takehiro
• WAKAYAMA Hisaya
• Ogawa Masatsugu

Classifications

• B25J9/1666 Primary

  Avoiding collision or forbidden zones · CPC title

• B25J9/1669

  characterised by special application, e.g. multi-arm co-operation, assembly, grasping · CPC title

• B25J9/1671 Primary

  characterised by simulation, either to verify existing program or to create and verify new program, CAD/CAM oriented, graphic oriented programming systems · CPC title

• B25J9/1697

  Vision controlled systems · CPC title

• G05B19/42

  Recording and playback systems, i.e. in which the program is recorded from a cycle of operations, e.g. the cycle of operations being manually controlled, after which this record is played back on the same machine · CPC title