Information processing apparatus, information processing method, and storage medium for measuring a position and an orientation of an object by using a model indicating a shape of the object

Patent metadata

Field	Value
Publication number	US-9984291-B2
Application number	US-201615077783-A
Country	US
Kind code	B2
Filing date	Mar 22, 2016
Priority date	Mar 24, 2015
Publication date	May 29, 2018
Grant date	May 29, 2018

Abstract

An information processing apparatus includes a distance information acquisition unit configured to acquire distance information with respect to a measurement target object to determine interference between the object and a container for storing the object when the object is to be gripped, a derivation unit configured to derive a position and an orientation of the measurement target object based on the distance information and a partial model representing a partial shape of the measurement target object, and an interference determination unit configured, based on the position and the orientation derived by the derivation unit and a whole model representing a whole shape of the measurement target object, to determine whether interference has occurred between the measurement target object and the container for storing the measurement target object.

First claim

What is claimed is:

1. An information processing apparatus comprising:
one or more processors; and
one or more memory devices, the one or more memory devices storing a partial model representing a shape of a part of a whole shape of a target object and a whole model representing the whole shape of the target object, the one or more memory devices storing executable instructions, which when executed by the one or more processors, cause the information processing apparatus to:
derive an approximate position and an approximate orientation of the target object and derive a position and an orientation each having higher accuracy using the approximate position and the approximate orientation, based on measured three-dimensional information of a target object stored in a container and the partial model and the whole model of the target object stored in the one or more memory devices; and
based on the derived position and the orientation and the whole model of the target object stored in the one or more memory devices, determine whether the target object and the container will come into contact with each other when a robot hand moves the target object.

2. The information processing apparatus according to claim 1 , wherein the instructions when executed by the one or more processors cause the information processing apparatus to, based on the approximate position and the approximate orientation, associate a model point extracted from the partial model with a measurement point included in the measured three-dimensional information, and derive the position and the orientation by updating the approximate position and the approximate orientation such that a difference between the associated model point and the measurement point is reduced.

3. The information processing apparatus according to claim 2 ,
wherein the partial model is generated by clipping one part from the whole model, and
wherein the position and the orientation are derived without using a model point on a clipped surface generated when the partial model is generated from the whole model, the model point being among model points of the partial model.

4. The information processing apparatus according to claim 1 , wherein the approximate position and approximate orientation are derived using one among the whole model and the partial model and the position and orientation are derived using the other among the whole model and the partial model.

5. The information processing apparatus according to claim 4 , wherein the approximate position and approximate orientation are derived using the whole model, and the position and orientation are derived using the partial model.

6. The information processing apparatus according to claim 1 , wherein the one or more processors further cause the information processing apparatus to control the robot hand.

7. The information processing apparatus according to claim 1 , wherein a length of the target object in a predetermined axis direction is greater than that of the container in a predetermined axis direction.

8. The information processing apparatus according to claim 1 , wherein the three-dimensional information is acquired from a captured image of the target object, and
wherein the captured image does not include a whole of the target object.

9. The information processing apparatus according to claim 8 , wherein the instructions when executed by the one or more processors cause the information processing apparatus to, if a distance between the whole model arranged in the position and the orientation of the target object and the model representing a container shape arranged in a position of the container is smaller than a threshold value, determine that the target object and the container will come into contact with each other.

10. The information processing apparatus according to claim 9 , wherein the threshold value is determined for each part of the whole model.

11. The information processing apparatus according to claim 1 , wherein the instructions when executed by the one or more processors cause the information processing apparatus to determine whether the whole model arranged in the position and the orientation of the target object and a model representing a container shape arranged in a position of the container will come into contact with each other.

12. An information processing method comprising:
deriving an approximate position and an approximate orientation of a target object and deriving a position and an orientation each having higher accuracy using the approximate position and the approximate orientation, based on measured three-dimensional information of a target object stored in a container and a partial model and a whole model of the target object; and
determining, based on the derived position and the orientation and the whole model of the target object, whether the target object and the container will come into contact with each other when a robot hand moves the target object,
wherein the partial model represents a shape of a part of a whole shape of the target object, and
wherein the whole model represents the whole shape of the target object.

13. A non-transitory computer-readable storage medium storing instructions that, when executed by a computer of an information processing apparatus, cause the computer to perform a method comprising:
deriving an approximate position and an approximate orientation of a target object and deriving a position and an orientation each having higher accuracy using the approximate position and the approximate orientation, based on measured three-dimensional information of a target object stored in a container and a partial model and a whole model of the target object; and
determining, based on the derived position and the orientation and the whole model of the target object, whether the target object and the container will come into contact with each other when a robot hand moves the target object,
wherein the partial model represents a shape of a part of a whole shape of the target object, and
wherein the whole model represents the whole shape of the target object.

Assignees

• Canon Kk

Inventors

• Okazaki Hiroshi

Classifications

• G06V10/764

  using classification, e.g. of video objects · CPC title

• G06V20/10

  Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59) · CPC title

• G06T7/75 Primary

  involving models · CPC title

• G06F18/24323

  Tree-organised classifiers · CPC title

• B25J9/1697

  Vision controlled systems · CPC title