Information processing apparatus and method

Patent metadata

Field	Value
Publication number	US-9467682-B2
Application number	US-201113976200-A
Country	US
Kind code	B2
Filing date	Dec 22, 2011
Priority date	Dec 28, 2010
Publication date	Oct 11, 2016
Grant date	Oct 11, 2016

Abstract

An information processing apparatus includes a model storing unit configured to store a three-dimensional form model for acquiring the position and posture of a measurement target object, an image acquiring unit configured to acquire an image of the measurement target object, a first position and posture acquiring unit configured to acquire a first position and posture of the three-dimensional form model in a first coordinate system on the basis of a first geometric feature of the three-dimensional form model and a first geometric feature within the image, and a second position and posture acquiring unit configured to acquire a second position and posture of the three-dimensional form model in a second coordinate system that is different from the first coordinate system on the basis of a second geometric feature of the three-dimensional form model and a second geometric feature within the image and the first position and posture.

First claim

The invention claimed is:

1. An information processing apparatus comprising:
an image acquiring unit configured to acquire an image of a measurement target object;
a first position and orientation acquiring unit configured to associate a first geometric feature of a three-dimensional model with a first image feature corresponding to the first geometric feature within the image based on an approximate position and orientation of the measurement target object and acquire a first position and orientation of the measurement target object based on an association result; and
a second position and orientation acquiring unit configured to, based on the first position and orientation, associate a second geometric feature of the three-dimensional model for determining an orientation component in a rotating direction around a rotational center axis of the three-dimensional model with a second image feature corresponding to the second geometric feature, and acquire a second position and orientation of the measurement target object by updating the first position and orientation so that a distance between the second geometric feature and the second image feature that are associated with each other becomes small.

2. The information processing apparatus according to claim 1 , wherein the first position and orientation are a position and orientation represented by position and orientation parameters of six degrees of freedom in an image coordinate system, wherein the image coordinate system is an image coordinate system of an image pickup apparatus with which the image is acquired.

3. The information processing apparatus according to claim 1 , wherein the second position and orientation are a position and orientation represented by position and orientation parameters of three or fewer degrees of freedom based on a model coordinate system which is a model coordinate system based on the three-dimensional model.

4. The information processing apparatus according to claim 3 , wherein the second position and orientation are a position and orientation which are represented by at least one of a rotation component of one degree of freedom based on the model coordinate system and a translation component of one degree of freedom.

5. The information processing apparatus according to claim 1 , wherein the second position and orientation acquiring unit performs pattern matching by using an image of the second geometric feature of the three-dimensional model to acquire the second position and orientation of the three-dimensional model in a second coordinate system.

6. The information processing apparatus according to claim 1 , wherein the second position and orientation acquiring unit acquires the second position and orientation by nonlinear optimization.

7. The information processing apparatus according to claim 1 , wherein the second position and orientation acquiring unit acquires the second position and orientation from a simultaneous equation.

8. The information processing apparatus according to claim 1 , wherein the image acquiring unit acquires, as the image of the measurement target object, at least one of a two-dimensional image and a depth map of the measurement target object.

9. The information processing apparatus according to claim 1 , further comprising a model rotational center axis setting unit configured to set the rotational center axis of the three-dimensional model.

10. The information processing apparatus according to claim 9 , where the model rotational center axis setting unit sets the rotational center axis of the three-dimensional model according to a user input.

11. The information processing apparatus according to claim 9 , where the model rotational center axis setting unit comprises:
a first setting unit configured to select a basic face from among a plurality of planes forming the three-dimensional model and set a basic axis that is a rotational center axis of the basic face;
a second setting unit configured to select a reference face different from the basic face from among a plurality of planes which forms the three-dimensional model, and set a reference axis that is a rotational center axis of the reference face; and
a similarity calculating unit configured to calculate a similarity between an orientation of the basic axis and an orientation of the reference axis,
wherein the rotational center axis is set based on the similarity.

12. The information processing apparatus according to claim 11 , wherein the first setting unit selects a plurality of basic faces and sets a plurality of basic axes that are rotational center axes of the plurality of basic faces;
wherein the second setting unit selects a plurality of the reference faces each for a different one of the plurality of the basic axes and sets a plurality of the reference axes that are rotational center axes of the plurality of selected reference faces;
wherein the similarity calculating unit calculates, for each of the plurality of the basic axes, a similarity in an orientation to a corresponding reference axis to obtain a plurality of similarities between the plurality of the basic axes and the plurality of the reference axes; and
wherein the model rotational center axis setting unit sets, as the rotational center axis, a basic axis corresponding to a highest evaluation value among evaluation values in which a plurality of similarities calculated for the plurality of basic axes are included.

13. The information processing apparatus according to claim 11 , wherein the similarity calculating unit calculates a similarity between an orientation and a starting point position of the basic axis and an orientation and a starting point position of the reference axis.

14. The information processing apparatus according to claim 1 , wherein the first position and orientation acquiring unit acquires the first position and orientation by calculating a position and orientation component other than the orientation component in a rotating direction around a rotational center axis; and
wherein the second position and orientation acquiring unit acquires the second position and orientation by only calculating the orientation component in the rotating direction around the rotational center axis.

15. The information processing apparatus according to claim 1 , wherein the three-dimensional model is three-dimensional computer aided design data.

16. The information processing apparatus according to claim 1 , wherein the second geometric feature is selected from geometric features of the three-dimensional model in advance.

17. An information processing method comprising:
an image acquiring step of, by an image acquiring unit, acquiring an image of a measurement target object;
a first position and orientation acquiring step of, by a first position and orientation acquiring unit, associating a first geometric feature of a three-dimensional model with a first image feature corresponding to the first geometric feature within the image based on an approximate position and orientation of the measurement target object and acquiring a first position and orientation of the measurement target object based on an association result; and
a second position and orientation acquiring step of, by a second position and orientation acquiring unit, based on the first position and orientation, associating a second geometric feature of the three-dimensional model for determining an orientation component in a rotating direction around a rotational center axis of the three-dimensional model with a second image feature corresponding to the second geometric feature, and

Assignees

• Watanabe Daisuke
• Uchiyama Shinji
• Kotake Daisuke
• Canon Kk

Inventors

• Watanabe Daisuke
• Uchiyama Shinji
• Kotake Daisuke

Classifications

• H04N13/0275 Primary

  Electricity · mapped topic

• G06T2207/10004

  Still image; Photographic image · CPC title

• G06T7/0046

  Physics · mapped topic

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G06T7/75 Primary

  involving models · CPC title