Triangulation device, triangulation method, and recording medium recording program therefor

Patent metadata

Field	Value
Publication number	US-10126115-B2
Application number	US-201515510737-A
Country	US
Kind code	B2
Filing date	Sep 18, 2015
Priority date	Sep 18, 2014
Publication date	Nov 13, 2018
Grant date	Nov 13, 2018

Abstract

A triangulation device for computing a three-dimensional position of a measurement target point using a stereo method, the triangulation device includes: optimum image coordinate estimation unit configured to, based on coordinates of corresponding points corresponding to the measurement target point in two images each of which including an image of the measurement target point, and intrinsic parameters and extrinsic parameters of optical instruments generating the two images, calculate correction vectors by which coordinates of the corrected corresponding points satisfy an epipolar equation composed of the intrinsic parameters and the extrinsic parameters, using a characteristic polynomial including a correction amount of coordinates of the corresponding points or a reciprocal of the correction amount as a variable, and compute coordinates of the corrected corresponding points based on calculated correction vectors; and three-dimensional coordinate calculation unit configured to calculate three-dimensional coordinates of the measurement target point based on coordinates of the corrected corresponding points, the intrinsic parameters and the extrinsic parameters.

First claim

What is claimed is:

1. A triangulation device for computing a three-dimensional position of a measurement target point using a stereo method, the triangulation device comprising:
an optimum image coordinate estimation unit configured to,
based on coordinates of corresponding points corresponding to the measurement target point in two images each of which including an image of the measurement target point, and intrinsic parameters and extrinsic parameters of optical instruments generating the two images, calculate correction vectors by which coordinates of corrected corresponding points satisfy an epipolar equation composed of the intrinsic parameters and the extrinsic parameters, using a characteristic polynomial including a correction amount of the coordinates of the corresponding points or a reciprocal of the correction amount as a variable, and
compute the coordinates of the corrected corresponding points based on the calculated correction vectors; and

a three-dimensional coordinate calculation unit configured to calculate three-dimensional coordinates of the measurement target point based on the coordinates of the corrected corresponding points, the intrinsic parameters and the extrinsic parameters.

2. The triangulation device according to claim 1 , wherein the optimum image coordinate estimation unit includes:
a characteristic polynomial calculation unit configured to
receive the coordinates of the corresponding points, the intrinsic parameters and the extrinsic parameters,
calculate a predetermined constraint matrix indicating a constraint to be satisfied by the correction vectors and including the correction amount of the coordinates of the corresponding points or the reciprocal of the correction amount as an eigenvalue, and
solve a characteristic equation of the constraint matrix to compute a minimum correction amount; and

a correction vector calculation unit configured to
calculate an eigenvector of the constraint matrix corresponding to the minimum correction amount, with the coordinates of the corresponding points, the constraint matrix and the minimum correction amount as inputs,
perform predetermined scaling on the eigenvector to calculate the correction vectors, and
calculate the coordinates of the corrected corresponding points based on the correction vectors.

3. The triangulation device according to claim 1 , wherein the correction amount of the corresponding points indicates a Lagrange multiplier in a constrained nonlinear optimization problem including magnitude of the correction vectors as an objective function and the epipolar equation with scale indeterminacy as a constraint.

4. The triangulation device according to claim 1 , wherein the stereo method is a passive stereo method in which two images of the measurement target point are captured by cameras from different positions, respectively.

5. The triangulation device according to claim 1 , wherein the stereo method is an active stereo method in which an image of the measurement target point is projected by a projector from a certain position, and an image of the measurement target point is captured by a camera from another position.

6. A triangulation method comprising, by a triangulation device:
receiving coordinates of corresponding points corresponding to a measurement target point in images capturing a measurement target from two different positions, and intrinsic parameters and extrinsic parameters of optical instruments capturing the two images;
calculating correction vectors by which coordinates of corrected corresponding points satisfy an epipolar equation composed of the intrinsic parameters and the extrinsic parameters, based on a characteristic polynomial including a correction amount of the coordinates of the corresponding points or a reciprocal of the correction amount as a variable;
computing the coordinates of the corrected corresponding points based on the calculated correction vectors; and
receiving the coordinates of the corrected corresponding points, the intrinsic parameters and the extrinsic parameters, and calculating three-dimensional coordinates of the measurement target point based on the coordinates of the corrected corresponding points, the intrinsic parameters and the extrinsic parameters.

7. The triangulation method according to claim 6 , wherein the triangulation device
receives the coordinates of the corresponding points, the intrinsic parameters and the extrinsic parameters,
calculates a predetermined constraint matrix indicating a constraint to be satisfied by the correction vectors and including the correction amount of the coordinates of the corresponding points or the reciprocal of the correction amount as an eigenvalue,
solves a characteristic equation of the constraint matrix to compute a minimum correction amount,
calculates an eigenvector of the constraint matrix corresponding to the minimum correction amount, based on the coordinates of the corresponding points, the constraint matrix, and the minimum correction amount,
performs predetermined scaling on the eigenvector to calculate the correction vectors, and
calculates the coordinates of the corrected corresponding points based on the correction vectors.

8. The triangulation method according to claim 6 , wherein the correction amount of the corresponding points indicates a Lagrange multiplier in a constrained nonlinear optimization problem including magnitude of the correction vectors as an objective function and the epipolar equation with scale indeterminacy as a constraint.

9. A non-transitory computer-readable recording medium storing a program causing a computer to function as:
optimum image coordinate estimation unit configured to
receive coordinates of corresponding points corresponding to a measurement target point in two images each of which including an image of the measurement target point, and intrinsic parameters and extrinsic parameters of optical instruments generating the two images,
calculate correction vectors by which coordinates of corrected corresponding points satisfy an epipolar equation composed of the intrinsic parameters and the extrinsic parameters, based on a characteristic polynomial including a correction amount of the coordinates of the corresponding points or a reciprocal of the correction amount as a variable, and
compute the coordinates of the corrected corresponding points based on the calculated correction vectors; and

three-dimensional coordinate calculation unit configured to
calculate three-dimensional coordinates of the measurement target point based on the coordinates of the corrected corresponding points, the intrinsic parameters and the extrinsic parameters.

10. The non-transitory computer-readable recording medium storing the program according to claim 9 , wherein the optimum image coordinate estimation unit includes:
characteristic polynomial calculation unit configured to
calculate a predetermined constraint matrix indicating a constraint to be satisfied by the correction vectors and including the correction amount of the coordinates of the corresponding points or the reciprocal of the correction amount as an eigenvalue, based on the coordinates of the corresponding points, the intrinsic parameters and the extrinsic parameters, and
solve a characteristic equation of the constraint matrix to compute a minimum correction amount; and

correction vector calculation unit configured to
calculate an eigenvector of the constraint matrix corresponding to the minimum correction amount, based on the coordinates of the corresponding points, the constraint matrix, and the minimum correction amount,
perform predetermined scaling on the eigenvector to calculate the correction vectors,

Assignees

• Nec Corp

Inventors

• Nakano Gaku

Classifications

• G01B11/002 Primary

  for measuring two or more coordinates · CPC title

• G06T7/73

  using feature-based methods · CPC title

• G01C3/08

  Use of electric radiation detectors · CPC title

• G06T2200/04

  involving 3D image data · CPC title

• G01C3/14 Primary

  with binocular observation at a single point, e.g. stereoscopic type (G01C3/20 takes precedence) · CPC title