Camera parameter calculation apparatus, method, and recording medium based on an absolute value of corresponding pixel values

Patent metadata

Field	Value
Publication number	US-10664995-B2
Application number	US-201715687761-A
Country	US
Kind code	B2
Filing date	Aug 28, 2017
Priority date	Sep 8, 2016
Publication date	May 26, 2020
Grant date	May 26, 2020

Abstract

Provided are: a point group obtainer that obtains three-dimensional point group data indicating three-dimensional locations of each of a plurality of three-dimensional points included in an imaging space of one or more cameras; a camera parameter calculator that (i) obtains corresponding points, for each of the plurality of three-dimensional points, in individual images captured using the one or more cameras, based on the three-dimensional point group data and an initial camera parameter of each camera, and (ii) calculates a camera parameter of each camera on the basis of the initial camera parameter of each camera and pixel values, included in the individual images, at the corresponding points; and a camera parameter outputter that outputs the calculated camera parameter of each camera.

First claim

What is claimed is:

1. A camera parameter calculation apparatus, comprising:
a point group obtainer that obtains three-dimensional point group data indicating three-dimensional coordinates of a plurality of three-dimensional points included in a common imaging space of one or more cameras;
a camera parameter calculator that (i) calculates image coordinates of corresponding points, for each of the plurality of three-dimensional points, in one or more images captured using the one or more cameras, based on the three-dimensional point group data and one or more initial camera parameters of the one or more cameras, and (ii) calculates one or more camera parameters of the one or more cameras, based on pixel values, included in the one or more images, at the image coordinates; and
a camera parameter outputter that outputs the one or more camera parameters,
wherein the one or more cameras and the one or more initial camera parameters are in one-to-one relationship, the one or more cameras and the one or more images are in one-to-one relationship, and the one or more cameras and the one or more camera parameters are in one-to-one relationship,
wherein calculation of the image coordinates includes the camera parameter calculator converting the plurality of three-dimensional coordinates into the image coordinates in the one or more images corresponding to the one or more cameras, based on the one or more initial camera parameters corresponding to the one or more cameras,
wherein the one or more cameras include two cameras,
the camera parameter calculator calculates the one or more camera parameters on the basis of a plurality of difference values, and
each of the plurality of difference values is an absolute value of a difference between:
a pixel value at a corresponding point, for one three-dimensional point from among the plurality of three-dimensional points, in a first image captured by a first camera included in the two cameras; and
a pixel value at a corresponding point, for the one three-dimensional point, in a second image captured by a second camera included in the two cameras.

2. A camera parameter calculation apparatus, comprising:
a point group obtainer that obtains three-dimensional point group data indicating three-dimensional coordinates of a plurality of three-dimensional points included in a common imaging space of one or more cameras;
a camera parameter calculator that (i) calculates image coordinates of corresponding points, for each of the plurality of three-dimensional points, in one or more images captured using the one or more cameras, based on the three-dimensional point group data and one or more initial camera parameters of the one or more cameras, and (ii) calculates one or more camera parameters of the one or more cameras, based on pixel values, included in the one or more images, at the image coordinates; and
a camera parameter outputter that outputs the one or more camera parameters,
wherein the one or more cameras and the one or more initial camera parameters are in one-to-one relationship, the one or more cameras and the one or more images are in one-to-one relationship, and the one or more cameras and the one or more camera parameters are in one-to-one relationship,
wherein calculation of the image coordinates includes the camera parameter calculator converting the plurality of three-dimensional coordinates into the image coordinates in the one or more images corresponding to the one or more cameras, based on the one or more initial camera parameters corresponding to the one or more cameras,
wherein the one or more cameras include two cameras,
the camera parameter calculator calculates the one or more camera parameters on the basis of a plurality of difference values, and each of the plurality of difference values is a square value of a difference between:
a pixel value at a corresponding point, for one three-dimensional point from among the plurality of three-dimensional points, in a first image captured by a first camera included in the two cameras; and
a pixel value at a corresponding point, for the one three-dimensional point, in a second image captured by a second camera included in the two cameras.

3. A camera parameter calculation method, including:
obtaining three-dimensional point group data indicating three-dimensional coordinates of a plurality of three-dimensional points included in a common imaging space of one or more cameras;
calculating image coordinates of corresponding points, for each of the plurality of three-dimensional points, in one or more images captured using the one or more cameras, based on the three-dimensional point group data and one or more initial camera parameters of the one or more cameras;
calculating one or more camera parameters of the one or more cameras, based on pixel values, included in the one or more images, at the image coordinates; and
outputting the one or more camera parameters,
wherein the one or more cameras and the one or more initial camera parameters are in one-to-one relationship, the one or more cameras and the one or more images are in one-to-one relationship, and the one or more cameras and the one or more camera parameters are in one-to-one relationship,
wherein calculation of the image coordinates includes the camera parameter calculator converting the plurality of three-dimensional coordinates into the image coordinates in the one or more images corresponding to the one or more cameras, based on the one or more initial camera parameters corresponding to the one or more cameras,
wherein the one or more cameras include two cameras,
the camera parameter calculator calculates the one or more camera parameters on the basis of a plurality of difference values, and
each of the plurality of difference values is an absolute value of a difference between:
a pixel value at a corresponding point, for one three-dimensional point from among the plurality of three-dimensional points, in a first image captured by a first camera included in the two cameras; and
a pixel value at a corresponding point, for the one three-dimensional point, in a second image captured by a second camera included in the two cameras.

4. A recording medium provided with a control program for causing a device provided with a processor to execute processing, the recording medium being nonvolatile and computer-readable, and the processing including:
obtaining three-dimensional point group data indicating three-dimensional coordinates of a plurality of three-dimensional points included in a common imaging space of one or more cameras;
calculating image coordinates of corresponding points, for each of the plurality of three- dimensional points, in one or more images captured using the one or more cameras, based on the three-dimensional point group data and one or more initial camera parameters of the one or more cameras;
calculating one or more camera parameters of the one or more cameras, based on pixel values, included in the one or more images, at the image coordinates; and
outputting the one or more camera parameters,
wherein the one or more cameras and the one or more initial camera parameters are in one-to-one relationship, the one or more cameras and the one or more images are in one-to-one relationship, and the one or more cameras and the one or more camera parameters are in one-to- one relationship,
wherein calculation of the image coordinates includes the camera parameter calculator converting the plurality of three-dimensional coordinates into the image coordinates in the one or more images corresponding to the one or more cameras, based on the one or more initial camera parameters corresponding to the one or more cameras,
wherein the one or more cameras include two cameras,
the camera parameter calculator calculates the one or more camera parameters on

Assignees

• Panasonic Ip Man Co Ltd

Inventors

• Wakai Nobuhiko
• Nobori Kunio
• Azuma Takeo
• Sato Satoshi
• Maruyama Ayako
• Nakata Mikiya

Classifications

• H04N13/246

  Calibration of cameras · CPC title

• G06T2207/30244

  Camera pose · CPC title

• G01B21/042

  Calibration or calibration artifacts (G01B3/30, G01B9/02072 take precedence) · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T7/80 Primary

  Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration · CPC title