Method and apparatus for modeling dynamic intrinsic parameters of a camera

Patent metadata

Field	Value
Publication number	US-12106517-B2
Application number	US-202117448308-A
Country	US
Kind code	B2
Filing date	Sep 21, 2021
Priority date	Sep 21, 2021
Publication date	Oct 1, 2024
Grant date	Oct 1, 2024

Abstract

Apparatuses, systems, and methods dynamically model intrinsic parameters of a camera. Methods include: collecting, using a camera having a focus motor, calibration data at a series of discrete focus motor positions; generating, from the calibration data, a set of constant point intrinsic parameters; determining, from the set of constant point intrinsic parameters, a subset of intrinsic parameters to model dynamically; performing, for each intrinsic parameter of the subset of intrinsic parameters, a fit of the point intrinsic parameter values against focus motor positions; generating a model of the intrinsic parameters for the camera based, at least in part, on the fit of the point intrinsic parameter values against the focus motor positions; and determining a position of a fiducial marker within a field of view of the camera based, at least in part, on the model of the intrinsic parameters for the camera.

First claim

That which is claimed:

1. A method for modeling intrinsic parameters of a camera, the method comprising: collecting, using the camera having a focus motor, calibration data at a series of discrete focus motor positions; generating, from the calibration data, a set of constant point intrinsic parameters; determining, from the set of constant point intrinsic parameters, a subset of intrinsic parameters to model dynamically, wherein determining the subset of intrinsic parameters to model dynamically comprises perturbing each constant point intrinsic parameter of the set of constant point intrinsic parameters over a value range of each respective constant point intrinsic parameter to determine the subset of intrinsic parameters that impact a position estimate of a fiducial marker; performing, for each intrinsic parameter of the subset of intrinsic parameters, a fit of point intrinsic parameter values against the focus motor positions; generating a model of intrinsic parameters for the camera based, at least in part, on the fit of the point intrinsic parameter values against the focus motor positions; and determining a position of the fiducial marker within a field of view of the camera based, at least in part, on the model of the intrinsic parameters for the camera.

2. The method of claim 1 , wherein performing the fit of the point intrinsic parameter values against the focus motor positions comprises performing the fit using a least squares polynomial regression of the point intrinsic parameter values against the focus motor positions to generate the model of the intrinsic parameters for the camera.

3. The method of claim 1 , wherein generating a model of the intrinsic parameters for the camera further comprises performing joint refinement on the fit of the point intrinsic parameter values against the focus motor positions for the subset of intrinsic parameters.

4. The method of claim 3 , wherein performing the joint refinement on the fit of the point intrinsic parameter values against the focus motor positions for the subset of intrinsic parameters comprises performing focus-based bundle adjustment on the fit of the point intrinsic parameter values against the focus motor positions for the subset of intrinsic parameters.

5. The method of claim 4 , wherein the focus-based bundle adjustment on the fit of the point intrinsic parameter values against the focus motor positions for the subset of intrinsic parameters is performed using a polynomial model as an initial guess.

6. The method of claim 1 , wherein collecting, using the camera having the focus motor, the calibration data at the series of discrete focus motor positions comprises:
capturing a plurality of images using the camera at different orientations using different focal distances.

7. The method of claim 6 , wherein capturing the plurality of images using the camera at different orientations using different focal distances comprises capturing the plurality of images of a ChArUco board using the camera at different orientations using different focal distances.

8. The method of claim 1 , wherein determining the position of the fiducial marker within the field of view of the camera comprises determining the position of the fiducial marker within the field of view of the camera using a translation between a camera coordinate frame of the camera and a fiducial marker coordinate frame of the fiducial marker.

9. The method of claim 8 , wherein determining the position of the fiducial marker within the field of view of the camera further comprises projecting the position of the fiducial marker in the camera coordinate frame in three-dimensions to a two-dimensional image plane.

10. The method of claim 1 , wherein determining the position of the fiducial marker within the field of view of the camera comprises determining the position and orientation of the fiducial marker.

11. An apparatus for modeling intrinsic parameters of a camera, the apparatus comprising:
the camera configured to acquire a plurality of static images of different orientations of a space in which a fiducial marker is disposed;
a control system configured to:
determine calibration data from the plurality of static images;
generate, from the calibration data, a set of constant point intrinsic parameters;
determine, from the set of constant point intrinsic parameters, a subset of intrinsic parameters to model dynamically, wherein the subset of intrinsic parameters to dynamically model is determined by perturbing each constant point intrinsic parameter of the set of constant point intrinsic parameters over a value range of each respective constant point intrinsic parameter to determine the subset of intrinsic parameters that impact a position estimate of the fiducial marker;
perform, for each intrinsic parameter of the subset of intrinsic parameters, a fit of point of intrinsic parameter values against focus motor positions;
generate a model of intrinsic parameters for the camera based at least in part on the fit of the point intrinsic parameter values against the focus motor positions; and
determine a position of the fiducial marker within a field of view of the camera based, at least in part, on the model of the intrinsic parameters for the camera.

12. The apparatus of claim 11 , wherein the control system configured to perform the fit of the point intrinsic parameter values against the focus motor positions is further configured to perform the fit using a least squares polynomial regression of the point intrinsic parameter values against the focus motor positions to generate the model of the intrinsic parameters for the camera.

13. The apparatus of claim 11 , wherein the control system configured to generate a model of the intrinsic parameters for the camera is further configured to perform joint refinement on the fit of the point intrinsic parameter values against the focus motor positions for the subset of intrinsic parameters.

14. The apparatus of claim 13 , wherein the control system configured to perform the joint refinement on the fit of the point intrinsic parameter values against the focus motor positions for the subset of intrinsic parameters is further configured to perform focus-based bundle adjustment on the fit of the point intrinsic parameter values against the focus motor positions for the subset of intrinsic parameters.

15. The apparatus of claim 14 , wherein the focus-based bundle adjustment on the fit of the point intrinsic parameter values against the focus motor positions for the subset of intrinsic parameters is performed using a polynomial model as an initial guess.

16. The apparatus of claim 11 , wherein the fiducial marker comprises a ChArUco board.

17. A control system for modeling intrinsic parameters of a camera, the control system configured to: collect, using the camera having a focus motor, calibration data at a series of discrete focus motor positions; generate, from the calibration data, a set of constant point intrinsic parameters; determine, from the set of constant point intrinsic parameters, a subset of intrinsic parameters to model dynamically, wherein the subset of intrinsic parameters to dynamically model is determined by perturbing each constant point intrinsic parameter of the set of constant point intrinsic parameters over a value range of each respective constant point intrinsic parameter to determine the subset of intrinsic parameters that impact a position estimate of a fiducial marker; perform, for each intrinsic parameter of the subset of intrinsic parameters, a fit of point intrinsic parameter values against the focus motor

Assignees

• Boeing Co

Inventors

• Feldman Aaron
• Khosla Deepak
• Chen Yang
• Huber David

Classifications

• H04N17/002

  for television cameras · CPC title

• G06T2207/30204

  Marker · CPC title

• G06T2207/10148

  Varying focus · CPC title

• H04N23/676

  Bracketing for image capture at varying focusing conditions · CPC title

• G06T7/73

  using feature-based methods · CPC title