Method and apparatus for calibration of stereo-optical three-dimensional surface-mapping system

Patent metadata

Field	Value
Publication number	US-9456200-B2
Application number	US-201314370713-A
Country	US
Kind code	B2
Filing date	Jan 4, 2013
Priority date	Jan 4, 2012
Publication date	Sep 27, 2016
Grant date	Sep 27, 2016

Abstract

A system for, and method of, extracting a surface profile from a stereo pair of images obtained at an arbitrary setting S of an optical system, includes determining surface profile reconstruction parameters for images obtained with the optical system at a reference setting So of the optical system; determining warping parameters for a digital image processor for warping images obtained with the optical system at the arbitrary setting S into images corresponding to the reference setting So; obtaining the stereo pair of images from at least one camera of the optical system; warping the stereo pair of images into images corresponding to the reference setting So, and using the surface profile reconstruction parameters to determine the surface profile. In a particular embodiment, the surface profile is passed to a computer model of tissue deformation and used to determine an intra-surgery location of a tumor or other anatomic feature of tissue.

First claim

What is claimed is:

1. A method of calibrating a system for extracting a surface profile from a stereo pair of images obtained at an arbitrary setting S of an optical system, comprising:
determining surface profile reconstruction parameters for a stereo pair of images obtained with the optical system at a reference setting S0 of the optical system, the reference setting S0 being different from the arbitrary setting S;
determining warping parameters for a digital image processor for warping the stereo pair of images obtained with the optical system at the arbitrary setting S into a stereo pair of warped images corresponding to the reference setting S0;
wherein the settings S and S0 include at least a different configuration for magnification of the optical system;
and further comprising recording surface profile reconstruction parameters for a plurality of reference settings in a table.

2. The method of claim 1 further including recording warping parameters (DFPs) for warping stereo pairs of images obtained at each of a plurality of predetermined optical settings into stereo pairs of warped images corresponding to the reference setting S 0 in the table, measuring a current set of optical parameters corresponding to the arbitrary setting S, and determining warping parameters for warping the stereo pair of images obtained with the optical system at the arbitrary setting S into the stereo pair of warped images corresponding to the reference setting S0 by interpolation between the DFPs recorded in the table.

3. A of calibrating a system for extracting a surface profile from a stereo pair of images obtained at an arbitrary setting S of an optical system, comprising:
determining surface profile reconstruction parameters for a stereo pair of images obtained with the optical system at a reference setting S0 of the optical system, the reference setting S0 being different from the arbitrary setting S;
determining warping parameters for a digital image processor for warping the stereo pair of images obtained with the optical system at the arbitrary setting S into a stereo pair of warped images corresponding to the reference setting S0;
wherein the settings S and S0 include at least a different configuration for magnification of the optical system;
the arbitrary setting S of the optical system comprising an S-magnification setting and the reference setting S0 of the optical system comprising a S0-magnification setting, the S0 and S magnification settings being different;
and further including recording warping parameters (DFPs) for warping stereo pairs of images obtained at each of a plurality of predetermined optical settings into stereo pairs of warped images corresponding to the reference setting S 0 in the table, measuring a current set of optical parameters corresponding to the arbitrary setting S, and determining warping parameters for warping the stereo pair of images obtained with the optical system at the arbitrary setting S into the stereo pair of warped images corresponding to the reference setting S0 by interpolation between the DFPs recorded in the table.

4. A method of calibrating a system for extracting a surface profile from a stereo pair of images obtained at an arbitrary setting S of an optical system, comprising:
determining surface profile reconstruction parameters for a stereo pair of images obtained with the optical system at a reference setting S0 of the optical system, the reference setting S0 being different from the arbitrary setting S;
determining warping parameters for a digital image processor for warping the stereo pair of images obtained with the optical system at the arbitrary setting S into a stereo pair of warped images corresponding to the reference setting S0;
wherein the settings S and S0 include at least a different configuration for magnification of the optical system;
wherein the step of determining warping parameters further comprises machine readable instructions for using images of a calibration phantom, the calibration phantom having reference marks, to determine the warping parameters.

5. The method of claim 4 wherein the reference marks of the calibration phantom are squares of randomly varied intensity.

6. A method of extracting a surface profile from a stereo pair of images obtained at an arbitrary setting S of an optical system, comprising:
determining surface profile reconstruction parameters for a stereo pair of images obtained with the optical system at a reference setting S0 of the optical system, the reference setting S0 being different from the arbitrary setting S;
determining warping parameters for a digital image processor for warping the stereo pair of images obtained with the optical system at the arbitrary setting S into a stereo pair of warped images corresponding to the reference setting S0;
wherein the settings S and S0 include at least a different configuration for magnification of the optical system;
wherein the surface profile is a surface profile of tissue exposed during surgery, and further comprising:
using the surface profile, a pre-surgery three-dimensional location of a tumor in the tissue, and a model of deformation of the tissue to determine an intra-surgery location of the tumor.

7. A method of extracting a surface profile from a stereo pair of images obtained at an arbitrary setting S of an optical system, comprising:
determining surface profile reconstruction parameters for a stereo pair of images obtained with the optical system at a reference setting S0 of the optical system, the reference setting S0 being different from the arbitrary setting S;
determining warping parameters for a digital image processor for warping the stereo pair of images obtained with the optical system at the arbitrary setting S into a stereo pair of warped images corresponding to the reference setting S0;
wherein the settings S and S0 include at least a different configuration for magnification of the optical system;
and further comprising:
obtaining the stereo pair of images obtained at the arbitrary setting S of the optical system from at least one camera of the optical system;
warping the stereo pair of images obtained at the arbitrary setting S of the optical system into a stereo pair of warped images corresponding to the reference setting S0, and using the surface profile reconstruction parameters to determine the surface profile;
further comprising recording warping parameters DFPs for warping images obtained with predetermined optical settings in a table, measuring a current set of optical parameters corresponding to the arbitrary setting S, and determining warping parameters for the arbitrary setting S by interpolation between the DFPs recorded in the table.

8. A system adapted for extracting a surface profile comprising:
an adjustable optical system having a reference setting S 0 and at least one arbitrary setting S, the optical system having at least one camera for obtaining stereo image pairs, and wherein settings S and S0 include at least a magnification of the adjustable optical system;
an image processor coupled to receive stereo image pairs from the at least one camera of the optical system, further comprising a processor and a memory having recorded therein:
reconstruction parameters for determining a surface profile from images obtained with the optical system at the reference setting S 0 ;
machine readable instructions for using warping parameters to warp images obtained with the optical system at the arbitrary setting S into images corresponding to the reference setting S 0 ; and
machine readable instructions for using the reconstruction parameters to determine the surface profile; and
further comprising:
a library having recorded therein warping parameters DFPs for

Assignees

• Dartmouth College

Inventors

• Ji Songbai
• Fan Xiaoyao
• Paulsen Keith D
• Roberts David W
• Hartov Alex

Classifications

• G06T3/0093

  Physics · mapped topic

• H04N13/0246 Primary

  Electricity · mapped topic

• G01C11/02 Primary

  Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures · CPC title

• H04N2013/0074

  Stereoscopic image analysis · CPC title

• G01C25/00

  Manufacturing, calibrating, cleaning, or repairing instruments or devices referred to in the other groups of this subclass (testing, calibrating or compensating compasses G01C17/38) · CPC title