System and methods for calibration of an array camera

Patent metadata

Field	Value
Publication number	US-11570423-B2
Application number	US-202217653267-A
Country	US
Kind code	B2
Filing date	Mar 2, 2022
Priority date	Mar 10, 2013
Publication date	Jan 31, 2023
Grant date	Jan 31, 2023

Abstract

Systems and methods for calibrating an array camera are disclosed. Systems and methods for calibrating an array camera in accordance with embodiments of this invention include the capturing of an image of a test pattern with the array camera such that each imaging component in the array camera captures an image of the test pattern. The image of the test pattern captured by a reference imaging component is then used to derive calibration information for the reference component. A corrected image of the test pattern for the reference component is then generated from the calibration information and the image of the test pattern captured by the reference imaging component. The corrected image is then used with the images captured by each of the associate imaging components associated with the reference component to generate calibration information for the associate imaging components.

First claim

What is claimed:

1. A method for synthesizing an image, the method comprising:
capturing image data using a plurality of imaging components in an array of cameras, the image data comprising:
a reference image captured by a reference imaging component having a reference viewpoint; and
an associate image captured by the associate imaging component having a different second viewpoint;

applying corrections to locations of pixels of the reference image using calibration information for the reference imaging component, the calibration information for the reference imaging component comprising scene independent geometric corrections for image data captured by the reference imaging component to account for distortions related to the mechanical construction of the imaging component and produce a corrected reference image;
applying corrections to locations of pixels of the associate image using calibration information for the associate imaging component, the calibration information for the associate imaging component comprising scene independent geometric corrections for image data captured by the associate imaging component that correct locations of pixels in an image captured by the associate imaging component to locations of corresponding pixel locations in the corrected reference image, where corresponding pixel locations image the same point in a scene in the absence of disparity due to parallax;
generating a depth map by measuring disparity due to parallax between the corrected pixels in the reference image and the corrected pixels in the associate image; and
synthesizing an image using the depth map and at least some of the pixels from the captured image data.

2. The method of claim 1 , wherein the calibration information for the reference imaging component includes characterization information and correction parameters.

3. The method of claim 2 , wherein the characterization information includes uniformity characteristics.

4. The method of claim 1 , wherein the calibration information for the reference imaging component includes compensation parameters for low frequency aberrations.

5. The method of claim 4 , wherein the compensation parameters include X and Y translations.

6. The method of claim 4 , wherein the compensation parameters include a 3rd-order radial translation.

7. The method of claim 4 , wherein the compensation parameters include a 5th-order radial translation.

8. The method of claim 1 further comprising dynamically refocusing an image to blur the synthesized image to make portions of a scene appear out of focus.

9. The method of claim 1 further comprising generating a stereo pair of images using the depth map and the captured image data.

10. The method of claim 9 further comprising displaying the stereo pair of images on a 3D display.

11. The method of claim 1 further comprising synthesizing an image from one or more virtual viewpoints using the depth map.

12. The method of claim 11 further comprising simulating motion parallax and dolly zoom.

13. The method of claim 1 , wherein the synthesized image is a super-resolution image.

14. The method of claim 1 , wherein the calibration information for the reference imaging component further includes colorimetric corrections for image data captured by the reference imaging component.

15. The method of claim 1 , wherein the calibration information for the associate imaging component further includes colorimetric corrections for image data captured by the associate imaging component.

16. The method of claim 1 , wherein the calibration information for the reference imaging component further includes photometric corrections for image data captured by the reference imaging component.

17. The method of claim 1 , wherein the calibration information for the associate imaging component further includes photometric corrections for image data captured by the associate imaging component.

18. The method of claim 1 , wherein the scene independent geometric corrections for image data captured by the associate imaging component are represented by a grid that provides a geometric correction prescription for pixels of the associate imaging component.

Assignees

• Adeia Imaging Llc

Inventors

• Mullis Robert

Classifications

• H04N5/23232

  Electricity · mapped topic

• G06T2207/20048

  Transform domain processing · CPC title

• G06T2207/10012

  Stereo images · CPC title

• H04N13/282

  for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems · CPC title

• H04N13/246 Primary

  Calibration of cameras · CPC title