System and methods for calibration of an array camera

Patent metadata

Field	Value
Publication number	US-11985293-B2
Application number	US-202318161317-A
Country	US
Kind code	B2
Filing date	Jan 30, 2023
Priority date	Mar 10, 2013
Publication date	May 14, 2024
Grant date	May 14, 2024

Abstract

Systems and methods for calibrating an array camera are disclosed. Systems and methods for calibrating an array camera in accordance with embodiments of this invention include the capturing of an image of a test pattern with the array camera such that each imaging component in the array camera captures an image of the test pattern. The image of the test pattern captured by a reference imaging component is then used to derive calibration information for the reference component. A corrected image of the test pattern for the reference component is then generated from the calibration information and the image of the test pattern captured by the reference imaging component. The corrected image is then used with the images captured by each of the associate imaging components associated with the reference component to generate calibration information for the associate imaging components.

First claim

What is claimed:

1. A method for calibrating an array of cameras, the method comprising:
capturing image data using cameras in an array of cameras, where each camera in the array of cameras has a different viewpoint, and where the image data comprises a plurality of images captured from the different viewpoints;
generating scene independent geometric corrections for each camera in the array of cameras, where the scene independent geometric corrections for each camera are generated with respect to a virtual viewpoint that does not correspond to the viewpoints of any camera in the array of cameras;
determining corrections to locations of pixels of at least one image in the plurality of images using the scene independent geometric corrections for the camera in the array of cameras that captured the at least one image, wherein the determined corrections are configured to be used to produce a corrected image from the virtual viewpoint; and
storing the determined corrections in a memory.

2. The method of claim 1 , further comprising generating a depth map using at least two images from the plurality of images in the image data.

3. The method of claim 1 , further comprising:
applying corrections to locations of pixels of at least two images in the plurality of images, using the scene independent geometric corrections for the cameras in the array of cameras that captured the at least two images, to produce at least two corrected images from the reference viewpoint; and
generating a higher resolution image from the reference viewpoint using the at least two corrected images.

4. The method of claim 1 , wherein the array of cameras comprises cameras positioned in a 5×5 array.

5. The method of claim 1 , wherein a first camera and a second camera in the array of cameras have different imaging characteristics.

6. The method of claim 5 , wherein the different imaging characteristics comprise field of view.

7. The method of claim 1 , wherein generating scene independent geometric corrections for a given camera in the array of cameras comprises:
capturing a first image and a second image of a pattern using the given camera and a reference camera, respectively;
identifying positions of a set of features in the pattern in the first image;
identifying positions of the set of features in the pattern in the second image;
translating the positions of the set of features to account for expected parallax shift between the given camera and the reference camera;
calculating X and Y offsets for each feature in the set of features, wherein the calculating of the X and Y offsets is based at least in part on a comparison of the translated positions of the set of features and the identified positions of the set of features in the first image; and
generating the scene independent geometric corrections based on the X and Y offsets.

8. The method of claim 7 , wherein the set of features comprises intersections in the pattern.

9. The method of claim 1 , wherein at least two cameras in the array of cameras do not contain overlapping pixels.

10. The method of claim 1 , further comprising generating colorimetric corrections for each camera in the array of cameras using the plurality of images captured from the different viewpoints.

11. A calibration system for an array of cameras, comprising:
an array of cameras;
a processor communicatively coupled to cameras in the array of cameras; and
a memory communicatively coupled to the processor, where the memory stores machine readable instructions that configure the processor to;
capture image data using cameras in the array of cameras, where each camera in the array of cameras has a different viewpoint, and where the image data comprises a plurality of images captured from the different viewpoints;
generate scene independent geometric corrections for each camera in the array of cameras, where the scene independent geometric corrections for each camera are generated with respect to a virtual viewpoint that does not correspond to the viewpoints of any of any camera in the array of cameras;
determine corrections to locations of pixels of at least one image in the plurality of images using the scene independent geometric corrections for the camera in the array of cameras that captured the at least one image, wherein the determined corrections are configured to be used to produce a corrected image from the virtual viewpoint; and
store the determined corrections in a memory as calibration data in the memory.

12. The system of claim 11 , where the machine readable instructions further direct the processor to generate a depth map using at least two images from the plurality of images in the image data.

13. The system of claim 11 , where the machine readable instructions further direct the processor to:
apply corrections to locations of pixels of at least two images in the plurality of images, using the scene independent geometric corrections for the cameras in the array of cameras that captured the at least two images, to produce at least two corrected images from the reference viewpoint; and
generate a higher resolution image from the reference viewpoint using the at least two corrected images.

14. The system of claim 11 , wherein the array of cameras comprises cameras positioned in a 5×5 array.

15. The system of claim 11 , wherein a first camera and a second camera in the array of cameras have different imaging characteristics.

16. The system of claim 15 , wherein the different imaging characteristics comprise field of view.

17. The system of claim 11 , wherein to generate scene independent geometric corrections for a given camera in the array of cameras, the machine readable instructions further direct the processor to:
capture a first image and a second image of a pattern using the given camera and a reference camera, respectively;
identify positions of a set of features in the pattern in the first image;
identify positions of the set of features in the pattern in the second image;
translate the positions of the set of features to account for expected parallax shift between the given camera and the reference camera;
calculate X and Y offset for each feature in the set of features, wherein the calculating of the X and Y offsets is based at least in part on a from a comparison of the translated positions of the set of features and the identified positions of the set of features in the first image; and
generate the scene independent geometric corrections based on the X and Y offset information.

18. The system of claim 17 , wherein the set of features comprises intersections in the pattern.

19. The system of claim 11 , wherein at least two cameras in the array of cameras do not contain overlapping pixels.

20. The system of claim 11 , the machine readable instructions further direct the processor to generate colorimetric corrections for each camera in the array of cameras using the plurality of images captured from the different viewpoints.

Assignees

• Adeia Imaging Llc

Inventors

• Mullis Robert

Classifications

• H04N13/246 Primary

  Calibration of cameras · CPC title

• G06T7/85

  Stereo camera calibration · CPC title

• H04N13/243

  using three or more two-dimensional [2D] image sensors · CPC title

• H04N13/257

  Colour aspects · CPC title

• H04N13/282

  for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems · CPC title