Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors

Patent metadata

Field	Value
Publication number	US-11022725-B2
Application number	US-201916382099-A
Country	US
Kind code	B2
Filing date	Apr 11, 2019
Priority date	Jun 30, 2012
Publication date	Jun 1, 2021
Grant date	Jun 1, 2021

Abstract

Systems and methods in accordance with embodiments of the invention actively align a lens stack array with an array of focal planes to construct an array camera module. In one embodiment, a method for actively aligning a lens stack array with a sensor that has a focal plane array includes: aligning the lens stack array relative to the sensor in an initial position; varying the spatial relationship between the lens stack array and the sensor; capturing images of a known target that has a region of interest using a plurality of active focal planes at different spatial relationships; scoring the images based on the extent to which the region of interest is focused in the images; selecting a spatial relationship between the lens stack array and the sensor based on a comparison of the scores; and forming an array camera subassembly based on the selected spatial relationship.

First claim

What is claimed is:

1. A method for disabling lens stacks within an array of lens stacks, the method comprising:
providing a lens stack array having a plurality of focal planes in conjunction with a sensor, where each focal plane comprises a plurality of rows of pixels that also form a plurality of columns of pixels and each focal plane is associated with a lens stack of the array;
determining a final spatial relationship arrangement between the lens stack array and the sensor for use in an array camera module;
capturing at least one image of a first known target utilizing the plurality of focal planes at the final spatial relationship arrangement between the lens stack and array;
for each focal plane of the plurality, scoring the at least one image captured, where the resulting score provides an indication to which at least one region of interest within the first known target is focused in the at least one image;
determining that the resulting score of a focal plane does not meet a predetermined quality criterion; and
deactivating the lens stack associated with the focal plane that does not meet a predetermined quality criterion based on the resulting score of the focal plane not meeting the predetermined quality criterion;
capturing images of a second known target using a plurality of active focal planes at different spatial relationships between the lens stack array and the sensor, where the lens stack array comprises a plurality of lens stacks, wherein the second known target has an on-axis and an off-axis region of interest;
scoring the images captured by the plurality of active focal planes, where the resulting scores provide a direct comparison of the extent to which the on-axis and off-axis region of interest are each focused in the images;
comparing the resulting scores of captured images, wherein the comparison of scores further comprises computing:
a first best-fit plane that defines a spatial relationship between the lens stack array and the sensor based on each active focal plane's ability to focus on the on-axis region of interest according to a first predetermined criterion;
a second best-fit plane that defines a spatial relationship between the lens stack array and the sensor based on each active focal plane's ability to focus on the off-axis region of interest according to a second predetermined criterion; and
at least a third intervening plane between the first and second best-fit planes; and

determining the final spatial relationship arrangement between the lens stack array and the sensor utilizing the comparison of the scores.

2. The method of claim 1 , wherein the predetermined quality criterion is based on a lens stack's ability to focus sharply.

3. The method of claim 1 , wherein the predetermined quality criterion is based upon a modulation transfer function (MTF) score for the at least one image.

4. The method of claim 1 , further comprising: when the number of deactivated lens stacks remains below a predetermined threshold, incorporating the lens stack array within a camera module.

5. The method of claim 1 , wherein the first known target and the second known target are the same known target.

6. The method of claim 1 , wherein scoring the images captured by the plurality of active focal planes comprises computing modulation transfer function (MTF) scores for the images.

7. The method of claim 1 , wherein the comparison of the scores of images captured by a plurality of the active focal planes is based upon:
a comparison of the scores of the images captured by a plurality of the active focal planes at the selected spatial relationship to the scores of images captured by the same active focal planes at different spatial relationships; and
the variation between the scores of the images captured by the active focal planes at the selected spatial relationship.

8. The method of claim 1 , wherein the final spatial relationship arrangement minimizes the variance of the scores between the images of the plurality of active focal planes.

9. The method of claim 1 , wherein:
the images are scored such that a score is provided for each region of interest visible in each image, the score being indicative of the extent to which the respective region of interest is focused in the image;
the comparison of scores comprises determining mathematical relationships for each of a plurality of active focal planes that characterize the relationships between:
the scores of the extent to which the on-axis region of interest is focused in the images captured by the respective active focal plane and the spatial relationship between the lens stack array and the sensor; and
the scores of the extent to which the off-axis region of interest is focused in the images captured by the respective active focal plane and the spatial relationship between the lens stack array and the sensor.

10. The method of claim 1 , wherein the first predetermined criterion is based upon:
at each spatial relationship defined by the computed planes, averaging the scores indicative of the extent to which the on-axis region of interest is focused, the scores being averaged across all active focal planes at the respective spatial relationship; and
assessing the variance in the average scores between the spatial relationships.

11. The method of claim 1 , wherein the second predetermined criterion is based upon:
at each spatial relationship defined by the computed planes, averaging the scores indicative of the extent to which the off-axis region of interest is focused, the scores being averaged across all active focal planes at the respective spatial relationship; and
assessing the variance in the average scores between the spatial relationships.

12. The method of claim 1 further comprising varying the spatial relationship between the lens stack array and the sensor.

13. The method of claim 12 , wherein varying the spatial relationship between the lens stack array and the sensor involves sweeping the lens stack array relative to the sensor.

14. The method of claim 13 , wherein the lens stack array is swept in a direction substantially normal to the surface of the sensor.

15. The method of claim 12 , wherein varying the spatial relationship between the lens stack array and the sensor involves at least one of: tipping, tilting or rotating the lens stack array relative to the sensor.

16. The method of claim 1 , wherein a spatial relationship between the lens stack array and the sensor is selected to be used when constructing an array camera module based upon the final spatial relationship arrangement.

17. The method of claim 1 , wherein the resulting score provides an indication to which at least two regions of interest within the first known target are focused in the at least one image.

18. The method of claim 17 , wherein the at least two regions of interest include an on-axis region of interest and an off-axis region of interest.

19. The method of claim 17 , wherein the at least one image is scored such that a score is provided for each region of interest visible in each image, the resulting score being indicative of the extent to which each respective region of interest is focused in the image.

Assignees

• Fotonation Ltd

Inventors

• Duparre Jacques
• Mcmahon Andrew Kenneth John
• Lelescu Dan

Classifications

• H04N17/002 Primary

  for television cameras · CPC title

• H04N25/41

  Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors · CPC title

• H04N23/57

  Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices · CPC title

• H04N23/67

  Focus control based on electronic image sensor signals · CPC title

• H04N23/55 Primary

  Optical parts specially adapted for electronic image sensors; Mounting thereof · CPC title