Thin multi-aperture imaging system with auto-focus and methods for using same

Patent metadata

Field	Value
Publication number	US-11856291-B2
Application number	US-202318333575-A
Country	US
Kind code	B2
Filing date	Jun 13, 2023
Priority date	Aug 1, 2013
Publication date	Dec 26, 2023
Grant date	Dec 26, 2023

Abstract

Dual-aperture digital cameras with auto-focus (AF) and related methods for obtaining a focused and, optionally optically stabilized color image of an object or scene. A dual-aperture camera includes a first sub-camera having a first optics bloc and a color image sensor for providing a color image, a second sub-camera having a second optics bloc and a clear image sensor for providing a luminance image, the first and second sub-cameras having substantially the same field of view, an AF mechanism coupled mechanically at least to the first optics bloc, and a camera controller coupled to the AF mechanism and to the two image sensors and configured to control the AF mechanism, to calculate a scaling difference and a sharpness difference between the color and luminance images, the scaling and sharpness differences being due to the AF mechanism, and to process the color and luminance images into a fused color image using the calculated differences.

First claim

What is claimed is:

1. A multi-aperture imaging system comprising:
a first camera comprising a first plurality of lens elements and a first sensor with a first number of pixels and a non-standard color filter array that includes repetitions of a N×N micro-cell, wherein 3≤N≤6; and
a second camera comprising a second sensor with a second number of pixels and a second type of color filter array different from the first type of filter array,
wherein the N×N micro-cell includes a 4×2 pixel group,
wherein the 4×2 pixel group includes a third number of red pixels and a third number of blue pixels,
wherein a first line of the 4×2 pixel group includes a first red pixel and a second red pixel directly adjacent to the first red pixel,
wherein a second line of the 4×2 pixel group includes a first blue pixel and a second blue pixel directly adjacent to the first blue pixel, and wherein the first camera is an auto-focus camera.

2. The multi-aperture imaging system of claim 1 , wherein the second camera is an auto-focus camera and comprises a second plurality of lens elements.

3. The multi-aperture imaging system of claim 2 , wherein the first number of pixels is equal to or different from the second number of pixels.

4. The multi-aperture imaging system of claim 3 , wherein the first camera is disposed adjacent to the second camera.

5. The multi-aperture imaging system of claim 4 , wherein the multi-aperture imaging system is included in a cell-phone.

6. The multi-aperture imaging system of claim 4 , wherein the multi-aperture imaging system includes a camera controller, and wherein a camera controller configuration is based on calibration data.

7. The multi-aperture imaging system of claim 6 , wherein the calibration data is saved in a one-time programmable memory or an EEPROM in the multi-aperture imaging system.

8. The multi-aperture imaging system of claim 4 , wherein the multi-aperture imaging system includes a processor, wherein the processor is configured to receive a first image from the first camera and a second image from the second camera, and wherein the processor is configured to perform an image registration on the first and second images to obtain respective rectified, normalized and scale-adjusted first and second images.

9. The multi-aperture imaging system of claim 4 , wherein the multi-aperture imaging system includes a processor, wherein the processor is configured to receive a first image from the first camera and a second image from the second camera, wherein the processor is configured to run an algorithm that synthesizes a third image from the first and second images, and wherein the third image includes information at higher spatial frequencies than the first image alone.

10. A multi-aperture imaging system comprising:
a first camera comprising a first plurality of lens elements and a first sensor with a first number of pixels and a non-standard color filter array that include repetitions of a N×N micro-cell, wherein 3≤N≤6; and
a second camera comprising a second sensor with a second number of pixels and a second type of color filter array different from the first type of filter array,
wherein the N×N micro-cell includes a 4×2 pixel group,
wherein the 4×2 pixel group includes a third number of red pixels and a third number of blue pixels,
wherein the 4×2 pixel group includes a first red pixel, a second red pixel directly adjacent to the first red pixel, a first blue pixel, a second blue pixel directly adjacent to the first blue pixel, and first and second green pixels,
wherein the first green pixel is disposed on a first column line and the second green pixel is disposed on a fourth column line in the 4×2 pixel group, and wherein the first camera is an auto-focus camera.

11. The multi-aperture imaging system of claim 10 , wherein the second camera is an auto-focus camera, and wherein the second camera includes a second plurality of lens elements.

12. The multi-aperture imaging system of claim 11 , wherein the first number of pixels is equal to or different from the second number of pixels.

13. The multi-aperture imaging system of claim 12 , wherein the first camera is disposed adjacent to the second camera.

14. The multi-aperture imaging system of claim 13 , wherein the multi-aperture imaging system is included in a cell-phone.

15. The multi-aperture imaging system of claim 13 , wherein the multi-aperture imaging system includes a camera controller, and wherein a camera controller configuration is based on calibration data.

16. The multi-aperture imaging system of claim 15 , wherein the calibration data is saved in a one-time programmable memory or an EEPROM in the multi-aperture imaging system.

17. The multi-aperture imaging system of claim 13 , wherein the multi-aperture imaging system includes a processor, wherein the processor is configured to receive a first image from the first camera and a second image from the second camera, and wherein the processor is configured to perform an image registration to obtain respective rectified, normalized and scale-adjusted first and second images.

18. The multi-aperture imaging system of claim 13 , wherein the multi-aperture imaging system includes a processor, wherein the processor is configured to receive a first image from the first camera and a second image from the second camera, wherein the processor is configured to run an algorithm that synthesizes a third image from the first image and the second image, and wherein the third image includes information at higher spatial frequencies than the first image alone.

19. A multi-aperture imaging system comprising:
a first camera comprising a plurality of lens element and a first sensor with a first number of pixels and a non-standard color filter array that include repetitions of N×N micro-cell, wherein 3≤N≤6; and
a second camera comprising a second sensor with a second number of pixels and a second type of color filter array different from the first type of filter array,
wherein the N×N micro-cell includes a 4×2 pixel group,
wherein the 4×2 pixel group includes a third number of red pixels and a third number of blue pixels,
wherein the 4×2 pixel group includes a first red pixel, a second red pixel directly adjacent to the first red pixel, a first blue pixel, a second blue pixel directly adjacent to the first blue pixel, and first and second green pixels,
wherein the first red pixel and the second red pixel are disposed on first and second column lines in the 4×2 pixel group,
wherein the first blue pixel and the second blue pixel are disposed on third and fourth column lines in the 4×2 pixel group,
and wherein the first camera is an auto-focus camera.

20. The multi-aperture imaging system of claim 19 , wherein the first green pixel is disposed on a first column line and the second green pixel is disposed on a fourth column line in the 4×2 pixel group.

21. The multi-aperture imaging system of claim 20 , wherein the second camera is an auto-focus camera, and wherein the second camera includes a second plurality of lens elements.

22. The multi-aperture imaging system of claim 21 , wherein the first number of pixels is different from the second number of pixels.

23. The multi-aperture imaging system of claim 22 , wherein the multi-aperture imaging system is included in a cell-phone.

24. The multi-aperture imaging system of claim 22 , wherein the multi-aperture imaging system includes a camera controller, and wherein a cam

Assignees

• Corephotonics Ltd

Inventors

• Shabtay Gal
• Cohen Noy
• Geva Nadav
• Gigushinski Oded
• Goldenberg Ephraim

Classifications

• H04N9/64

  Circuits for processing colour signals (H04N9/77 takes precedence; camera processing pipelines for processing colour signals H04N23/84) · CPC title

• H04N5/33

  Transforming infrared radiation (cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20) · CPC title

• H04N23/84

  for processing colour signals · CPC title

• H04N23/20

  for generating image signals from infrared radiation only · CPC title

• H04N23/67 Primary

  Focus control based on electronic image sensor signals · CPC title