Point of view aberrations correction in a scanning folded camera

Patent metadata

Field	Value
Publication number	US-12108151-B2
Application number	US-202218064269-A
Country	US
Kind code	B2
Filing date	Dec 11, 2022
Priority date	Jul 15, 2020
Publication date	Oct 1, 2024
Grant date	Oct 1, 2024

Abstract

Systems and methods for correcting point of view (POV) aberrations in scanning folded cameras and multi-cameras including such scanning folded cameras. In a Tele folded camera that includes an optical path folding element (OPFE) and an image sensor, the OPFE is tilted in one or two directions to direct the Tele folded camera towards a POV of a scene, a Tele image or a stream of Tele images is captured from the POV, the Tele image having POV aberrations and the POV aberrations are digitally corrected to obtain an aberration-corrected image or stream of images.

First claim

What is claimed is:

1. A method comprising:
a) providing a Tele folded camera that includes an optical path folding element (OPFE) and an image sensor;
b) tilting the OPFE in one or more directions to perform optical image stabilization (OIS);
c) while performing the OIS, capturing a stream of Tele images, wherein each captured Tele image is associated with a respective point of view (POV) and has a respective POV aberration in the shape of a non-rectangular tetragon that depends on a respective OPFE tilt position; and
d) digitally correcting the non-rectangular tetragon shape of the respective POV aberration into a rectangular shape based on the respective OPFE tilt position.

2. The method of claim 1 , wherein the correcting the respective POV aberration depends on calibration data.

3. The method of claim 1 , wherein for calculating OIS control signals, data from an inertial measurement unit and/or and image data is used.

4. The method of claim 1 , wherein the respective POV aberration represents a rotation of a Tele image.

5. The method of claim 1 , wherein the respective POV aberration represents a stretching to a trapez shape of a Tele image.

6. The method of claim 1 , wherein the respective POV aberration represents a scaling of a Tele image.

7. The method of claim 1 , wherein the OPFE is tilted in two directions to perform OIS.

8. The method of claim 1 , wherein the Tele folded camera has a scanning Tele field-of-view (S-FOV T ) which is scanned by tilting the OPFE, the S-FOV T including a center POV and a plurality of non-center POVs, and wherein the Tele folded camera can be directed towards all POVs within S-FOV T to perform the OIS.

9. The method of claim 8 , wherein the respective POV aberration is caused by tilting the OPFE to a non-center POV.

10. The method of claim 1 , wherein the OPFE is a prism.

11. The method of claim 1 , wherein the correcting the respective POV aberration includes applying a geometric transformation to the captured Tele image having the respective POV aberration to obtain a respective aberration-corrected image.

12. The method of claim 11 , wherein the geometric transformation uses calibration data captured during a camera calibration process.

13. The method of claim 11 , wherein the geometric transformation is a homography transformation.

14. The method of claim 1 , further comprising cropping the aberration-corrected image to obtain a respective aberration-corrected cropped (ACC) image that has an ACC image center, an ACC image size and an ACC image width/height ratio.

15. The method of claim 14 , further comprising scaling the ACC image to obtain a respective aberration-corrected cropped and scaled output image that has an output image center (OIC), an output image size and an output image width/height ratio.

16. The method of claim 15 , wherein the image sensor has an image sensor center, an active sensor width and an active sensor height, and wherein the OIC coincides with the image sensor center.

17. The method of claim 15 , wherein the OIC is selected so that a largest possible rectangular crop image size for a particular output image width/height ratio is achieved.

18. The method of claim 15 , wherein the OIC is located less than 10 pixel sizes away from an ideal OIC, wherein the ideal OIC is where a particular image point is located at the OIC or an image center is located at the OIC.

19. The method of claim 15 , wherein the OIC is located less than a distance of 10% of the active sensor width away from an ideal OIC, wherein the ideal OIC is where a particular image point is located at the OIC or an image center is located at the OIC.

20. The method of claim 15 , wherein the OIC is located less than a distance of 10% of the active sensor height away from an ideal OIC, wherein the ideal OIC is where a particular image point is located at the OIC or an image center is located at the OIC.

21. The method of claim 15 , wherein a cropping criterion is selected such that an object-image magnification M of an object across different POVs does vary from a constant value by less than 10%.

22. The method of claim 15 , wherein the OIC is selected such that the output image covers a maximum area within a scene.

23. The method of claim 15 , wherein steps b and c are repeated to obtain a plurality of Tele images captured at a plurality of respective POVs, and wherein the OIC is selected such that a plurality of Tele images captured for all possible POVs cover a maximum rectangular area within a scene.

24. The method of any of the claim 23 , wherein the method is used in a smartphone.

Assignees

• Corephotonics Ltd

Inventors

• Azoulai Itamar
• Safra Gal
• Werbner Anat
• Yehudayi Ela
• Ilan Paz
• Geva Nadav
• Cohen Noy
• Shabtay Gal
• Goldenberg Ephraim
• Katz Ruthy

Classifications

• H04N23/55

  Optical parts specially adapted for electronic image sensors; Mounting thereof · CPC title

• H04N23/683 Primary

  performed by a processor, e.g. controlling the readout of an image memory · CPC title

• G02B27/646

  compensating for small deviations, e.g. due to vibration or shake (movement of one or more optical elements for control of motion blur in cameras, projectors or printers G03B2205/0007; image stabilisation in cameras peculiar to the presence or use of an electronic image sensor H04N23/68) · CPC title

• G03B17/12

  with means for supporting objectives, supplementary lenses, filters, masks, or turrets · CPC title

• G02B7/1805

  for prisms (G02B7/181 takes precedence) · CPC title