Multi-camera system using folded optics free from parallax and tilt artifacts

Patent metadata

Field	Value
Publication number	US-2016198087-A1
Application number	US-201615015573-A
Country	US
Kind code	A1
Filing date	Feb 4, 2016
Priority date	Jun 20, 2014
Publication date	Jul 7, 2016
Grant date	—

Abstract

Aspects relate to an array camera exhibiting little or no parallax artifacts in captured images. For example, the planes of the central mirror prism of the array camera can intersect at an apex defining the vertical axis of symmetry of the system. The apex can serve as a point of intersection for the optical axes of the sensors in the array. Each sensor in the array “sees” a portion of the image scene using a corresponding facet of the central mirror prism, and accordingly each individual sensor/mirror pair represents only a sub-aperture of the total array camera. The complete array camera has a synthetic aperture generated based on the sum of all individual aperture rays.

First claim

1 - 30 . (canceled)

31 . An imaging system for forming an image of a target scene by combining into an image a plurality of portions of a target scene, comprising:
a reflecting component having a plurality of reflecting means for reflecting incoming light from a target scene into a plurality of portions and redirecting each portion in a different direction, the plurality of reflecting means arranged to intersect at an apex; and a plurality of capturing means for capturing the plurality of portions of incoming light from the target scene, the reflecting component disposed between at least two of the capturing means, each of the plurality of capturing means being associated with one of the plurality of reflecting means and arranged to receive light reflected from the associated reflecting means, each of the plurality of capturing means having an optical axis and arranged such that each optical axis is aligned to intersect at the apex, and each capturing means including a means for sensing configured to provide an output representative of the portion of light received by the means for sensing from the target scene.

32 . The imaging system of claim 31 , wherein each of the plurality of reflecting means of the reflecting component comprises a planar reflective surface, the planar reflective surfaces arranged to form sides of the reflecting component and intersecting at the apex.

33 . The imaging system of claim 32 ,
wherein each of the plurality of capturing means comprises a camera having a lens assembly, and wherein each of the plurality of sensing means comprises an image sensor having an array of light sensing elements.

34 . The imaging system of claim 33 ,
wherein the imaging system further comprises a virtual optical axis passing through the apex; wherein the at least one of the planar reflective surfaces is positioned to such that a plane formed by the planar reflective surface relative to the virtual optical axis form a first angle, the cameras arranged such that the optical axis of at least one camera forms a second angle relative to the virtual optical axis, the value of the second angle being twice the value of the first angle.

35 . The imaging system of claim 34 , wherein each of the reflective surfaces are positioned such that planes formed by each of the reflective surfaces form the first angle relative to the virtual optical axis, the optical axis of each of the plurality of cameras forming the second angle relative to the virtual optical axis.

36 . The imaging system of claim 33 , wherein:
the plurality of reflective surfaces are arranged such that a first subset of the plurality of reflective surfaces form the first angle relative to the virtual optical axis; the plurality of cameras are arranged such that the optical axis of a corresponding first subset of the plurality of cameras form the second angle relative to the virtual optical axis; the plurality of reflective surfaces further arranges such that planes formed by a second subset of the plurality of reflective surfaces form a third angle relative to the virtual optical axis, the third angle having a value different than the value of the first angle; and the plurality of cameras are arranged such that the optical axis of a corresponding second subset of the plurality of cameras form a fourth angle relative to the virtual optical axis, the fourth angle having a value equal to double the value of the third angle.

37 . The imaging system of claim 31 , wherein each of the plurality of capturing means comprises a camera having a lens assembly and a sensor, and for each camera
the optical axis of the camera intersects with a center of projection of the lens assembly, and the optical axis of the camera intersects with the sensor at a location offset from a center of the sensor.

38 . The imaging system of claim 37 , wherein each lens assembly has a center of projection, and wherein at least two of the lens assemblies are positioned such that the apex is equidistant from the center of projection of each of the at least two of lens assemblies.

39 . The imaging system of claim 37 , wherein each lens assembly is identical to one another, and wherein the lens assemblies are positioned equidistant from the apex.

40 . The imaging system of claim 33 , further comprising a substrate, the reflecting component coupled to the substrate, and wherein each of the image sensors are positioned on the substrate.

41 . The imaging system of claim 33 , further comprising a substrate, the reflecting component mounted within an aperture of the substrate, and wherein each of the image sensors are positioned on the substrate.

42 . The system of claim 33 , further comprising a plurality of secondary light reflecting surfaces, each of the plurality of secondary light reflecting surfaces positioned to receive incoming light from a corresponding one of the lens assemblies and redirect the incoming light toward a corresponding one of the image sensors.

43 . The system of claim 42 , wherein the plurality of secondary light reflecting surfaces each comprise one of a reflective surface or a refractive prism.

44 . An imaging system for capturing a plurality of portions of a target scene into an image, comprising:
a reflecting component comprising
a plurality of primary light reflecting surfaces positioned to split incident light representing the target scene into the plurality of portions and redirect each of the plurality of portions in a different direction, and
an apex located at an intersection of the plurality of primary light reflecting surfaces; and
a plurality of cameras each positioned to receive a portion of the plurality of portions, the reflecting component disposed between at least two cameras of the plurality of cameras, each of the at least two cameras having:
an optical axis aligned to intersect at the apex,
an image sensor that generates an output representing the portion of the target scene captured by the image sensor, the image sensor associated with one of the plurality of primary light reflecting surfaces and arranged to receive light from a portion of the target scene reflected by the associated primary light reflecting surface.

45 . The imaging system of claim 44 , further comprising a virtual optical axis passing through the apex, wherein at least one of the plurality of primary light reflecting surfaces is positioned such that a plane formed by the at least one of the plurality of primary light reflecting surfaces relative to the virtual optical axis form a first angle, the optical axis of at least one of the plurality of cameras forming a second angle relative to the virtual optical axis, the second angle having a value equal to double a value of the first angle.

46 . The imaging system of claim 45 , wherein each of the plurality of primary light reflecting surfaces are positioned such that planes formed by each of the plurality of primary light reflecting surfaces form the first angle relative to the virtual optical axis, the optical axis of each of the plurality of cameras forming the second angle relative to the virtual optical axis.

47 . The imaging system of claim 45 , wherein:
planes formed by a first subset of the plurality of primary light reflecting surfaces form the first angle relative to the virtual optical axis; the optical axis of a corresponding first subset of the plurality of cameras form the second angle relative to the virtual optical axis; planes formed by a second subset of the plurality of primary light reflecting surfaces form a third angle rel

Assignees

• Qualcomm Inc

Inventors

• Georgiev Todor Georgiev
• Goma Sergiu Radu

Classifications

• Y10T29/49828

  Progressively advancing of work assembly station or assembled portion of work · CPC title

• G03B17/17 Primary

  with reflectors arranged in beam forming the photographic image, e.g. for reducing dimensions of camera · CPC title

• G03B17/00

  Details of cameras or camera bodies; Accessories therefor (lens hoods or caps G03B11/04) · CPC title

• H04N23/54

  Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils · CPC title

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title