Multi-camera system using folded optics free from parallax artifacts

Patent metadata

Field	Value
Publication number	US-2016286121-A1
Application number	US-201615163091-A
Country	US
Kind code	A1
Filing date	May 24, 2016
Priority date	Jun 20, 2014
Publication date	Sep 29, 2016
Grant date	—

Abstract

Aspects relate to an array camera exhibiting little or no parallax artifacts in captured images. For example, the planes of the central mirror surfaces of the array camera can be located at a midpoint along, and orthogonally to, a line between the corresponding camera location and the virtual camera location. Accordingly, the cones of all of the cameras in the array appear as if coming from the virtual camera location after folding by the mirrors. Each sensor in the array “sees” a portion of the image scene using a corresponding facet of the central mirror prism, and accordingly each individual sensor/mirror pair represents only a sub-aperture of the total array camera. The complete array camera has a synthetic aperture generated based on the sum of all individual aperture rays.

First claim

1 - 30 . (canceled)

31 . A system for capturing an image of a target scene, the system comprising:
an array of a plurality of cameras positioned to capture image data representing a plurality of portions of the target scene, the array having a virtual center of projection; each of the plurality of cameras positioned to capture a portion of the image data representing a different one of the plurality of portions of the target scene, and each of the plurality of cameras comprising
an image sensor,
a lens assembly comprising at least one lens, the lens assembly having a center of projection, and
a first reflective surface positioned to reflect incoming light representing one of the plurality of portions of the target scene toward the lens assembly, the first reflective surface provided in a plane positioned
at a midpoint along a line connecting the center of projection of the lens assembly and the virtual center of projection, and
at an angle orthogonal to the line;

a surface positioned between the array and the target scene, the surface including an aperture positioned to allow light representing the target scene to pass to the first reflective surface of each of the plurality of cameras; a processor; and a memory storing instructions that configure the processor to generate the image of the target scene based at least partly on the image data comprising each of the plurality of portions of the target scene; wherein the image sensor of each of the plurality of cameras is positioned within a common plane.

32 . The system of claim 31 , each of the plurality of cameras further comprising a second reflective surface positioned to reflect light received from the lens assembly onto the image sensor, wherein the lens assembly is positioned between the first and second reflective surfaces.

33 . The system of claim 31 , further comprising a substrate having the image sensor of each of the plurality of cameras mounted to the substrate.

34 . The system of claim 33 , wherein the surface comprises the substrate, each of the plurality of cameras comprising a refractive prism comprising the first reflective surface and an input surface, the input surface of the refractive prism positioned in the aperture.

35 . The system of claim 33 , further comprising a central reflective element mounted to the substrate in the path of light representing the target scene passing through the aperture of the surface, the central reflective element having a plurality of facets configured to split the light representing the target scene into the plurality of portions, the first reflective surface of each of the plurality of cameras forming one of the plurality of facets.

36 . The system of claim 35 , wherein the central reflective element comprises an apex formed by an intersection of each of the first reflective surfaces, and wherein an optical axis of each of the plurality of cameras passes through the apex.

37 . The system of claim 36 , wherein the array has a virtual optical axis, and wherein the apex and the virtual center of projection are located on the virtual optical axis.

38 . The system of claim 31 , further comprising a camera housing comprising:
the surface having the aperture as an upper surface thereof; and a lower surface positioned substantially parallel to the upper surface.

39 . The system of claim 38 , wherein each of the plurality of cameras is positioned between the upper surface and the lower surface.

40 . The system of claim 31 , wherein the instructions stored in the memory further configure the processor to perform a projective transform on the image data based at least partly on a geometric relationship between the virtual center of projection and the center of projection of the lens assembly of each of the plurality of cameras and the location of the mirror for each of the plurality of cameras within a corresponding mirror plane.

41 . An apparatus for capturing an image of a target scene, the apparatus comprising:
an array of a plurality of cameras having a virtual center of projection, the array positioned to capture image data representing a plurality of portions of the target scene; each of the plurality of cameras positioned to capture a portion of the image data representing a different one of the plurality of portions of the target scene, each of the plurality of cameras comprising
image sensing means for generating the image data in response to received light,
means for focusing light, the means for focusing having a center of projection, and
first light folding means positioned to redirect incoming light representing one of the plurality of portions of the target scene toward the means for focusing, the first light folding means provided in a plane positioned
at a midpoint along a line connecting the center of projection of the means for focusing and the virtual center of projection, and
at an angle orthogonal to the line;

housing means positioned between the array and the target scene, the housing means including an aperture positioned to allow light representing the target scene to be received by the first light folding means of each of the plurality of cameras; and means for mounting the image sensing means of each of the plurality of cameras within a common plane.

42 . The apparatus of claim 41 , each of the plurality of cameras further comprising second light folding means positioned to redirect light received from the means for focusing onto the image sensing means, wherein the lens assembly is positioned between the first and second reflective surfaces.

43 . The apparatus of claim 42 , further comprising means for moving at least one of the first and second light folding means to change a focal length between the means for focusing and the image sensing means.

44 . The apparatus of claim 41 , further comprising means for combining the image data representing the plurality of portions of the target scene into the image.

45 . The apparatus of claim 41 , further comprising means for moving the means for focusing to change a focal length between the means for focusing and the image sensing means.

46 . The apparatus of claim 41 , further comprising means for adjusting the focus of each of the plurality of cameras together, the means for adjusting positioned between the first light folding means of each of the plurality of cameras and the target scene.

47 . A method of capturing an image of a target scene such that the image is substantially free of parallax and tilt artifacts, comprising:
receiving light representing the target scene through an aperture to a plurality of mirrors; splitting the light representing the target scene into a plurality of portions using the plurality of mirrors; capturing image data representing the plurality of portions of the target scene by a corresponding plurality of cameras, each of the plurality of cameras positioned to capture a portion of the image data representing a different one of the plurality of portions from a location of a virtual camera having a virtual center of projection, each of the plurality of cameras comprising
a mirror of the plurality of mirrors,
a lens assembly comprising at least one lens, the lens assembly positioned to receive light representing one of the plurality of portions from the mirror,
a center of projection of the lens assembly, and
a sensor positioned to receive the light from the lens assembly,
wherein the mirror is provided in a plane positioned
at a midpoint along a line connecting the center of projection of the lens assembly and

Assignees

• Qualcomm Inc

Inventors

• Georgiev Todor Georgiev
• Osborne Thomas Wesley
• Goma Sergiu Radu

Classifications

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• H04N23/51

  Housings · CPC title

• H04N23/60

  Control of cameras or camera modules · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title