Image sensor, image-capturing apparatus and image-capturing system

Patent metadata

Field	Value
Publication number	US-10412358-B2
Application number	US-201815872343-A
Country	US
Kind code	B2
Filing date	Jan 16, 2018
Priority date	Mar 16, 2012
Publication date	Sep 10, 2019
Grant date	Sep 10, 2019

Abstract

To produce both 2D image data and color parallax image data from image data output from a single-plate image sensor, the resolutions of the 2D image data and parallax image data may be both degraded. The image sensor has a primitive lattice that is a group of pixels including (i) at least four types of parallax pixels formed by photoelectric converter elements each of which is associated with one of combinations of two different types of aperture masks and two different types of color filters and (ii) no-parallax pixels configured to guide an incident luminous flux to photoelectric converter elements without limitation. In the group of pixels, the no-parallax pixels are more than the parallax pixels.

First claim

What is claimed is:

1. An image sensor comprising:
parallax pixels having photoelectric converter elements each of which is associated with one of a plurality of types of aperture masks that respectively have openings positioned to transmit different partial luminous fluxes of an incident luminous flux from each other; and
no-parallax pixels configured to guide the incident luminous flux to photoelectric converter elements without limitation of openings, wherein
the parallax pixels are arranged at equal intervals in both of two dimensional directions in such a manner that a parallax pixel associated with an aperture mask of one of the types is sandwiched between a no-parallax pixel and a parallax pixel associated with an aperture mask of a different one of the types, and parallax pixels associated with aperture masks of different ones of the types are arranged as distant as possible.

2. The image sensor as set forth in claim 1 , wherein
each of the parallax and no-parallax pixels is associated with one of a plurality of types of color filters that transmit different wavelength ranges, and
parallax pixels associated with each of the plurality of types of color filters are arranged at equal intervals in both of the two dimensional directions, and, among parallax pixels associated with each of the plurality of types of color filters, parallax pixels associated with different ones of the plurality of types of aperture masks are arranged as distant as possible.

3. The image sensor as set forth in claim 1 , wherein
parallax pixels associated with each of the plurality of types of aperture masks are arranged so as not to overlap each other in both of a row direction and a column direction of the two dimensional directions.

4. An image-capturing apparatus comprising:
the image sensor as set forth in claim 1 ; and
an image processor configured to produce a plurality of pieces of parallax image data having parallax therebetween and 2D image data without parallax based on the outputs from the image sensor.

5. An image sensor comprising a pixel arrangement in which:
pixels constituted by photoelectric converter elements that photoelectrically convert incident light into electric signals are periodically arranged on a x-y plane;
at least three types of aperture masks are provided in a one-to-one correspondence with the pixels and are respectively associated with a reference direction, a first parallax direction different from the reference direction and a second parallax direction different from the reference direction; and
pixels provided with the aperture masks associated with the first parallax direction are isotropically arranged at equal intervals in two directions of an x direction and a y direction, each pixel provided with one of the aperture masks associated with the first parallax direction being sandwiched between one of the pixels provided with one of the aperture masks associated with the reference direction and one of the pixels provided with one of the aperture masks associated with the second parallax direction, and pixels provided with the aperture masks associated with the second parallax direction are isotropically arranged at equal intervals in the two directions of the x direction and the y direction, each pixel provided with one of the aperture masks associated with the first parallax direction being sandwiched between one of the pixels provided with one of the aperture masks associated with the reference direction and one of the pixels provided with one of the aperture masks associated with the first parallax direction.

6. The image sensor as set forth in claim 5 , wherein
when the pixels are provided with and in a one-to-one correspondence with color filters for two or more types of color components and at least pixels provided with color filters for one of the types of color components include one or more pixels having one or more aperture masks associated with the reference direction, one or more pixels having one or more aperture masks associated with the first parallax direction and one or more pixels having one or more aperture masks associated with the second parallax direction,
in the pixels provided with the color filters for the one of the types of color components, the pixels having the aperture masks associated with the first parallax direction are isotropically arranged at equal intervals in the two directions of the x direction and the y direction, and the pixels having the aperture masks associated with the second parallax direction are isotropically arranged at equal intervals in the two directions of the x direction and the y direction.

7. The image sensor as set forth in claim 6 , wherein
each of (i) the pixels having the aperture masks associated with the reference direction, (ii) the pixels having the aperture masks associated with the first parallax direction and (iii) the pixels having the aperture masks associated with the second parallax direction are provided for each of the two or more types of color components.

8. The image sensor as set forth in claim 5 , wherein
in the pixels periodically arranged forming a primitive lattice, the pixels having the aperture masks associated with the first parallax direction are positioned in different rows and in different columns from each other.

9. The image sensor as set forth in claim 5 , wherein
when pixel values of all of the pixels of the pixel arrangement are read and when pixel values of the pixels in the pixel arrangement are read in such a manner that pixel values of a plurality of pixels are added together in the x direction and a plurality of pixels in the y direction are discarded, a density ratio between the pixels having the aperture masks associated with the reference direction, the pixels having the aperture masks associated with the first parallax direction, and the pixels having the aperture masks associated with the second parallax direction remains the same.

10. The image sensor as set forth in claim 9 , wherein
the density ratio between the pixels having the aperture masks associated with the reference direction, the pixels having the aperture masks associated with the first parallax direction, and the pixels having the aperture masks associated with the second parallax direction is 6:1:1.

Assignees

• Nikon Corp

Inventors

• Ishiga Kenichi
• Shibazaki Kiyoshige
• Hamashima Muneki
• Mori Susumu

Classifications

• H04N13/00 Primary

  Stereoscopic video systems; Multi-view video systems; Details thereof · CPC title

• H04N13/257

  Colour aspects · CPC title

• H04N13/218 Primary

  using spatial multiplexing · CPC title

• H04N13/207

  using a single two-dimensional [2D] image sensor · CPC title