Image sensor, image-capturing apparatus and image capturing system

Patent metadata

Field	Value
Publication number	US-9906770-B2
Application number	US-201414487554-A
Country	US
Kind code	B2
Filing date	Sep 16, 2014
Priority date	Mar 16, 2012
Publication date	Feb 27, 2018
Grant date	Feb 27, 2018

Abstract

To produce both 2D image data and color parallax image data from image data output from a single-plate image sensor, the resolutions of the 2D image data and parallax image data may be both degraded. The image sensor has a primitive lattice that is a group of pixels including (i) at least four types of parallax pixels formed by photoelectric converter elements each of which is associated with one of combinations of two different types of aperture masks and two different types of color filters and (ii) no-parallax pixels configured to guide an incident luminous flux to photoelectric converter elements without limitation. In the group of pixels, the no-parallax pixels are more than the parallax pixels.

First claim

What is claimed is:

1. An image sensor having a primitive lattice formed by a group of pixels comprising:
at least four types of parallax pixels, configured to guide an incident luminous flux to photoelectric converter elements with limitation by openings, and having photoelectric converter elements each of which is associated with (i) one of a first aperture mask and a second aperture mask that respectively have openings positioned to transmit different partial luminous fluxes of the incident luminous flux from each other and (ii) one of a first color filter and a second color filter that respectively transmit different wavelength ranges from each other; and
no-parallax pixels configured to guide the incident luminous flux to photoelectric converter elements without limitation by openings, wherein,
in the group of pixels, the no-parallax pixels are more than the parallax pixels,
each of the no-parallax pixels is also associated with one of a group of color filters including the first color filter and the second color filter, and
in the group of pixels, the no-parallax pixels associated with the first color filters are more than the parallax pixels associated with the first color filters and the no-parallax pixels associated with the second color filters are more than the parallax pixels associated with the second color filters.

2. The image sensor as set forth in claim 1 , wherein
the group of pixels includes at least six types of parallax pixels including the four types of parallax pixels and two additional types of parallax pixels, and
the two additional types of parallax pixels have photoelectric converter elements and are each associated with (i) one of the first aperture mask and the second aperture mask and (ii) a third color filter that transmits a wavelength range different from the wavelength ranges transmitted by the first color filter and the second color filter.

3. The image sensor as set forth in claim 2 , wherein
in the group of pixels, when the first color filter, the second color filter and the third color filter are respectively an R filter, a G filter and a B filter, the parallax pixels and the no-parallax pixels associated with the G filters are respectively more than the parallax pixels and the no-parallax pixels associated with the R filters and respectively more than the parallax pixels and the no-parallax pixels associated with the B filters.

4. An image sensor having a primitive lattice formed by a group of pixels comprising:
at least four types of parallax pixels having photoelectric converter elements each of which is associated with (i) one of a first aperture mask and a second aperture mask that respectively have openings positioned to transmit different partial luminous fluxes of an incident luminous flux from each other and (ii) one of a first color filter and a second color filter that respectively transmit different wavelength ranges from each other; and
no-parallax pixels configured to guide the incident luminous flux to photoelectric converter elements without limitation by openings, wherein,
in the group of pixels, the no-parallax pixels are more than the parallax pixels,
the group of pixels includes at least six types of parallax pixels including the four types of parallax pixels and two additional types of parallax pixels,
the two additional types of parallax pixels have photoelectric converter elements and are each associated with (i) one of the first aperture mask and the second aperture mask and (ii) a third color filter that transmits a wavelength range different from the wavelength ranges transmitted by the first color filter and the second color filter, and
in the group of pixels, (i) a distribution ratio between the first color filters, the second color filters and the third color filters of the parallax pixels having the first aperture mask, (ii) a distribution ratio between the first color filters, the second color filters and the third color filters of the parallax pixels having the second aperture masks, and (iii) a distribution ratio between the first color filters, the second color filters and the third color filters of the no-parallax pixels are the same.

5. An image-capturing apparatus comprising:
the image sensor as set forth in claim 1 ; and
an image processor configured to produce a plurality of pieces of parallax image data having parallax therebetween and 2D image data without parallax based on the outputs from the image sensor.

6. An image sensor comprising a pixel arrangement in which:
pixels constituted by photoelectric converter elements that photoelectrically convert incident light into electric signals are periodically arranged on a x-y plane;
at least three types of aperture masks are provided in a one-to-one correspondence with the pixels and are respectively associated with a reference direction, a first parallax direction different from the reference direction and a second parallax direction different from the reference direction; and
a density of pixels having the aperture masks associated with the first parallax direction and a density of pixels having the aperture masks associated with the second parallax direction are lower than a density of pixels having the aperture masks associated with the reference direction, wherein
when all of the pixels of the image sensor are monochrome pixels having the same spectral sensitivity characteristics, a density of the pixels having the aperture masks associated with the first parallax direction and a density of the pixels having the aperture masks associated with the second parallax direction are each equal to or lower than ⅛ of a density of the pixels having the aperture masks associated with the reference direction.

7. The image sensor as set forth in claim 6 , wherein
when the pixels are provided with and in a one-to-one correspondence with color filters for two or more types of color components and at least pixels provided with color filters for one of the color components include one or more pixels having an aperture mask associated with the reference direction, one or more pixels having an aperture mask associated with the first parallax direction and one or more pixels having an aperture mask associated with the second parallax direction,
in the pixels provided with the color filters for the one color component, a density of the pixels having the aperture masks associated with the first parallax direction and a density of the pixels having the aperture masks associated with the second parallax direction are lower than a density of the pixels having the aperture masks associated with the reference direction.

8. The image sensor as set forth in claim 7 , wherein
the density of the pixels having the aperture masks associated with the first parallax direction and the density of the pixels having the aperture masks associated with the second parallax direction are equal to or lower than half the density of the pixels having the aperture masks associated with the reference direction.

9. The image sensor as set forth in claim 7 , wherein
(i) the pixels having the aperture masks associated with the reference direction, (ii) the pixels having the aperture masks associated with the first parallax direction and (iii) the pixels having the aperture masks associated with the second parallax direction are provided for each of the two or more types of color components.

10. The image sensor as set forth in claim 9 , wherein
when the two or more types of color components are R, G and B color components,
in each of (i) the pixels having the aperture masks associated with the first parallax direction and (ii) the pixels having the aperture masks associated with the second parallax direction, a de

Assignees

• Nikon Corp

Inventors

• Ishiga Kenichi
• Shibazaki Kiyoshige
• Hamashima Muneki
• Mori Susumu

Classifications

• H04N13/218 Primary

  using spatial multiplexing · CPC title

• H04N13/257

  Colour aspects · CPC title

• H04N13/207

  using a single two-dimensional [2D] image sensor · CPC title

• H04N13/00 Primary

  Stereoscopic video systems; Multi-view video systems; Details thereof · CPC title

• H04N13/0217 Primary

  Electricity · mapped topic