Image sensor, imaging device and image processing device

Patent metadata

Field	Value
Publication number	US-9414046-B2
Application number	US-201414204556-A
Country	US
Kind code	B2
Filing date	Mar 11, 2014
Priority date	Sep 14, 2011
Publication date	Aug 9, 2016
Grant date	Aug 9, 2016

Abstract

To obtain image data including a parallax in the vertical direction and image data including a parallax in the horizontal direction, it has been necessary to prepare imaging devices individually at the positions corresponding to the respective viewpoints. Hence, provided is an image processing element including: photoelectric converting elements that are arranged two-dimensionally and convert incident light to electric signals, respectively; and aperture masks provided on the photoelectric converting elements, wherein photoelectric converting element groups each including n photoelectric converting elements are arranged cyclically where n is an integer equal to or larger than 4, and apertures in the aperture masks are positioned lopsidedly to be axisymmetric to each other with respect to each of two orthogonal axes defined on the two-dimensional arrangement of each photoelectric converting element group.

First claim

What is claimed is:

1. An image sensor, comprising:
photoelectric converting elements that are arranged two-dimensionally and photoelectrically convert incident light to electric signals, respectively; and
aperture masks provided on the photoelectric converting elements, wherein
photoelectric converting element groups each including n photoelectric converting elements out of the photoelectric converting elements are arranged cyclically, where n is an integer equal to or larger than 4,
apertures in the aperture masks are positioned lopsidedly to be axisymmetric to each other with respect to each of two orthogonal axes defined on two-dimensional arrangement of each photoelectric converting element group,
the image sensor further comprises:
a selecting circuit that selects from each photoelectric converting element group, mutually pertinent at least two photoelectric converting elements of the photoelectric converting elements; and
an adder that, for each photoelectric converting element group, adds the electric signals from the at least two photoelectric converting elements selected by the selecting circuit, and

the selecting circuit selects at least two of the photoelectric converting elements provided with the aperture masks such that the apertures are axisymmetric with respect to one of the two axes.

2. An image sensor, comprising:
photoelectric converting elements that are arranged two-dimensionally and photoelectrically convert incident light to electric signals, respectively; and
aperture masks provided on the photoelectric converting elements, wherein
photoelectric converting element groups each including n photoelectric converting elements out of the photoelectric converting elements are arranged cyclically, where n is an integer equal to or larger than 4,
apertures in the aperture masks, when imaginarily brought upon one photoelectric converting element with their positions with respect to corresponding ones of the photoelectric converting elements maintained, are positioned lopsidedly to be axisymmetric to each other with respect to each of two orthogonal axes defined on the photoelectric converting element provided imaginarily,
the image sensor further comprises:
a selecting circuit that selects from each photoelectric converting element group, mutually pertinent at least two photoelectric converting elements of the photoelectric converting elements; and
an adder that, for each photoelectric converting element group, adds the electric signals from the at least two photoelectric converting elements selected by the selecting circuit, and

the selecting circuit selects at least two of the photoelectric converting elements for which the apertures in the respective aperture masks of the photoelectric converting elements are arranged lopsidedly in different directions.

3. The image sensor according to claim 1 , wherein
the apertures in the aperture masks are positioned so as to let through fluxes of light from different partial regions provided in a cross-sectional region of the incident light, respectively.

4. An imaging device, comprising:
the image sensor according to claim 1 ;
a posture detecting section that detects a posture of the image sensor;
a control section that, based on the posture detected by the posture detecting section, controls the selecting circuit to select specific ones of the photoelectric converting elements, and controls the adder to add the electric signals from the specific photoelectric converting elements; and
an image processing section that processes image signals output from the adder of the image sensor.

5. An image processing device, comprising:
an output image data acquiring section that acquires output image data that is based on the electric signals output from the image sensor according to claim 1 ;
an aperture information acquiring section that acquires aperture position information regarding positions of the apertures of the image sensor; and
a parallax image data generating section that generates parallax image data by processing the output image data based on the aperture position information.

6. The image processing device according to claim 5 , wherein
the parallax image data generating section generates the parallax image data by, based on the aperture position information, adding pixel values of mutually pertinent at least two pixels among pixels that are included in the output image data and correspond to each photoelectric converting element group.

7. The image processing device according to claim 6 , comprising a depth map generating section that generates a depth map indicating depth information of an object by processing the output image data, wherein
the parallax image data generating section selects the at least two pixels based on the depth map.

8. The image processing device according to claim 6 , wherein
the parallax image data generating section selects the at least two pixels based on a difference between pixel values of adjoining pixels.

9. The image processing device according to claim 6 , comprising a posture information acquiring section that acquires posture information regarding a posture of the image sensor of when the image sensor outputted the electric signals, wherein
the parallax image data generating section selects the at least two pixels based on the posture information.

Assignees

• Nikon Corp

Inventors

• Hamashima Muneki
• Shibazaki Kiyoshige
• Mori Susumu

Classifications

• H04N13/229

  using lenticular lenses, e.g. arrangements of cylindrical lenses · CPC title

• G03B35/10

  having single camera with stereoscopic-base-defining system · CPC title

• H04N13/257

  Colour aspects · CPC title

• H04N13/211 Primary

  using temporal multiplexing · CPC title

• H04N13/282

  for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems · CPC title