RGB-RWB dual images by multi-layer sensors towards better image quality

Patent metadata

Field	Value
Publication number	US-9712792-B2
Application number	US-201514924704-A
Country	US
Kind code	B2
Filing date	Oct 27, 2015
Priority date	Aug 10, 2015
Publication date	Jul 18, 2017
Grant date	Jul 18, 2017

Abstract

Using improved Image Signal Processing (ISP) along with a multi-layer Color Filter Array (CFA) architecture to capture both the Red-Green-Blue (RGB) as well as the Red-X-Blue (RXB) images substantially simultaneously on the same Complementary Metal Oxide Semiconductor (CMOS) image sensor chip in a single shot so that subsequent image processing stage(s) can choose between RGB and RXB images to improve the quality of the final image. The color “X” in the RXB image may be a white color, a yellow color, or a cyan color. In contrast to the individual RWB or RGB imaging based conventional CMOS sensors, the disclosed CMOS sensor with one or more layers of specifically-selected CFAs can capture both the RGB and RXB images in a single shot using associated ISP. The multi-layer sensor may be an organic sensor or a stacked X3 sensor. The dual RGB-RXB imaging may reduce colorblindness, chromatic aberration, and saturation artifacts.

First claim

What is claimed is:

1. A method comprising:
providing a multi-layer image sensor having a plurality of pixels arranged in a pixel array and further having at least one layer of Color Filer Array (CFA) overlaid on the pixel array such that at least one location-specific color filter is associated with each pixel location in the pixel array;
collecting one or more color signals from each pixel location in the pixel array during a single imaging operation, wherein each color signal associated with a given pixel location represents a different color of light;
for each pixel location, selectively combining only those color signals which are collected from the pixel location so as to obtain a pixel location-specific color content that is independent of color signals collected from neighboring pixel locations in the pixel array; and
using each pixel location-specific color content to construct the following two color patterns, each color pattern having colors arranged in one-to-one correspondence with each pixel location in the pixel array:
a Red-Green-Blue (RGB) color pattern, and
an RXB color pattern, wherein “X” represents one of the following colors: white, yellow, or cyan.

2. The method of claim 1 , wherein the multi-layer image sensor is one of the following:
a Complementary Metal Oxide Semiconductor (CMOS) organic sensor; and
a stacked X3 CMOS sensor.

3. The method of claim 1 , wherein the at least one layer of CFA includes the following:
a wavelength-selective semi-transparent organic photo-conversion layer; and
a non-organic CFA layer.

4. The method of claim 3 , wherein the wavelength-selective semi-transparent organic photo-conversion layer is sensitive to green color only.

5. The method of claim 4 , wherein the non-organic CFA layer is one of the following:
a Red-Magenta-Blue (RMB) CFA layer; and
an RB CFA layer.

6. The method of claim 3 , wherein the wavelength-selective semi-transparent organic photo-conversion layer is a green light-sensitive Organic Photodiode (OPD).

7. The method of claim 3 , wherein the non-organic CFA layer is an RGB CFA layer, and wherein the wavelength-selective organic layer is composed of a plurality of color filters such that at least some color filters in the plurality of color filters are complementary to corresponding color filters in the RGB CFA layer at respective pixel locations in the pixel array.

8. The method of claim 3 , wherein providing the multi-layer image sensor includes:
selecting the organic photo-conversion layer sensitive to a first color; and
further selecting the non-organic CFA layer having color filters in a plurality of second colors, wherein at least one color in the plurality of second colors is selected such that a color signal having the selected second color, when combined with a color signal having the first color, produces the color “X” in the RXB color pattern.

9. The method of claim 1 , wherein at least one of the following applies:
color filters in at least one CFA layer are arranged in a Bayer pattern;
colors in the RGB color pattern are arranged in the Bayer pattern; and
colors in the RXB color pattern are arranged in the Bayer pattern.

10. The method of claim 1 , wherein selectively combining the color signals includes:
selectively combining the color signals using software.

11. The method of claim 1 , wherein selectively combining the color signals includes one of the following:
combining the color signals from less than all pixel locations in the pixel array to construct the RGB and the RXB color patterns; and
combining the color signals only as needed to construct the RGB and RXB color patterns.

12. The method of claim 1 , further comprising:
performing the following as part of generating an image for a user as a result of the single imaging operation:
performing chromatic denoising using color content from the RXB color pattern only, and
performing color correction using a Color Correction Matrix (CCM) associated with the RGB color pattern only.

13. The method of claim 12 , further comprising:
performing at least one of the following:
using color content from only the RGB color pattern to generate a first region in the image where red-green edges are present;
using color content from only the RXB color pattern to generate a second region in the image where green-grey edges are present;
using color content from only the RXB color pattern to generate image content closer to a center of the image; and
using color content from only the RGB color pattern to generate image content away from the center of the image.

14. A method comprising:
providing a multi-layer image sensor having a plurality of pixels arranged in a pixel array and further having at least one layer of Color Filer Array (CFA) overlaid on the pixel array such that at least one location-specific color filter is associated with each pixel location in the pixel array, wherein the at least one layer of CFA includes the following:
a wavelength-selective semi-transparent organic photo-conversion layer, and
a non-organic CFA layer;

collecting one or more color signals from each pixel location in the pixel array during a single imaging operation, wherein each color signal associated with a given pixel location represents a different color of light; and
selectively combining color signals from each pixel location to construct the following color patterns, each color pattern having colors arranged in one-to-one correspondence with each pixel location in the pixel array:
a Red-Green-Blue (RGB) color pattern, and
an RXB color pattern, wherein “X” represents one of the following colors: white, yellow, or cyan,

wherein the organic photo-conversion layer is sensitive to a first color and the non-organic CFA layer has color filters in a plurality of second colors, and wherein at least one color in the plurality of second colors is selected such that a color signal having the selected second color, when combined with a color signal having the first color, produces the color “X” in the RXB color pattern.

15. The method of claim 14 , wherein the multi-layer image sensor is one of the following:
a Complementary Metal Oxide Semiconductor (CMOS) organic sensor; and
a stacked X3 CMOS sensor.

16. The method of claim 14 , wherein the wavelength-selective semi-transparent organic photo-conversion layer is sensitive to green color only.

17. The method of claim 14 , wherein the non-organic CFA layer is an RGB CFA layer, and wherein the wavelength-selective organic layer is composed of a plurality of color filters such that at least some color filters in the plurality of color filters are complementary to corresponding color filters in the RGB CFA layer at respective pixel locations in the pixel array.

18. The method of claim 14 , further comprising:
performing at least one of the following as part of generating an image for a user as a result of the single imaging operation:
using color content from only the RGB color pattern to generate a first region in the image where red-green edges are present;
using color content from only the RXB color pattern to generate a second region in the image where green-grey edges are present;
using color content from only the RXB color pattern to generate image content closer to a center of the image; and
using color content from only the RGB color pattern to generate image content away from the center of the image.

19. A method comprising:
providing a multi-layer image sensor having a plurality of pixels arranged in a pix

Assignees

• Shi Lilong
• Ovsiannikov Ilia
• Samsung Electronics Co Ltd

Inventors

• Shi Lilong
• Ovsiannikov Ilia

Classifications

• H04N25/57

  Control of the dynamic range · CPC title

• H04N25/60

  Noise processing, e.g. detecting, correcting, reducing or removing noise · CPC title

• H04N23/10

  for generating image signals from different wavelengths · CPC title

• H04N25/79 Primary

  Arrangements of circuitry being divided between different or multiple substrates, chips or circuit boards, e.g. stacked image sensors · CPC title

• H04N25/76 Primary

  Addressed sensors, e.g. MOS or CMOS sensors · CPC title