Single image sensor for restoring images corresponding to various fields of view

Patent metadata

Field	Value
Publication number	US-12445739-B2
Application number	US-202318121407-A
Country	US
Kind code	B2
Filing date	Mar 14, 2023
Priority date	Oct 21, 2022
Publication date	Oct 14, 2025
Grant date	Oct 14, 2025

Abstract

An image sensor includes a color filter array including a first color filter including a first number of blue pass filtering elements, the first number of red pass filtering elements, and green pass filtering elements in a first pattern, wherein a number of the green pass filtering elements in the first pattern is twice the first number, and a second color filter including a second number of blue pass filtering elements, the second number of red pass filtering elements, and green pass filtering elements in a second pattern, wherein a number of green pass filtering elements in the second pattern is twice the second number, and the second number is greater than the first number. The second color filter may surround an area of the first color filter.

First claim

What is claimed is:

1. An image sensor, comprising:
a color filter array comprising:
a first color filter comprising a first number of blue pass filtering elements, the first number of red pass filtering elements, and green pass filtering elements arranged in a first pattern, wherein a number of green pass filtering elements in the first pattern is twice the first number, and
a second color filter comprising a second number of blue pass filtering elements, the second number of red pass filtering elements, and green pass filtering elements arranged in a second pattern, wherein a number of green pass filtering elements in the second pattern is twice the second number, and
wherein the second number is greater than the first number;
a sensing array comprising first sensing elements arranged in a first sensing region configured to receive light passing through the first color filter, and second sensing elements arranged in a second sensing region configured to receive light passing through the second color filter; and
a processor configured to generate sensing data based on a sensing of the first sensing elements and a sensing of the second sensing elements,
wherein the second color filter surrounds an area of the first color filter,
wherein the processor is further configured to restore a first image corresponding to a first field of view (FOV) based on first sensing data corresponding to the sensing of the first sensing elements, and restore a second image corresponding to a second FOV that extends further than the first FOV, based on the first sensing data and second sensing data corresponding to the sensing of the second sensing elements, and
wherein in restoring the first image, the processor is configured to:
determine pixel values of first pixels constituting the first image from a sensing value obtained by summing intensity values sensed by the first sensing elements grouped based on a first binning size;
generate channel images for each color channel from the pixel values of the first pixels; and
restore the first image using the channel images.

2. The image sensor of claim 1 , wherein the processor is configured to:
group the first sensing elements based on the first binning size determined based on the first pattern of the first color filter; and
group the second sensing elements based on a second binning size determined based on the second pattern of the second color filter.

3. The image sensor of claim 2 , wherein the processor is configured to:
generate the first sensing data based on the grouped first sensing elements based on the first binning size; and
generate the second sensing data based on the grouped second sensing elements based on the second binning size.

4. The image sensor of claim 3 , wherein
the first sensing data comprises a sensing value obtained by summing intensity values sensed by the first sensing elements grouped based on the first binning size, and
the second sensing data comprises a sensing value obtained by summing intensity values sensed by the second sensing elements grouped based on the second binning size.

5. The image sensor of claim 1 , wherein
the second image comprises a first partial image corresponding to the first sensing region, and a second partial image corresponding to the second sensing region, and
in restoring the second image, the processor is configured to:
determine pixel values of first pixels based on the grouping of the first sensing elements based on the first binning size, identify second pixels corresponding to sets of plural first pixels which form part of the first partial image, and determine pixel values of the second pixels by performing a color interpolation on the pixel values of the first pixels and performing a digital binning on the first pixels;
determine pixel values of second pixels which form part of the second partial image based on the grouping of the second sensing elements based on the second binning size; and
restore the second image by generating channel images for each color channel from the determined pixel values of the second pixels in the first partial image and the second partial image.

6. The image sensor of claim 5 , wherein in determining pixel values of the second pixels in a region of the first partial image, the processor is configured to:
identify one set of first pixels corresponding to one second pixel forming a part of the first partial image; and
determine an intensity value of a color indicated by the one second pixel by interpolating a first pixel having a pixel value corresponding to an intensity value of a color other than the color indicated by the one second pixel among the identified one set of first pixels with a pixel value of another first pixel outside of the one set of first pixels and proximate to the first pixel, the pixel value of the another first pixel corresponding to the intensity value of the color indicated by the one second pixel.

7. The image sensor of claim 6 , wherein the processor is configured to determine a pixel value of the one second pixel by performing digital binning to sum intensity values of the color indicated by the one second pixel for each of the first pixels corresponding to the one second pixel.

8. The image sensor of claim 7 , wherein the processor is configured to determine the pixel values of the second pixels constituting the first partial image by performing a digital binning on the first pixels based on a binning size corresponding to a value obtained by dividing the second binning size by the first binning size.

9. The image sensor of claim 1 , wherein
the color filter array further comprises a third color filter comprising a third number of blue pass filtering elements, the third number of red pass filtering elements, and green pass filtering elements arranged in a third pattern, wherein a number of green pass filtering elements in the third pattern is twice the third number, and
wherein the third number is greater than the second number,
the sensing array further comprises third sensing elements arranged in a third sensing region configured to receive light passing through the third color filter, and
the third color filter surrounds an area of the second color filter.

10. The image sensor of claim 9 , wherein the processor is configured to:
group the third sensing elements based on a third binning size determined based on the third pattern of the third color filter; and
generate third sensing data based on the grouping of the third sensing elements based on the third binning size.

11. The image sensor of claim 10 , wherein the processor is further configured to restore a third image corresponding to a third FOV, based on first sensing data generated based on a grouping of the first sensing elements based on a first binning size, second sensing data generated based on a grouping of the second sensing elements based on a second binning size, and the third sensing data.

12. The image sensor of claim 11 , wherein in restoring the third image the processor is configured to:
determine pixel values of first pixels based on the grouping of the first sensing elements based on the first binning size, and determine pixel values of third pixels corresponding to a first sensing region of the third image by performing a color interpolation on the pixel values of the first pixels and performing a digital binning on the first pixels;
determine pixel values of second pixels based on the grouping of the second sensing elements based on the second binning size, and determine pixel values of third pixels corresponding to a second sensing region of the third image by performing a color interpolation on the pixel v

Assignees

• Samsung Electronics Co Ltd

Inventors

• Cho Yang Ho
• Lee Kiwoo
• Nam Dong Kyung

Classifications

• H10F39/8063

  Microlenses · CPC title

• H04N25/46

  by combining or binning pixels · CPC title

• H04N25/134 Primary

  based on three different wavelength filter elements · CPC title

• H10F39/8053 Primary

  Colour filters · CPC title

• G06T2207/10024

  Color image · CPC title