Image sensor, image processing system including the same, and operation method thereof

Patent metadata

Field	Value
Publication number	US-12520054-B2
Application number	US-202318535525-A
Country	US
Kind code	B2
Filing date	Dec 11, 2023
Priority date	Dec 28, 2022
Publication date	Jan 6, 2026
Grant date	Jan 6, 2026

Abstract

An image sensor, including a pixel array; a readout circuit configured to generate image data including first image data including phase information regarding a first phase, second image data including phase information regarding a second phase, and full image data including color information; and a signal processing unit including: a front end processing module configured to generate third image data including additional phase information regarding the first phase using the second image data and the full image data, and to generate fourth image data including additional phase information regarding the second phase using the first image data and the full image data; and an auto-focusing processing module configured to calculate a phase difference between the first phase and the second phase using the first image data, the second image data, the third image data, and the fourth image data.

First claim

What is claimed is:

1 . An image sensor comprising:
a pixel array comprising a plurality of pixel groups, wherein each pixel group of the plurality of pixel groups comprises a plurality of pixels; a readout circuit configured to generate image data by reading pixel signals output from the pixel array, wherein the image data comprises first image data comprising phase information regarding a first phase, second image data comprising phase information regarding a second phase, and full image data comprising color information; and a signal processing unit configured to process the image data, and comprising:
a front end processing module configured to generate third image data comprising additional phase information regarding the first phase using the second image data and the full image data, and to generate fourth image data comprising additional phase information regarding the second phase using the first image data and the full image data; and
an auto-focusing processing module configured to calculate a phase difference between the first phase and the second phase in a first direction using the first image data, the second image data, the third image data, and the fourth image data.

2 . The image sensor of claim 1 , wherein the each pixel group comprises pixels arranged in two rows and two columns, and a microlens, and
wherein a color filter is disposed on four adjacent pixel groups from among the plurality of pixel groups.

3 . The image sensor of claim 2 , wherein a first color filter is disposed on a first pixel group, a second pixel group, a third pixel group, and a fourth pixel group which are adjacently arranged in a first row group from among the plurality of pixel groups,
wherein a second color filter is disposed on a fifth pixel group, a sixth pixel group, a seventh pixel group, and an eighth pixel group which are adjacently arranged in a second row group from among the plurality of pixel groups, and wherein the first image data is generated based on the first to fourth pixel groups, and the second image data is generated based on the fifth to eighth pixel groups.

4 . The image sensor of claim 1 , wherein the front end processing module is further configured to generate the third image data by multiplying a data value of the second image data by a gain, and subtracting a result of the multiplying from a data value of the full image data.

5 . The image sensor of claim 1 , wherein the auto-focusing processing module comprises:
a binning module configured to generate first binning data, second binning data, third binning data, and fourth binning data by binning the first to fourth image data; a first merge module configured to generate first merge data by merging the first binning data with the third binning data; a second merge module configured to generate second merge data by merging the second binning data with the fourth binning data; and a phase difference calculation module configured to calculate the phase difference between the first phase and the second phase in the first direction using the first merge data and the second merge data.

6 . The image sensor of claim 5 , wherein the first merge module is further configured to generate the first merge data by adding a data value corresponding to a first pixel at a position in the first binning data, to values obtained by applying a weight value to data values corresponding to pixels arranged in a direction perpendicular to the first direction, based on a second pixel at the position in the second binning data.

7 . The image sensor of claim 1 , wherein the auto-focusing processing module comprises:
a binning module configured to generate first binning data, second binning data, third binning data, and fourth binning data by binning the first to fourth image data; a first phase difference calculation module configured to generate first phase difference data including phase difference information using the first binning data and the second binning data; a second phase difference calculation module configured to generate second phase difference data including the phase difference information using the third binning data and the fourth binning data; and a merge module configured to generate third phase difference data including the phase difference information using the first phase difference data and the second phase difference data.

8 . The image sensor of claim 7 , wherein the merge module is further configured to generate the third phase difference data by averaging a data value of the first phase difference data and a data value of the second phase difference data.

9 . An image processing system comprising:
an image sensor configured to generate image output data; and at least one processor configured to: perform image signal processing on the image output data, wherein the image sensor comprises:
a pixel array comprising a plurality of pixel groups, wherein each pixel group of the plurality of pixel groups comprises a plurality of pixels;
a readout circuit configured to generate image data by reading pixel signals output from the pixel array, wherein the image data comprises first image data comprising phase information regarding a first phase, second image data comprising phase information regarding a second phase, and full image data comprising color information; and
a signal processing unit configured to process the image data, and comprising a front end processing module configured to generate third image data comprising additional phase information regarding the first phase using the second image data and the full image data, and to generate fourth image data comprising additional phase information regarding the second phase using the first image data and the full image data.

10 . The image processing system of claim 9 , wherein the signal processing unit further comprises:
a binning module configured to generate first binning data, second binning data, third binning data, and fourth binning data by binning the first to fourth image data; a first merge module configured to generate first merge data by merging the first binning data with the third binning data; a second merge module configured to generate second merge data by merging the second binning data with the fourth binning data; and a phase difference calculation module configured to calculate a phase difference between the first phase and the second phase using the first merge data and the second merge data.

11 . The image processing system of claim 9 , wherein the signal processing unit further comprises:
a binning module configured to generate first binning data, second binning data, third binning data, and fourth binning data by binning the first to fourth image data; a first merge module configured to generate first merge data by merging the first binning data with the third binning data; and a second merge module configured to generate second merge data by merging the second binning data with the fourth binning data, wherein the at least one processor comprises a phase difference calculation module configured to calculate a phase difference between the first phase and the second phase using the first merge data and the second merge data.

12 . The image processing system of claim 9 , wherein the signal processing unit further comprises:
a binning module configured to generate first binning data, second binning data, third binning data, and fourth binning data by binning the first to fourth image data; a first phase difference calculation module configured to generate first phase difference data comprising phase difference information corresponding to a phase difference between the fir

Assignees

• Samsung Electronics Co Ltd

Inventors

• Yim Sunghyuk
• Song Seongwook
• Lee Jeehong
• Park Dongjin
• Choi Wooseok

Classifications

• H10F39/8063

  Microlenses · CPC title

• H04N25/79

  Arrangements of circuitry being divided between different or multiple substrates, chips or circuit boards, e.g. stacked image sensors · CPC title

• H04N25/134 Primary

  based on three different wavelength filter elements · CPC title

• H04N23/672

  based on the phase difference signals · CPC title

• H04N25/78

  Readout circuits for addressed sensors, e.g. output amplifiers or A/D converters · CPC title