Crosstalk processing module, method of processing crosstalk and image processing system

Patent metadata

Field	Value
Publication number	US-10225495-B2
Application number	US-201715823880-A
Country	US
Kind code	B2
Filing date	Nov 28, 2017
Priority date	Apr 24, 2017
Publication date	Mar 5, 2019
Grant date	Mar 5, 2019

Abstract

A crosstalk processing module configured to process a crosstalk of an image signal includes a correction element generation unit, a storage, and a crosstalk correction check unit. The correction element generation unit receives the image signal and input information associated with at least a size of the image signal and generates seed values and correction parameters which are used to correct the crosstalk, based on the input information and a representative channel image signal obtained by separating the image signal with respect to color. The storage stores the seed values and the correction parameters. The crosstalk correction check unit receives the image signal, receives the seed values and the correction parameters from the storage, corrects the crosstalk, and outputs a final image signal and pass/fail information indicating a pass or fail of the correction of the crosstalk based on a plurality of reference values.

First claim

What is claimed is:

1. A crosstalk processing module configured to process a crosstalk of an image signal produced from an image sensor, wherein the image sensor comprises a pixel array including a plurality of sub-pixels arranged along a plurality of rows and a plurality of columns, and k number of sub-pixels representing one color formed in conjunction with each other, and wherein the number k is an integer equal to or greater than four, the crosstalk processing module comprising:
a correction element generation unit configured to receive the image signal and input information, the input information being associated with at least a size of the image signal, and configured to generate seed values and correction parameters which are used to correct the crosstalk;
a storage, connected to the correction element generation unit, configured to store the seed values and the correction parameters;
a crosstalk correction check unit configured to receive the image signal, receive the seed values and the correction parameters from the storage, correct the crosstalk produced from the image sensor, and output a final image signal and pass/fail information indicating a pass or fail of the correction of the crosstalk based on a plurality of reference values; and
a control engine configured to control the correction element generation unit, the storage and the crosstalk correction check unit.

2. The crosstalk processing module of claim 1 , wherein the plurality of sub-pixels includes a first color filter, a second color filter, a third color filter and a fourth color filter, each of the first second, third, and fourth color filter being formed with k number of sub-pixels, and
wherein the correction element generation unit comprises:
an image separation engine configured to separate the image signal into 4*k number of channel image signals with respect to each channel of sub-pixels corresponding to each of the color filters;
a representative channel image generation engine configured to calculate a representative value of pixel values of each of the 4*k number of channel image signals with respect to each of the color filters to generate k representative channel image signals;
a correction parameter calculation engine configured to calculate the correction parameters based on the 4*k channel image signals and the k representative channel image signals; and
a seed value calculation engine configured to generate the seed values based on the k representative channel image signals and the input information.

3. The crosstalk processing module of claim 2 , wherein:
the image signal has a first size defined by p sub-pixels along a first direction and q sub-pixels along a second direction perpendicular to the first direction, where p and q are multiples of four and are greater than four; and
each of the channel image signals and each of the representative channel image signals have a second size defined by p/k sub-pixels along the first direction and q/k sub-pixels along the second direction.

4. The crosstalk processing module of claim 2 , wherein the correction parameter calculation engine comprises:
a first correction parameter calculator configured to calculate a ratio of a sum of pixel values of each of the k representative channel image signals to a sum of pixel values of each of the 4*k channel image signals with respect to each channel to calculate 4*k first correction parameters, based on the k representative channel image signals and the 4*k number of channel image signals; and
a second correction parameter calculator to calculate 4*k pairs of second correction parameters, each pair including a first shift along a first direction and a second shift along a second direction based on the k representative channel image signals and the 4*k channel image signals, wherein the second direction is perpendicular to the first direction, wherein the first shift is associated with a shift between each of the k representative channel image signals and each of k image signals of a same color channel in the first direction, wherein the second shift is associated with a shift between each of the k representative channel image signals and each of the k image signals of the same color channel in the second direction, and wherein the k image signals of the same color channel is associated with image signals corresponding to the same color filter.

5. The crosstalk processing module of claim 4 , wherein the second correction parameter calculator is configured to calculate the 4*k pairs of the second correction parameters based on absolute value of a first number of pixel values in the second direction and absolute value of a second number of pixel values in the first direction, of each of the k representative channel image signals and of each of the k image signals of the same color channel.

6. The crosstalk processing module of claim 2 , wherein in the seed value calculation engine comprises:
a grid image generator configured to sample r*r sub-pixels as one intersecting point of each of the k representative channel image signals to generate k grid image signals, based on the input information, where r is an integer equal to or greater than two;
a seed value generator configured to perform a filtering on internal intersecting points of each of the k grid image signals to generate intermediate seed values for each of the k representative channel image signals, wherein the internal intersecting points of each of the k grid image signals correspond to intersecting points except boundary intersecting points located in an outskirt region in each of the k grid image signals; and
a packer configured to store bits of the intermediate seed values to provide the seed values by compressing the bits.

7. The crosstalk processing module of claim 6 , wherein the seed value generator is configured to generate a corresponding intermediate seed value based on pixel values of adjacent two intersecting points for each corner intersecting point of the boundary intersecting points.

8. The crosstalk processing module of claim 7 , wherein the seed value generator is configured to generate a corresponding intermediate seed value for each rest intersecting points except the corner intersecting points of the boundary intersecting points based on a pixel value of the representative channel image signal, corresponding to each of the rest intersecting points and a pixel value of an intersecting point adjacent to each of the rest intersecting points in a first direction.

9. The crosstalk processing module of claim 6 , wherein the seed value generator is configured to perform median filtering on each of the intersecting points to generate the intermediate seed values.

10. The crosstalk processing module of claim 1 , wherein the correction parameters comprise first correction parameters and second correction parameters, wherein the plurality of sub-pixels includes a first color filter, a second color filter, a third color filter and a fourth color filter with respect to the k number of sub-pixels, and
wherein the crosstalk correction check unit comprises:
a gain map generation engine configured to generate 4*k gain maps based on the seed values, the first correction parameters and the second correction parameters;
an image separation engine configured to separate the image signal according to a channel of sub-pixels corresponding to each of the color filters to generate 4*k channel image signals;
a result image generation engine configured to multiply sub-pixels of each of the 4*k channel image signals by a gain of each sub-pixel of a corresponding gain main of the 4*k gain maps to generate 4*k result channel image signals;
an image merging engine configured to merge th

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Da-Hee
• Kim Dae-Kwan
• Noh Yo-Hwan
• Kim Kyung-Ho
• Kim Chae-Sung
• Min Dong-Ki
• Jo Seong-Won
• Choi Yun-Seok

Classifications

• G09G5/363 Primary

  Graphics controllers · CPC title

• G09G2320/0209

  Crosstalk reduction, i.e. to reduce direct or indirect influences of signals directed to a certain pixel of the displayed image on other pixels of said image, inclusive of influences affecting pixels in different frames or fields or sub-images which constitute a same image, e.g. left and right images of a stereoscopic display · CPC title

• G09G2360/18

  Use of a frame buffer in a display terminal, inclusive of the display panel · CPC title

• G09G5/04

  using circuits for interfacing with colour displays · CPC title

• G09G2360/16

  Calculation or use of calculated indices related to luminance levels in display data · CPC title