System and method for processing video images generated by a multiple viewing elements endoscope

Patent metadata

Field	Value
Publication number	US-10123684-B2
Application number	US-201514967771-A
Country	US
Kind code	B2
Filing date	Dec 14, 2015
Priority date	Dec 18, 2014
Publication date	Nov 13, 2018
Grant date	Nov 13, 2018

Abstract

An endoscope video processing system applies a blooming control feature to image frames of video data signals generated by viewing elements in the endoscope tip. A reduced digital gain is applied to a luminance (Y) component of the video data signal to generate an attenuated signal. An average luminance value of pixels neighboring a pixel of the attenuated signal is calculated and a function of the average luminance value is determined to generate a smoothly transitioning digital gain. The smoothly transitioning digital gain is conditioned using weights to generate a customizable digital gain, and the customizable digital gain is applied to the attenuated signal. This Local Blooming Control (LBC) facilitates a higher luminance digital gain in darker portions while maintaining a low or no luminance digital gain in brighter portions, within the same image frame.

First claim

We claim:

1. An endoscope video processing system, comprising:
a viewing element of an endoscope for generating a video data signal having an image frame, wherein the viewing element includes an image sensor;
a processor in communication with the viewing element;
a memory in communication with at least one of the viewing element and the processor;
a digital signal processor in communication with at least one of the viewing element, the processor, and the memory, for applying a reduced digital gain to a luminance (Y) component of the video data signal generated by the viewing element of the endoscope to generate an attenuated signal, wherein the reduced digital gain is defined by a weight; and
a local blooming control module for:
calculating an average luminance value of luminance levels of a plurality of pixels neighboring a pixel of the attenuated signal;
operating a function on the average luminance value to generate a smoothly transitioning digital gain, wherein the function is a sigmoid function;
conditioning the smoothly transitioning digital gain using said weight to generate a customizable digital gain; and
applying the customizable digital gain to the attenuated signal, for controlling blooming in the image frame of the video data signal generated by the viewing element of the endoscope, to facilitate an increased luminance digital gain in regions of a first brightness within the image frame while maintaining a decreased luminance digital gain in regions of a second brightness, wherein the first brightness is lower than the second brightness.

2. The endoscope video processing system of claim 1 , wherein said weight comprises a first weight and a second weight.

3. The endoscope video processing system of claim 2 , wherein the reduced digital gain meets a condition where a sum of the first weight and the second weight is in the range of 1.0 to 5.0.

4. The endoscope video processing system of claim 2 , wherein the first weight is a constant value while the second weight has a value depending on surrounding luminance.

5. The endoscope video processing system of claim 1 , wherein the average luminance value is calculated using Gaussian weights.

6. The endoscope video processing system of claim 2 , wherein a center point of the sigmoid function approximates 240/(1+second weight), wherein said image sensor comprises a CCD sensor.

7. The endoscope video processing system of claim 2 , wherein a center point of the sigmoid function approximates 255/(1+second weight), wherein said image sensor comprises a CMOS sensor.

8. The endoscope video processing system of claim 2 , wherein a center point of the sigmoid function approximates 100/(1+second weight), wherein said image sensor comprises a CMOS sensor.

9. The endoscope video processing system of claim 2 , wherein a center point of the sigmoid function decreases as the second weight increases and said center point increases as the second weight decreases.

10. The endoscope video processing system of claim 1 , wherein the customizable digital gain meets a plurality of conditions, said plurality of conditions including at least one of:
a value of said digital gain approaches 1.0 as a brightness of a region of the image frame nears maximal value;
said digital gain has an upper limit of 5.0 in a region of the image frame that, relative to all other regions in said image frame, is darkest; or
said digital gain transitions from a region of a first brightness to a region of a second brightness, wherein the first brightness is greater than the second brightness, in a smooth manner.

11. A method comprising:
generating a video data signal and corresponding image frame with a viewing element of an endoscope, wherein the viewing element includes an image sensor, and, implementing the following using a controller of the endoscope:
attenuating a luminance (Y) component of the video data signal of the viewing element to generate an attenuated signal, wherein the attenuation factor meets a condition such that a summation of a first weight K 1 and a second weight K 2 approximates a value equal to or less than 5.0;
applying a Gaussian function to luminance levels of a plurality of pixels neighboring a given pixel of the attenuated signal to generate an average luminance signal Gaussian(Y);
applying a sigmoid function to the average luminance signal to generate a modified signal sigmoid(Gaussian(Y)); and
applying a digital gain to the attenuated signal, wherein the digital gain is determined by applying weights to the modified signal sigmoid (Gaussian(Y)), for controlling blooming in a plurality of regions of the image frame of the video data signal generated by the viewing element of the endoscope.

12. The method of claim 11 , wherein the weights comprises a first weight K 1 and a second weight K 2 , wherein K 1 is a constant value and K 2 has a value depending on surrounding luminance.

13. The method of claim 12 , wherein a center point of the sigmoid function approximates 240/(1+second weight K 2 ), wherein said image sensor comprises a CCD sensor.

14. The method of claim 12 , wherein a center point of the sigmoid function approximates 255/(1+second weight K 2 ), wherein said image sensor comprises a CMOS sensor.

15. The method of claim 12 , wherein a center point of the sigmoid function approximates 100/(1+second weight K 2 ), wherein said image sensor comprises a CMOS sensor.

16. The method of claim 12 , wherein a center point of the sigmoid function decreases as the second weight K 2 increases and said center point increases as the second weight K 2 decreases.

17. The method of claim 11 , wherein the value of said digital gain approaches 1.0 as brightness of a region of the image frame nears maximum value.

18. The method of claim 11 , wherein the value of said digital gain has an upper limit of 5.0 in a region of the image frame that, relative to all other regions in an image frame, is the darkest.

19. The method of claim 11 , wherein said digital gain transitions from a region of a first brightness to a region of a second brightness, wherein the first brightness is greater than the second brightness, in a smooth manner.

Assignees

• Endochoice Inc

Inventors

• Sidar Itay
• Davidson Tal
• Kronman Achia

Classifications

• H04N23/555

  for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes · CPC title

• H04N25/58

  involving two or more exposures · CPC title

• H04N25/71

  Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors · CPC title

• H04N23/76

  by influencing the image signals · CPC title

• H04N23/71

  Circuitry for evaluating the brightness variation · CPC title