Image processing system and computer-readable recording medium

Patent metadata

Field	Value
Publication number	US-9972074-B2
Application number	US-201615372400-A
Country	US
Kind code	B2
Filing date	Dec 8, 2016
Priority date	Jun 12, 2014
Publication date	May 15, 2018
Grant date	May 15, 2018

Abstract

A technique to remove fog from an image more appropriately has been called for. An image processing system is provided, including: a high saturation pixel extracting unit that extracts, from one frame among a plurality of frames included in a moving image, a high saturation pixel having a saturation higher than a predetermined threshold; a high saturation pixel rate deriving unit that derives a high saturation pixel rate indicative of a percentage of the high saturation pixels in the one frame; and a scene change judging unit that judges whether or not a scene change is included in the moving image based on different criteria depending on whether or not the high saturation pixel rate in the one frame is higher than a predetermined threshold.

First claim

What is claimed is:

1. An image processing system comprising:
a high saturation pixel extracting unit that extracts, from one frame among a plurality of frames included in a moving image, a high saturation pixel having a saturation higher than a predetermined threshold;
a high saturation pixel rate deriving unit that derives a high saturation pixel rate indicative of a percentage of the high saturation pixels in the one frame; and
a scene change judging unit that judges whether or not a scene change is included in the moving image based on different criteria depending on whether or not the high saturation pixel rate in the one frame is higher than a predetermined threshold, wherein
when the high saturation pixel rate is higher than the threshold, the scene change judging unit judges whether or not a scene change is included in the moving image based on a hue of the one frame and a hue of a past frame of the one frame, and
when the high saturation pixel rate is equal to or lower than the threshold, the scene change judging unit judges whether or not a scene change is included in the moving image based on a high saturation pixel rate of the one frame and a high saturation pixel rate of a past frame of the one frame.

2. The image processing system according to claim 1 , further comprising:
a haze depth estimate value acquiring unit that acquires a haze depth estimate value of the one frame; and
a reliability deriving unit that derives a reliability of the haze depth estimate value based on the high saturation pixel rate in the one frame and an average luminance value of the one frame.

3. The image processing system according to claim 2 , wherein
when the estimate value is higher than a predetermined threshold, the reliability deriving unit derives a higher reliability as the average luminance value increases, and derives a higher reliability as the high saturation pixel rate decreases, and
when the estimate value is equal to or lower than a predetermined threshold, the reliability deriving unit derives a higher reliability as the average luminance value decreases, and derives a higher reliability as the high saturation pixel rate increases.

4. The image processing system according to claim 2 , further comprising:
a target value acquiring unit that acquires a haze depth target value of a past frame of the one frame; and
a target value determining unit that determines which one, the haze depth target value acquired by the target value acquiring unit or the haze depth estimate value acquired by the haze depth estimate value acquiring unit, is to be used for adjusting a parameter to be used in a haze removal process based on the reliability derived by the reliability deriving unit.

5. The image processing system according to claim 4 , further comprising a difference absolute value deriving unit that derives a difference absolute value between a haze depth target value acquired by the target value acquiring unit and the haze depth estimate value acquired by the haze depth estimate value acquiring unit, wherein
the target value determining unit determines which one, the haze depth target value acquired by the target value acquiring unit or the haze depth estimate value acquired by the haze depth estimate value acquiring unit, is to be used for adjusting a parameter to be used in a haze removal process based on a reliability of the estimate value and the difference absolute value, or a scene change flag indicative of whether the one frame is a frame in which a scene change occurs.

6. The image processing system according to claim 4 , further comprising a parameter adjusting unit that adjusts a parameter to be used in a haze removal process of the one frame such that it becomes close to, stepwise, a value corresponding to the haze depth target value or the haze depth estimate value determined by the target value determining unit.

7. The image processing system according to claim 6 , wherein the parameter adjusting unit adjusts a parameter to be used in a haze removal process with an adjustment amount corresponding to: a difference absolute value between the haze depth target value or the haze depth estimate value determined by the target value determining unit and a parameter used in the haze removal process of a past frame of the one frame; a reliability of the haze depth estimate value; and a scene change flag indicative of whether the one frame is a frame in which a scene change occurs such that it becomes close to, stepwise, a value corresponding to the haze depth target value or the haze depth estimate value determined by the target value determining unit.

8. A non-transitory computer-readable recording medium having recorded thereon a program for allowing a computer to function as:
a high saturation pixel extracting unit that extracts, from one frame among a plurality of frames included in a moving image, a high saturation pixel having a saturation higher than a predetermined threshold;
a high saturation pixel rate deriving unit that derives a high saturation pixel rate indicative of a percentage of the high saturation pixels in the one frame; and
a scene change judging unit that judges whether or not a scene change is included in the moving image based on different criteria depending on whether or not the high saturation pixel rate in the one frame is higher than a predetermined threshold, wherein
when the high saturation pixel rate is higher than the threshold, the scene change judging unit judges whether or not a scene change is included in the moving image based on a hue of the one frame and a hue of a past frame of the one frame, and
when the high saturation pixel rate is equal to or lower than the threshold, the scene change judging unit judges whether or not a scene change is included in the moving image based on a high saturation pixel rate of the one frame and a high saturation pixel rate of a past frame of the one frame.

Assignees

• Eizo Corp

Inventors

• Higashi Masafumi
• Nakamae Takashi
• Aoki Reo

Classifications

• G06T2207/20012

  Locally adaptive · CPC title

• H04N1/407 Primary

  Control or modification of tonal gradation or of extreme levels, e.g. background level · CPC title

• G06T7/11

  Region-based segmentation · CPC title

• G06T2207/20192

  Edge enhancement; Edge preservation · CPC title

• G06T7/529

  from texture · CPC title