Image processing apparatus, image processing method, and non-transitory computer-readable storage medium

Patent metadata

Field	Value
Publication number	US-2025272804-A1
Application number	US-202519056902-A
Country	US
Kind code	A1
Filing date	Feb 19, 2025
Priority date	Feb 27, 2024
Publication date	Aug 28, 2025
Grant date	—

Abstract

An image processing apparatus includes one or more memories storing instructions and one or more processors that execute the instructions to reduce turbulence in an image based on turbulence information, and to correct, based on the turbulence information and a spatial change in luminance in the image, contrast of the image.

First claim

What is claimed is:

1 . An image processing apparatus comprising one or more memories storing instructions and one or more processors that execute the instructions:
to reduce turbulence in an image based on turbulence information; and to correct, based on the turbulence information and a spatial change in luminance in the image, contrast of the image.

2 . The image processing apparatus according to claim 1 , wherein a histogram of luminance values in the image is calculated, a peak of the luminance values in the histogram is detected, a distance between peaks is calculated as the change in luminance, and emphasis of the contrast of the image is increased as the distance increases.

3 . The image processing apparatus according to claim 2 , wherein, in a case when the distance is less than a threshold, the emphasis is not performed.

4 . The image processing apparatus according to claim 1 , wherein, whether the change in luminance is large based on the number of edge pixels in the image or an edge intensity in the image is determined, and in a case where it is determined that the change in luminance is large, the correction is performed, and in a case where it is determined that the change in luminance is small, the correction is not performed.

5 . The image processing apparatus according to claim 1 , wherein emphasis of the contrast of the image is increased as an amount of turbulence indicated by the turbulence information increases.

6 . The image processing apparatus according to claim 5 , wherein, in a case when the amount of turbulence indicated by the turbulence information is less than a threshold, the emphasis is not performed.

7 . The image processing apparatus according to claim 1 , wherein emphasis of the contrast of the image is increased as an intensity of the reduction increases.

8 . The image processing apparatus according to claim 1 , wherein a degree of contrast emphasis for when a condition that an amount of turbulence indicated by the turbulence information is greater than or equal to a threshold and an intensity of the reduction is less than a threshold is satisfied is caused to be smaller than a degree of contrast emphasis for when the condition is not satisfied.

9 . The image processing apparatus according to claim 1 , wherein turbulence in an image of a current frame is reduced based on turbulence information of a past frame, and
the image of the current frame is corrected based on the turbulence information of the past frame and a spatial change in luminance in the image of the current frame.

10 . The image processing apparatus according to claim 9 , wherein, if an amount of turbulence indicated by the turbulence information of the past frame is greater than or equal to a threshold, the turbulence in the image of the current frame is reduced at an intensity greater than an intensity at which turbulence in the image of the past frame is reduced.

11 . The image processing apparatus according to claim 9 , wherein, if an amount of turbulence indicated by the turbulence information of the past frame is less than a threshold, the turbulence in the image of the current frame is reduced at an intensity that is the same as an intensity at which turbulence in the image of the past frame is reduced.

12 . An image processing apparatus comprising one or more memories storing instructions and one or more processors that execute the instructions:
to reduce turbulence in an image based on turbulence information; and to process, based on the turbulence information, a high-frequency component in a reduced image generated by the reduction, and generate an image obtained by adding the processed high-frequency component to the reduced image.

13 . The image processing apparatus according to claim 12 , wherein filter processing in which blurring of a high-frequency component is increased is performed as an amount of turbulence indicated by the turbulence information increases, and the high-frequency component that has been subjected to the filter processing is multiplied by a gain that increases as the amount of turbulence indicated by the turbulence information increases.

14 . The image processing apparatus according to claim 12 , wherein a low-amplitude signal of the high-frequency component removed.

15 . The image processing apparatus according to claim 12 , wherein, in a case when it is determined that a spatial change in luminance in the image is large, the processing and the generation are performed.

16 . The image processing apparatus according to claim 12 , wherein the processing and the generation are performed on an edge portion having an edge intensity that is greater than or equal to a threshold.

17 . An image processing apparatus comprising one or more memories storing instructions and one or more processors that execute the instructions:
to reduce turbulence in an image based on turbulence information; and to compress and encode the image at a compression ratio that accords with the turbulence information.

18 . The image processing apparatus according to claim 17 , wherein the compression ratio is decreased as an amount of turbulence indicated by the turbulence information increases.

19 . The image processing apparatus according to claim 17 , wherein the compression ratio is decreased as a degree of turbulence indicated by the turbulence information increases.

20 . The image processing apparatus according to claim 17 , wherein the compression ratio is decreased as an intensity of the reduction increases.

21 . The image processing apparatus according to claim 1 , wherein the image is an input image or a respective one of pixel blocks obtained by dividing the input image.

22 . The image processing apparatus according to claim 1 , further comprising an imaging unit.

23 . An image processing method performed by an image processing apparatus, the method comprising:
reducing turbulence in an image based on turbulence information; and correcting, based on the turbulence information and a spatial change in luminance in the image, contrast of the image.

24 . An image processing method performed by an image processing apparatus, the method comprising:
reducing turbulence in an image based on turbulence information; and processing, based on the turbulence information, a high-frequency component in a reduced image generated by the reduction, and generating an image obtained by adding the processed high-frequency component to the reduced image.

25 . An image processing method performed by an image processing apparatus, the method comprising:
reducing turbulence in an image based on turbulence information; and compressing and encoding the image at a compression ratio that accords with the turbulence information.

26 . A non-transitory computer-readable storage medium storing a computer program that causes a computer to function as:
a reduction unit configured to reduce turbulence in an image based on turbulence information; and a correction unit configured to correct, based on the turbulence information and a spatial change in luminance in the image, contrast of the image.

27 . A non-transitory computer-readable storage medium storing a computer program that causes a computer to function as:
a reduction unit configured to reduce turbulence in an image based on turbulence information; and a sharpening unit configured

Assignees

• Canon Kk

Inventors

• Nishio Taisuke
• Yamamoto Masashi
• Tsuji Tatsuya
• Sato Natsuko

Classifications

• G06T5/92 Primary

  based on global image properties · CPC title

• G06T2207/20192

  Edge enhancement; Edge preservation · CPC title

• G06T2207/20201

  Motion blur correction · CPC title

• G06T9/00

  Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00) · CPC title

• G06T5/40

  using histogram techniques · CPC title