Image processing apparatus and method, image capturing apparatus and storage medium

Patent metadata

Field	Value
Publication number	US-2023410265-A1
Application number	US-202318331399-A
Country	US
Kind code	A1
Filing date	Jun 8, 2023
Priority date	Jun 21, 2022
Publication date	Dec 21, 2023
Grant date	—

Abstract

In an image processing apparatus, an extraction unit extracts a plurality of AC signals of a plurality of different frequency bands from image data input by an input unit; a generation unit generates first and second adjustment values for adjusting positive and negative components of an amplitude of each AC signal; an adjustment unit adjusts the amplitude of each AC signal using the first and second adjustment values; a detection unit detects a skin area from the image data; and a correction unit corrects image data of the skin area using the adjusted AC signals. The generation unit generates the first adjustment value such that the positive component of the amplitude of the AC signal of a first frequency band is less attenuated than that of the AC signal of a second frequency band which is lower than the first frequency band.

First claim

What is claimed is:

1 . An image processing apparatus comprising one or more processors and/or circuitry which function as:
an input unit that inputs image data; an extraction unit that extracts a plurality of AC signals of a plurality of different frequency bands from the image data; a generation unit that generates a first adjustment value and a second adjustment value for adjusting a positive component and a negative component, respectively, of an amplitude of each of the AC signals of the respective frequency bands; an adjustment unit that adjusts the amplitude of each of the plurality of AC signals using the first adjustment value and the second adjustment value; a detection unit that detects a skin area from the image data; and a correction unit that corrects image data of the skin area using the plurality of AC signals which are adjusted by the adjustment unit, wherein the generation unit generates the first adjustment value such that the positive component of the amplitude of the AC signal of a first frequency band among the plurality of frequency bands is less attenuated than the positive component of the amplitude of the AC signal of a second frequency band which is lower than the first frequency band.

2 . The image processing apparatus according to claim 1 , wherein the detection unit further detects reliability of the skin area, and
the correction unit corrects the image data of the skin area by replacing AC signals of the skin area by AC signals respectively obtained by weighted-adding an AC signal obtained by adding the plurality of AC signals adjusted by the adjustment unit and the AC signals of the skin area according to the reliability.

3 . The image processing apparatus according to claim 1 , wherein the generation unit generates the first adjustment value and the second adjustment value such that
the first adjustment value for the first frequency band does not attenuate the positive component of the amplitude of the AC signal and the second adjustment value for the first frequency band attenuates the negative component of the AC signal, and the first adjustment value and the second adjustment value for the second frequency band attenuates the positive component and the negative component of the AC signal.

4 . The image processing apparatus according to claim 1 , wherein the one or more processors and/or circuitry further function as a face detection unit that detects a face area from the image data,
wherein the generation unit generates the first adjustment value and the second adjustment value based on information of the face area.

5 . The image processing apparatus according to claim 4 , wherein the generation unit generates the first adjustment value and the second adjustment value based on a size of the face area.

6 . The image processing apparatus according to claim 5 , wherein the generation unit
generates the first adjustment value that does not attenuate the positive component of the amplitude of the AC signal of the first frequency band and the second adjustment value that attenuates the positive component of the amplitude of the AC signal of the first frequency band in a case where the size of the face area is larger than a predetermined first size, and generates the first adjustment value and the second adjustment value that attenuate the positive component and the negative component of the amplitude of the AD signal of the first frequency band in a case where the size of the face area is equal to or less than the first size, and generates the first adjustment value that does not attenuate the positive component of the amplitude of the AC signal of the second frequency band and the second adjustment value that attenuates the positive component of the amplitude of the AC signal of the second frequency band in a case where the size of the face area is larger than a predetermined second size, and generates the first adjustment value and the second adjustment value that attenuate the positive component and the negative component of the amplitude of the AD signal of the second frequency band in a case where the size of the face area is equal to or less than the second size, wherein the first size is smaller than the second size.

7 . The image processing apparatus according to claim 4 , wherein the information of the face area includes an age of a person, and
the generation unit generates the first adjustment value and the second adjustment value further based on the age.

8 . The image processing apparatus according to claim 7 , wherein the generation unit adjusts the first adjustment value and the second adjustment value such that the amplitudes of the AC signals attenuates more if the age is higher than a first age than if the age is a second age which is lower than the first age.

9 . The image processing apparatus according to claim 4 , wherein the information of the face area includes gender of a person, and
the generation unit generates the first adjustment value and the second adjustment value further based on the gender.

10 . The image processing apparatus according to claim 4 , wherein the information of the face area includes a part of the face, and
the generation unit generates the first adjustment value and the second adjustment value further based on the part.

11 . The image processing apparatus according to claim 10 , wherein, in a case where the part is eyes, the generation unit adjust the first adjustment value such that the amplitude of the AC signal of the first frequency band in an area around the eyes is less attenuated among the image data.

12 . The image processing apparatus according to claim 10 , wherein, in a case where the part is a mouth, the generation unit adjusts the first adjustment value such that the amplitude of the AC signal of the first frequency band in an area around the mouth is less attenuated among the image data.

13 . An image capturing apparatus comprising:
an image processing apparatus comprising one or more processors and/or circuitry which function as:
an input unit that inputs image data;
an extraction unit that extracts a plurality of AC signals of a plurality of different frequency bands from the image data;
a generation unit that generates a first adjustment value and a second adjustment value for adjusting a positive component and a negative component, respectively, of an amplitude of each of the AC signals of the respective frequency bands;
an adjustment unit that adjusts each of the plurality of AC signals using the first adjustment value and the second adjustment value;
a detection unit that detects a skin area from the image data; and
a correction unit that corrects image data of the skin area using the plurality of AC signals which are adjusted by the adjustment unit, and
an imaging unit that performs image shooting and outputs the image data, wherein the generation unit generates the first adjustment value such that the positive component of the amplitude of the AC signal of a first frequency band among the plurality of frequency bands is less attenuated than the positive component of the amplitude of the AC signal of a second frequency band which is lower than the first frequency band.

14 . An image processing method comprising:
inputting image data; extracting a plurality of AC signals of a plurality of different frequency bands from the image data; generating a first adjustment value and a second adjustment value for adjusting a positive component and a negative component, respectively, of an amplitude of each of the AC signals of the respective frequency bands; adjusting the amplitude of eac

Assignees

• Canon Kk

Inventors

• Kimura Naoto

Classifications

• G06T5/005 Primary

  Physics · mapped topic

• G06V10/42

  Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation · CPC title

• G06V40/165

  using facial parts and geometric relationships · CPC title

• G06T2207/30201

  Face · CPC title

• G06V40/178

  estimating age from face image; using age information for improving recognition · CPC title