Information processing device and information processing method

Patent metadata

Field	Value
Publication number	US-12437380-B2
Application number	US-202117922579-A
Country	US
Kind code	B2
Filing date	Mar 30, 2021
Priority date	May 14, 2020
Publication date	Oct 7, 2025
Grant date	Oct 7, 2025

Abstract

Provided is a polarization rendering setting unit that sets a plurality of parameters to be used for generating a polarized rendered image of an abnormality detection target. A polarized rendered image generation unit generates the polarized rendered image of the abnormality detection target on the basis of the parameters set by the polarization rendering setting unit. An abnormality detection unit detects an abnormal region of the abnormality detection target on the basis of a difference between a polarized captured image acquired by imaging the abnormality detection target and the polarized rendered image generated by the polarized rendered image generation unit. Abnormalities that are difficult to detect on the basis of luminance information and color information becomes able to be detected on the basis of polarized images.

First claim

The invention claimed is:

1. An information processing device, comprising:
circuitry configured to:
acquire a polarized captured image of an abnormality detection target based on an imaging operation;
set a plurality of parameters that is used to generate a polarized rendered image of the abnormality detection target,
wherein the plurality of parameters includes a light source parameter related to a light source, a geometry parameter related to the abnormality detection target, a material parameter related to a polarization characteristic of the abnormality detection target, and a camera parameter associated with the acquisition of the polarized captured image;

generate the polarized rendered image of the abnormality detection target based on the plurality of parameters; and
detect an abnormal region of the abnormality detection target based on a difference between the acquired polarized captured image and the generated polarized rendered image.

2. The information processing device according to claim 1 , wherein
the plurality of parameters is measured, and
the circuitry is further configured to
set the plurality of parameters that is measured as the plurality of parameters that is used to generate the polarized rendered image.

3. The information processing device according to claim 1 , wherein
in a case where at least one parameter of the plurality of parameters is unmeasured, the circuitry is further configured to:
perform an optimization process for each of the unmeasured at least one parameter of the plurality of parameters;
calculate a parameter based on the performed optimization process; and
set, as the plurality of parameters that is used to generate the polarized rendered image, one of:
a measured parameter of the plurality of parameters and the parameter calculated based on the performed optimization process, or
the parameter calculated based on the performed optimization process in a case where there is no measured parameter.

4. The information processing device according to claim 3 , wherein the circuitry is further configured to
calculate, based on the performed optimization process, the parameter to minimize the difference between the acquired polarized captured image and the generated polarized rendered image.

5. The information processing device according to claim 4 , wherein
the circuitry is further configured to enable an adjustment of a convergence characteristic of the parameter based on a parameter value,
the parameter value has converged based on a repeated update of the parameter, and
the repeated update of the parameter is based on the difference as an optimized parameter value.

6. The information processing device according to claim 3 , wherein
the circuitry is further configured to estimate an abnormality cause of the detected abnormal region based on information indicating whether the plurality of parameters is one of the measured parameter or the parameter calculated based on the performed optimization process.

7. The information processing device according to claim 1 , wherein the circuitry is further configured to:
determine a difference in polarization information based on polarization information calculated from the polarized captured image and polarization information calculated from the polarized rendered image; and
detect the abnormal region of the abnormality detection target based on the determined difference in the polarization information.

8. The information processing device according to claim 1 , wherein
the circuitry is further configured to detect the abnormal region of the abnormality detection target in units of pixels.

9. The information processing device according to claim 1 , wherein the circuitry is further configured to:
measure the material parameter in advance; and
use the material parameter measured in advance in a fixed manner.

10. An information processing method, comprising:
acquiring a polarized captured image of an abnormality detection target based on an imaging operation;
setting a plurality of parameters that is used for generating a polarized rendered image of the abnormality detection target,
wherein the plurality of parameters includes a light source parameter related to a light source, a geometry parameter related to the abnormality detection target, a material parameter related to a polarization characteristic of the abnormality detection target, and a camera parameter associated with the acquisition of the polarized captured image;

generating the polarized rendered image of the abnormality detection target based on the plurality of parameters; and
detecting an abnormal region of the abnormality detection target based on a difference between the acquired polarized captured image and the generated polarized rendered image.

11. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by a computer, cause the computer to execute operations, the operations comprising:
acquiring a polarized captured image of an abnormality detection target based on an imaging operation;
setting a plurality of parameters that is used for generating a polarized rendered image of the abnormality detection target,
wherein the plurality of parameters includes a light source parameter related to a light source, a geometry parameter related to the abnormality detection target, a material parameter related to a polarization characteristic of the abnormality detection target, and a camera parameter associated with the acquisition of the polarized captured image;

generating the polarized rendered image of the abnormality detection target based on the plurality of parameters; and
detecting an abnormal region of the abnormality detection target based on a difference between the acquired polarized captured image and the generated polarized rendered image.

12. An information processing device, comprising:
circuitry configured to:
acquire a polarized captured image of an abnormality detection target based on an imaging operation;
obtain a plurality of parameters that is used to generate a polarized rendered image of the abnormality detection target;
perform, in a case where some or all of the plurality of parameters are unmeasured, an optimization process for each of the some or all of the plurality of parameters that are unmeasured;
calculate a parameter based on the performed optimization process;
set, as the plurality of parameters that is used to generate the polarized rendered image, one of:
a measured parameter of the plurality of parameters and the parameter calculated based on the performed optimization process, or
the parameter calculated based on the performed optimization process, in a case where there is no measured parameter;

generate the polarized rendered image of the abnormality detection target based on the plurality of parameters; and
detect an abnormal region of the abnormality detection target based on a difference between the acquired polarized captured image and the generated polarized rendered image.

Assignees

• Sony Group Corp

Inventors

• Sun Legong
• Hirasawa Yasutaka
• Kondo Yuhi
• Ono Taishi

Classifications

• G06T2207/30168

  Image quality inspection · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T7/90

  Determination of colour characteristics · CPC title

• G06T7/80

  Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration · CPC title

• G01N21/88

  Investigating the presence of flaws or contamination · CPC title