Diagnostic dictionary registering device, diagnosing device, method, program, and data structure

Patent metadata

Field	Value
Publication number	US-12013345-B2
Application number	US-201916970876-A
Country	US
Kind code	B2
Filing date	Feb 6, 2019
Priority date	Feb 20, 2018
Publication date	Jun 18, 2024
Grant date	Jun 18, 2024

Abstract

The disclosed technology describes determining and registering dictionary data to diagnose a deteriorating state of a surface of a diagnose object. The method comprises receiving spectral distribution information of deteriorating surface regions of a target object. Given the spectral distribution information and a predetermined spectral distribution information of a reference object, the present technology determines a reference reflectance value of the target object and registers the reference reflectance value of the target object as dictionary data. The reference reflectance value is approximately the same regardless of a progressing state of deterioration of a surface of the target object. Given the dictionary data, the present invention estimates a deterioration state of a surface of a diagnose object under a variety of type of light sources with accuracy, without measuring spectral distribution information about a light source used at the time of measuring spectral data of the diagnose object.

First claim

The invention claimed is:

1. A computer-implemented method for registering and diagnosing objects, the method comprising:
receiving, based on measured spectral data of a plurality of surface regions of a target object reflecting light from a light source, first spectral distribution information of a first surface region of the target object and second spectral distribution of a second surface region of the target object, wherein the first surface region and the second surface region are in a deteriorating state;
determining, based at least on the received first and second spectral distribution information and a predetermined spectral distribution information of a reference object, a a first spectral reflectance value of the first surface region of the target object and a second spectral reflectance value of the second surface region of the target object, wherein the predetermined spectral distribution information of the reference object is based on measured spectral data of a surface of the reference object reflecting light from the light source;
determining, based on the first and second spectral reflectance values, a range of wavelengths and a reference reflectance value of the range of wavelengths of the target object, wherein the first and second spectral reflectance values are within a predetermined deviation from each other at the range of wavelengths;
registering, as a set of dictionary entries for diagnosing the surface states of a diagnose object, one or more of:
the first and second spectral reflectance values,
the determined range of wavelengths,
the determined reference reflectance value of the target object, and
the predetermined spectral distribution information of the light source;

determining, based on the reference reflectance value, a surface state of the diagnose object; and
transmitting the surface state to an application configured to display the surface state as a diagnose result.

2. The computer-implemented method of claim 1 , wherein the light source is a part of a set of predetermined light sources for reproducing an outdoor illumination environment.

3. The computer-implemented method of claim 1 , the method further comprising:
receiving spectral image data of the diagnose object;
interactively receiving location information of a deterioration area in the spectral image data;
generating third spectral distribution information of the deterioration area based on pixel data of the deterioration area of the spectral image;
determining a degree of similarity between the third spectral distribution information and the predetermined spectral distribution information of the light source in the determined range of wavelengths as stored in the set of dictionary entries;
estimating, based on the determined degree of similarity, fourth spectral distribution information of the pixel data of the spectral image data of the diagnose object;
determining, based on the spectral distribution information of each pixel data of the spectral image data of the diagnose object and the estimated fourth spectral distribution information, a surface state of a location in the diagnose object corresponding to the pixel data; and
displaying the determined surface state as a result of a diagnosis of the diagnose object.

4. The computer-implemented method of claim 3 , the method further comprising:
determining a degree of deterioration of the diagnose object based on a ratio of a number of pixels indicating deterioration in the spectral image data over a number of pixels in the spectral image data;
specifying a status of deterioration of the diagnose object based on the degree of deterioration and a predetermined threshold; and
providing the surface status of the deterioration.

5. The computer-implemented method of claim 1 , wherein the first spectral reflectance value of the first surface region of the target object indicates a rate of energy, expressed as a ratio of a luminous flux incident of a surface of the target object surface and a reflected luminous flux of each spectrum, that the target object reflects for each wavelength in spectral distribution of light from the light source, the spectral distribution of light from the light source includes a strength of the energy of each wavelength of light from the light source.

6. The computer-implemented method of claim 1 , wherein the range of wavelengths represents a range of wavelengths where spectral reflectance values of a plurality of surface regions in the deteriorated state are within a predetermined deviation from the reference reflectance value.

7. The computer-implemented method of claim 1 , wherein the first spectral distribution information of the first surface region of the target object is measured using a spectrometer, and wherein the first surface region indicates at least one of:
polyethylene paint coated over a metal surface,
rust fluid, or
red rust due to aging.

8. A system for machine learning, the system comprises:
a processor; and
a memory storing computer-executable instructions that when executed by the processor cause the system to execute operations comprising:
receiving, based on measured spectral data of a plurality of surface regions of a target object reflecting light from a light source, first spectral distribution information of a first surface region of the target object and second spectral distribution of a second surface region of the target object, wherein the first surface region and the second surface region are in a deteriorating state;
determining, based at least on the received first and second spectral distribution information and a predetermined spectral distribution information of a reference object, a first spectral reflectance value of the first surface region of the target object and a second spectral reflectance value of the second surface region of the target object, wherein the predetermined spectral distribution information of the reference object is based on measured spectral data of a surface of the reference object reflecting light from the light source;
determining, based on the first and second spectral reflectance values, a range of wavelengths and a reference reflectance value of the range of wavelengths of the target object, wherein the first and second spectral reflectance values are within a predetermined deviation from each other at the range of wavelengths; and
registering, as a set of dictionary entries for diagnosing the surface states of a diagnose object, one or more of:
the first and second spectral reflectance values,
the determined range of wavelengths,
the determined reference reflectance value of the target object, and
the predetermined spectral distribution information of the light source;

determining, based on the reference reflectance value, a surface state of the diagnose object; and
transmitting the surface state to an application configured to display the surface state as a diagnose result.

9. The system of claim 8 , wherein the light source is a part of a set of predetermined light sources for reproducing an outdoor illumination environment.

10. The system of claim 8 , the computer-executable instructions when executed further causing the system to execute operations comprising:
receiving spectral image data of the diagnose object;
interactively receiving location information of a deterioration area in the spectral image data;
generating third spectral distribution information of the deterioration area based on pixel data of the deterioration area of the spectral image;
determining a degree of similarity between the third spectral distribution information and the predetermined spectral distribution information of the light source in the determined

Assignees

• Nippon Telegraph & Telephone

Inventors

• Tsukatani Shunsuke
• Ando Shingo
• Kinebuchi Tetsuya

Classifications

• G06N5/04

  Inference or reasoning models · CPC title

• G01N2201/061

  Sources · CPC title

• G01N21/55

  Specular reflectivity · CPC title

• G01N21/31 Primary

  Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry {(G01N21/72 takes precedence)} · CPC title

• G06N20/00

  Machine learning · CPC title