Model building apparatus, model building method, computer program and recording medium

Patent metadata

Field	Value
Publication number	US-12190239-B2
Application number	US-201917429789-A
Country	US
Kind code	B2
Filing date	Feb 12, 2019
Priority date	Feb 12, 2019
Publication date	Jan 7, 2025
Grant date	Jan 7, 2025

Abstract

A model building apparatus includes: a building unit that builds a generation model that outputs an adversarial example, which causes misclassification by a learned model, when a source sample is entered into the generation model; and a calculating unit that calculates a first evaluation value and a second evaluation value, wherein the first evaluation value is smaller as a difference is smaller between an actual visual feature of the adversarial example outputted from the generation model and a target visual feature of the adversarial example that are set to be different from a visual feature of the source sample, and the second evaluation value is smaller as there is a higher possibility that the learned model misclassifies the adversarial example outputted from the generation model. The building unit builds the generation model by updating the generation model such that an index value based on the first and second evaluation values is smaller.

First claim

What is claimed is:

1. A model building apparatus comprising a controller,
the controller being programmed to:
build a generation model that outputs an adversarial example, which causes misclassification by a learned model, when a source sample is entered into the generation model; and
calculate a first evaluation value and a second evaluation value, wherein the first evaluation value is smaller as a difference is smaller between an actual visual feature of the adversarial example outputted from the generation model and a target visual feature of the adversarial example that are set to be different from a visual feature of the source sample, and the second evaluation value is smaller as there is a higher possibility that the learned model misclassifies the adversarial example outputted from the generation model,
wherein
the controller is programmed to build the generation model by updating the generation model such that an index value based on the first and second evaluation values is smaller,
the controller is further programmed to generate an approximate model for approximating the learned model, and
the controller is programmed to calculate the second evaluation value on the basis of a parameter for defining the approximate model.

2. The model building apparatus according to claim 1 , wherein
the controller is programmed to (i) calculate the second evaluation value on the basis of a parameter for defining the learned model when it is possible to obtain the parameter for defining the learned model, and (ii) calculate the second evaluation value on the basis of the parameter for defining the approximate model when it is impossible to obtain the parameter for defining the learned model.

3. The model building apparatus according to claim 1 , wherein
the controller is further programmed to generate the adversarial example by entering the source sample into the generation model built by the building unit.

4. The model building apparatus according to claim 1 , wherein
the controller is further programmed to evaluate the adversarial examples outputted from the generation model.

5. A model building method comprising:
building a generation model that outputs an adversarial example, which causes misclassification by a learned model, when a source sample is entered into the generation model; and
calculating a first evaluation value and a second evaluation value, wherein the first evaluation value is smaller as a difference is smaller between an actual visual feature of the adversarial example outputted from the generation model and a target visual feature of the adversarial example that are set to be different from a visual feature of the source sample, and the second evaluation value is smaller as there is a higher possibility that the learned model misclassifies the adversarial example outputted from the generation model, wherein
building includes building the generation model by updating the generation model such that an index value based on the first and second evaluation values is smaller,
the method further comprising:
generating an approximate model for approximating the learned model, and
calculating the second evaluation value on the basis of a parameter for defining the approximate model.

6. A non-transitory recording medium on which a computer program that allows a computer to execute a model building method comprising:
building a generation model that outputs an adversarial example, which causes misclassification by a learned model, when a source sample is entered into the generation model; and
calculating a first evaluation value and a second evaluation value, wherein the first evaluation value is smaller as a difference is smaller between an actual visual feature of the adversarial example outputted from the generation model and a target visual feature of the adversarial example that are set to be different from a visual feature of the source sample, and the second evaluation value is smaller as there is a higher possibility that the learned model misclassifies the adversarial example outputted from the generation model, wherein
building includes building the generation model by updating the generation model such that an index value based on the first and second evaluation values is smaller,
the method further comprising:
generating an approximate model for approximating the learned model, and
calculating the second evaluation value on the basis of a parameter for defining the approximate model.

7. The model building apparatus according to claim 1 , wherein the parameter includes at least one of variables and coefficients used to determine at least one of behavior, structure, and properties of an approximation model, and the parameter includes at least one of weighting and biases, hyperparameters, and decision thresholds.

8. The non-transitory recording medium according to claim 6 , wherein the parameter includes at least one of variables and coefficients used to determine at least one of behavior, structure, and properties of an approximation model, and the parameter includes at least one of weighting and biases, hyperparameters, and decision thresholds.

Assignees

• Nec Corp

Inventors

• Kakizaki Kazuya
• Yoshida Kosuke

Classifications

• G06N3/09

  Supervised learning · CPC title

• G06N3/0475

  Generative networks · CPC title

• G06N3/094

  Adversarial learning · CPC title

• G06F21/36

  by graphic or iconic representation · CPC title

• G06F18/2413

  based on distances to training or reference patterns · CPC title