Calculation scheme decision system, calculation scheme decision device, calculation scheme decision method, and storage medium

Patent metadata

Field	Value
Publication number	US-2021158136-A1
Application number	US-201916617175-A
Country	US
Kind code	A1
Filing date	Jan 23, 2019
Priority date	Jan 25, 2018
Publication date	May 27, 2021
Grant date	—

Abstract

A calculation scheme decision system includes a pre-calculation unit performing, in an execution environment in which calculation is performed, calculation for each of respective layers of the network structure using at least one of calculation schemes prepared in advance for the respective layers, a cost acquisition unit acquiring a calculation cost of at least one calculation scheme for each layer based on a result of the calculation by the pre-calculation unit, a decision unit selecting one calculation scheme for each layer based on the calculation cost from among at least one of the calculation schemes prepared in advance for the respective layers to associate the layer with the selected one calculation scheme, and a calculation unit performing the calculation for each of the respective layers of the network structure on input data in the execution environment using the calculation scheme associated with each layer.

First claim

1 . A calculation scheme decision system comprising:
a pre-calculation unit configured to perform, in an execution environment in which calculation for processing input data is performed using a network structure and weight data, calculation for each of respective layers of the network structure on predetermined data using at least one of calculation schemes prepared in advance for the respective layers of the network structure; a cost acquisition unit configured to acquire a calculation cost of the at least one calculation scheme for each of the respective layers of the network structure based on a result of the calculation by the pre-calculation unit; a decision unit configured to select one calculation scheme for each of the respective layers of the network structure based on the calculation cost from among the at least one of the calculation schemes prepared in advance for the respective layers to associate the layer of the network structure with the selected one calculation scheme; and a calculation unit configured to perform the calculation for each of the respective layers of the network structure on the input data in the execution environment using the calculation scheme associated with each layer of the network structure by the decision unit.

2 . The calculation scheme decision system according to claim 1 , wherein
the at least one calculation scheme includes a plurality of algorithms executable in the execution environment and exerting the same function using arithmetic operations different from each other.

3 . The calculation scheme decision system according to claim 1 , wherein
the at least one calculation scheme includes a plurality of algorithms executable in the execution environment and performing the same arithmetic operation using resources different from each other.

4 . The calculation scheme decision system according to claim 1 , further comprising: a candidate decision unit configured to prepare the at least one calculation scheme for each of the respective layers of the network structure based on the execution environment.

5 . The calculation scheme decision system according to claim 1 , further comprising: a conversion unit configured to acquire the network structure and the weight data from an external device and convert the acquired network structure and weight data into a predetermined format, wherein
the pre-calculation unit and the calculation unit perform calculation based on the network structure and the weight data in the predetermined format converted by the conversion unit.

6 . The calculation scheme decision system according to claim 1 , further comprising: a first adjustment unit configured to change a data order of the weight data based on the execution environment, wherein
the pre-calculation unit and the calculation unit perform calculation based on the weight data adjusted by the first adjustment unit.

7 . The calculation scheme decision system according to claim 1 , further comprising: a second adjustment unit configured to perform a preprocess related to the calculation of the calculation unit on the weight data, wherein
the pre-calculation unit and the calculation unit perform calculation based on the weight data adjusted by the second adjustment unit.

8 . The calculation scheme decision system according to claim 1 , wherein
the pre-calculation unit and the calculation unit are included in a first terminal, and the calculation scheme decision system further comprises a provision unit configured to provide the calculation scheme decided by the decision unit to a second terminal having an execution environment the same as an execution environment of the first terminal.

9 . A calculation scheme decision device comprising:
a data acquisition unit configured to acquire, from a processing device in which calculation for processing input data is performed using a network structure and weight data, a calculation cost in a case of calculating, for each of respective layers of the network structure, in at least one of calculation schemes prepared in advance for the respective layers of the network structure; and a decision unit configured to select one calculation scheme for each of the respective layers of the network structure based on the calculation cost from among the at least one of the calculation schemes prepared in advance for the respective layers to associate the layer of the network structure with the selected one calculation scheme.

10 . (canceled)

11 . A calculation scheme decision method comprising:
performing, in an execution environment in which calculation for processing input data is performed using a network structure and weight data, calculation for each of respective layers of the network structure on predetermined data using at least one of calculation schemes prepared in advance for the respective layers of the network structure; acquiring a calculation cost of the at least one calculation scheme for each of the respective layers of the network structure based on a result of the calculation for each of the respective layers of the network structure; selecting one calculation scheme for each of the respective layers of the network structure based on the calculation cost from among the at least one of the calculation schemes prepared in advance for the respective layers to associate the layer of the network structure with the selected one calculation scheme; and performing the calculation for each of the respective layers of the network structure on the input data in the execution environment using the calculation scheme associated with each layer of the network structure.

12 . A calculation scheme decision method comprising:
acquiring, from a processing device in which calculation for processing input data is performed using a network structure and weight data, a calculation cost in a case of calculating, for each of respective layers of the network structure, in at least one of calculation schemes prepared in advance for the respective layers of the network structure; and selecting one calculation scheme for each of the respective layers of the network structure based on the calculation cost from among the at least one of the calculation schemes prepared in advance for the respective layers to associate the layer of the network structure with the selected one calculation scheme.

13 . (canceled)

14 . A non-transitory computer readable storage medium for storing a calculation scheme decision program causing a computer to operate,
the program causing the computer to function as:
a pre-calculation unit configured to perform, in an execution environment in which calculation for processing input data is performed using a network structure and weight data, calculation for each of respective layers of the network structure on predetermined data using at least one of calculation schemes prepared in advance for the respective layers of the network structure;
a cost acquisition unit configured to acquire a calculation cost of the at least one calculation scheme for each of the respective layers of the network structure based on a result of the calculation by the pre-calculation unit;
a decision unit configured to select one calculation scheme for each of the respective layers of the network structure based on the calculation cost from among the at least one of the calculation schemes prepared in advance for the respective layers to associate the layer of the network structure with the selected one calculation scheme; and
a calculation unit configured to perform the calculation for each of the respective layers of the network structure on the input data in the ex

Assignees

• Morpho Inc

Inventors

• Hiraga Masaki
• Kuroda Yasuhiro
• Matsuo Hitoshi
• Nishino Hideaki
• Kurihara Kouta

Classifications

• G06N5/01

  Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound · CPC title

• G06N3/045

  Combinations of networks · CPC title

• G06N3/048

  Activation functions · CPC title

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06N3/0499

  Feedforward networks · CPC title