Method, device and computer program product for deploying a machine learning model

Patent metadata

Field	Value
Publication number	US-11429902-B2
Application number	US-201916417147-A
Country	US
Kind code	B2
Filing date	May 20, 2019
Priority date	Jan 31, 2019
Publication date	Aug 30, 2022
Grant date	Aug 30, 2022

Abstract

Embodiments of the present disclosure relate to a method, device and computer program product for deploying a machine learning model. The method comprises: receiving an intermediate representation indicating processing of a machine learning model, learning parameters of the machine learning model, and a computing resource requirement for executing the machine learning model, the intermediate representation, the learning parameters, and the computing resource requirement being determined based on an original code of the machine learning model, the intermediate representation being irrelevant to a programming language of the original code; determining, at least based on the computing resource requirement, a computing node and a parameter storage node for executing the machine learning model; storing the learning parameters in the parameter storage node; and sending the intermediate representation to the computing node for executing the machine learning model with the stored learning parameters.

First claim

What is claimed is:

1. A method of deploying a machine learning model, comprising:
receiving a unified intermediate representation indicating processing of a machine learning model, learning parameters of the machine learning model, and a computing resource requirement for executing the machine learning model, the unified intermediate representation, the learning parameters, and the computing resource requirement being determined based on an original code of the machine learning model, the unified intermediate representation being a compilation of original code written in different programming languages of a plurality of machine learning models, the compilation of the original code being independent of the different programming languages;
determining, at least based on the computing resource requirement, a computing node and a parameter storage node for executing the machine learning model;
storing the learning parameters in the parameter storage node; and
sending the unified intermediate representation to the computing node for executing the machine learning model with the stored learning parameters.

2. The method according to claim 1 , wherein the computing resource requirement comprises at least one of the following:
a type of a device for executing the machine learning model,
a size of a storage space required for executing the machine learning model,
the number of threads required for executing the machine learning model,
a network bandwidth required for executing the machine learning model, and
the number of computation processing unit kernels required for executing the machine learning model; and
wherein the computing resource requirement is determined based on compiling of the original code.

3. The method according to claim 1 , wherein the learning parameters are trained machine learning model parameters.

4. The method according to claim 1 , wherein the learning parameters are obtained by randomly generating intermediate parameters during compiling of the original code, and training the intermediate parameters.

5. The method according to claim 1 , further comprising:
receiving training data for training the machine learning model; and
loading the training data into a training data storage node.

6. The method according to claim 1 , wherein the unified intermediate representation comprises a computing graph and a corresponding runtime library, the computing graph being described by a structured text.

7. The method according to claim 1 , further comprising:
receiving a parallel mode for executing the machine learning model, the parallel mode being one of a data parallel mode and a model parallel mode; and
causing the computing node to execute the machine learning model in the parallel mode.

8. A device for deploying a machine learning model, comprising:
at least one processing unit; and
at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the device to perform acts comprising:
receiving a unified intermediate representation indicating processing of a machine learning model, learning parameters of the machine learning model, and a computing resource requirement for executing the machine learning model, the unified intermediate representation, the learning parameters, and the computing resource requirement being determined based on an original code of the machine learning model, the unified intermediate representation being a compilation of original code written in different programming languages of a plurality of machine learning models, the compilation of the original code being independent of the different programming languages;
determining, at least based on the computing resource requirement, a computing node and a parameter storage node for executing the machine learning model;
storing the learning parameters in the parameter storage node; and
sending the unified intermediate representation to the computing node for executing the machine learning model with the stored learning parameters.

9. The device according to claim 8 , wherein the computing resource requirement comprises at least one of the following:
a type of a device for executing the machine learning model,
a size of a storage space required for executing the machine learning model,
the number of threads required for executing the machine learning model,
a network bandwidth required for executing the machine learning model, and
the number of computation processing unit kernels required for executing the machine learning model; and
wherein the computing resource requirement is determined based on compiling of the original code.

10. The device according to claim 8 , wherein the learning parameters are trained machine learning model parameters.

11. The device according to claim 8 wherein the learning parameters are obtained by randomly generating intermediate parameters during compiling of the original code, and training the intermediate parameters.

12. The device according to claim 8 , the acts further comprising:
receiving training data for training the machine learning model; and
loading the training data into a training data storage node.

13. The device according to claim 8 , wherein the unified intermediate representation comprises a computing graph and a corresponding runtime library, the computing graph being described by a structured text.

14. The device according to claim 8 , wherein the acts further comprise:
receiving a parallel mode for executing the machine learning model, the parallel mode being one of a data parallel mode and a model parallel mode; and
causing the computing node to execute the machine learning model in the parallel mode.

15. A computer program product being stored in a non-transitory computer storage medium and comprising machine-executable instructions which, when executed by a device, cause the device to perform a method of deploying a machine learning model, the method comprising:
receiving a unified intermediate representation indicating processing of a machine learning model, learning parameters of the machine learning model, and a computing resource requirement for executing the machine learning model, the unified intermediate representation, the learning parameters, and the computing resource requirement being determined based on an original code of the machine learning model, the unified intermediate representation being a compilation of original code written in different programming languages of a plurality of machine learning models, the compilation of the original code being independent of the different programming languages;
determining, at least based on the computing resource requirement, a computing node and a parameter storage node for executing the machine learning model;
storing the learning parameters in the parameter storage node; and
sending the unified intermediate representation to the computing node for executing the machine learning model with the stored learning parameters.

16. The computer program product according to claim 15 , wherein the computing resource requirement comprises at least one of the following:
a type of a device for executing the machine learning model,
a size of a storage space required for executing the machine learning model,
the number of threads required for executing the machine learning model,
a network bandwidth required for executing the machine learning model, and
the number of computation processing unit kernels required for exe

Assignees

• Emc Ip Holding Co Llc

Inventors

• Liu Jinpeng
• Wu Pengfei
• Zhao Junping
• Wang Kun

Classifications

• G06N20/00 Primary

  Machine learning · CPC title

• G06N20/10 Primary

  using kernel methods, e.g. support vector machines [SVM] · CPC title

• G06F8/60

  Software deployment · CPC title

• G06F8/41

  Compilation · CPC title

• G06F8/447

  Target code generation · CPC title