Visual programming platform featuring machine learning for automated code development

Patent metadata

Field	Value
Publication number	US-12578934-B2
Application number	US-202318468025-A
Country	US
Kind code	B2
Filing date	Sep 15, 2023
Priority date	Sep 15, 2023
Publication date	Mar 17, 2026
Grant date	Mar 17, 2026

Abstract

A visual programming platform can leverage a machine learning-based coding system to generate an initial set of programming-language code for further graphical editing by a human user. As an example, the visual programming platform can obtain a natural language description of a task to be performed by a computational pipeline. The visual programming platform can process the natural language description of the task with a machine learning coding system that includes one or more machine-learned models to generate, as an output of the machine learning coding system, a set of pseudocode that describes performance of the task. The platform can process the set of pseudocode that describes performance of the task with a compiler to generate a set of programming-language code that defines the computational pipeline for performing the task. The visual programming platform can generate a graphical visualization of the computational pipeline defined by the set of programming-language code.

First claim

What is claimed is:

1 . A visual programming platform that enables the graphical development of software code, the visual programming platform comprising one or more processors, the visual programming platform configured to perform operations, the operations comprising:
obtaining a natural language description of a task to be performed by a computational pipeline; processing the natural language description of the task with a machine learning coding system comprising one or more machine-learned models to generate, as an output of the machine learning coding system, a set of pseudocode that describes performance of the task; processing the set of pseudocode that describes performance of the task with a compiler to generate a set of programming-language code that defines the computational pipeline for performing the task; generating a graphical visualization of the computational pipeline defined by the set of programming-language code; and providing the graphical visualization of the computational pipeline for display in an interactive user interface that enables a human user to edit the graphical visualization to modify the set of programming-language code.

2 . The visual programming platform of claim 1 , wherein the machine learning coding system comprises one or more large language models.

3 . The visual programming platform of claim 1 , wherein the machine learning coding system comprises a machine-learned pseudocode drafting model configured to process the natural language description of the task to generate the set of pseudocode that describes performance of the task.

4 . The visual programming platform of claim 3 , wherein the machine learning coding system comprises a machine-learned node selection model configured to process the natural language description of the task to select one or more selected nodes from a library of nodes, wherein the one or more selected nodes are identified to the machine-learned pseudocode drafting model.

5 . The visual programming platform of claim 4 , wherein the one or more selected nodes are identified in a prompt supplied to the machine-learned pseudocode drafting model.

6 . The visual programming platform of claim 5 , wherein the prompt comprises a few-shot prompt that provides one or more examples of pseudocode output.

7 . The visual programming platform of claim 1 , wherein the natural language description of the task to be performed by the computational pipeline is input by the human user.

8 . The visual programming platform of claim 1 , wherein the computational pipeline comprises a machine learning pipeline that executes one or more machine learning models to process a pipeline input to generate a pipeline output.

9 . The visual programming platform of claim 1 , wherein the graphical visualization of the computational pipeline comprises an editable node-graph.

10 . A computer-implemented method for finetuning a sequence processing model to perform a pseudocode drafting task, the method comprising:
obtaining, by a computing system comprising one or more computing devices, a training tuple, the training tuple comprising a natural language description of a computational pipeline and a set of programming-language code that defines the computational pipeline; decompiling, by the computing system, the set of programming-language code to generate a set of ground truth pseudocode; processing, by the computing system, the natural language description of the computational pipeline with the sequence processing model to generate a set of predicted pseudocode; evaluating, by the computing system, a loss function that compares the set of predicted pseudocode with the set of ground truth pseudocode; and modifying, by the computing system, one or more values of one or more parameters of the sequence processing model based on the loss function.

11 . The computer-implemented method of claim 10 , wherein the natural language description was generated by a human.

12 . The computer-implemented method of claim 10 , wherein the natural language description was generated by a machine learning model.

13 . The computer-implemented method of claim 10 , wherein decompiling, by the computing system, the set of programming-language code to generate a set of ground truth pseudocode comprises applying, by the computing system, a set of inverse compiling rules to the set of programming-language code.

14 . The computer-implemented method of claim 10 , wherein the loss function evaluates whether the set of predicted pseudocode contains the same number, type, or sequence of nodes as the set of ground truth pseudocode.

15 . One or more non-transitory computer-readable media that store computer-executable instructions that, when executed, cause a computing system to perform operations, the operations comprising:
obtaining a natural language description of a task to be performed by a computational pipeline; processing the natural language description of the task with a machine learning coding system comprising one or more machine-learned models to generate, as an output of the machine learning coding system, a set of pseudocode that describes performance of the task; processing the set of pseudocode that describes performance of the task with a compiler to generate a set of programming-language code that defines the computational pipeline for performing the task; generating a graphical visualization of the computational pipeline defined by the set of programming-language code; and providing the graphical visualization of the computational pipeline for display in an interactive user interface that enables a human user to edit the graphical visualization to modify the set of programming-language code.

16 . The one or more non-transitory computer-readable media of claim 15 , wherein the machine learning coding system comprises one or more large language models.

17 . The one or more non-transitory computer-readable media of claim 15 , wherein the machine learning coding system comprises a machine-learned pseudocode drafting model configured to process the natural language description of the task to generate the set of pseudocode that describes performance of the task.

18 . The one or more non-transitory computer-readable media of claim 17 , wherein the machine learning coding system comprises a machine-learned node selection model configured to process the natural language description of the task to select one or more selected nodes from a library of nodes, wherein the one or more selected nodes are identified to the machine-learned pseudocode drafting model.

19 . The one or more non-transitory computer-readable media of claim 18 , wherein the one or more selected nodes are identified in a prompt supplied to the machine-learned pseudocode drafting model.

20 . The one or more non-transitory computer-readable media of claim 19 , wherein the prompt comprises a few-shot prompt that provides one or more examples of pseudocode output.

Assignees

• Google Llc

Inventors

• Du Ruofei
• Zhou Zhongyi

Classifications

• G06F8/33 Primary

  Intelligent editors · CPC title

• G06F8/34 Primary

  Graphical or visual programming · CPC title