Graph-based feature engineering for machine learning models

Patent metadata

Field	Value
Publication number	US-12299037-B2
Application number	US-202217882350-A
Country	US
Kind code	B2
Filing date	Aug 5, 2022
Priority date	Aug 5, 2022
Publication date	May 13, 2025
Grant date	May 13, 2025

Abstract

Methods and systems are presented for assisting a user to identify and evaluate features for use in a machine learning model configured to perform a task. Based on graph data associated with a graph data structure, a user interface is provided on a device. Based on user inputs received via the user interface, a feature candidate for the machine learning model is determined. The feature candidate is associated with a particular way of traversing the graph data structure to obtain attribute values associated with one or more vertices and/or one or more edges in the graph data structure. Based on the attribute values, a value corresponding to the feature candidate can be calculated. The value can be used to evaluate the effectiveness of the feature candidate in performing the task. The feature candidate can then be incorporated into the machine learning model as one of the input features.

First claim

What is claimed is:

1. A system, comprising:
a non-transitory memory; and
one or more hardware processors coupled with the non-transitory memory and configured to read instructions from the non-transitory memory to cause the system to perform operations comprising:
providing, on a device, a user interface based on graph data associated with a graph, wherein the graph represents transactions conducted among a plurality of accounts with a service provider;
receiving, via the user interface, a user input indicating (i) a graph traversal route comprising a number of hops from a seed vertex in the graph and (ii) a calculation based on attributes associated with one or more vertices along the graph traversal route;
determining, based on the user input, a feature candidate for a machine learning model, wherein the feature candidate specifies the graph traversal route and the calculation;
configuring the machine learning model to use the feature candidate as an input feature to perform a task, wherein the configuring the machine learning model comprises (i) generating programming code in a graph query language that performs the graph traversal route and the calculation and (ii) incorporating the programming code into the machine learning model;
in response to receiving a request to perform the task associated with an account with the service provider, generating, using the programming code incorporated into the machine learning model, an input value corresponding to the input feature for the machine learning model, wherein the generating the input value comprises (i) identifying a set of vertices in the graph based on traversing the graph from a vertex representing the account according to the graph traversal route, and (ii) performing the calculation based on a plurality of attributes associated with the set of vertices; and
processing, by the machine learning model, the request based on the input value.

2. The system of claim 1 , wherein the operations further comprise:
modifying a structure of the machine learning model based on the input feature.

3. The system of claim 2 , wherein the machine learning model comprises an artificial neural network, and wherein the modifying the structure of the machine learning model comprises adding an input node to an input layer of the machine learning model.

4. The system of claim 3 , wherein the programming code is incorporated into the input node of the input layer of the machine learning model.

5. The system of claim 1 , wherein the operations further comprise:
performing a plurality of simulations on the feature candidate based on using different vertices in the graph as the seed vertex; and
determining a correlation between the feature candidate and the task based on simulation results from the performing.

6. The system of claim 5 , wherein the operations further comprise:
determining that the correlation exceeds a threshold, wherein the configuring the machine learning model to use the feature candidate as the input feature is in response to the determining that the correlation exceeds the threshold.

7. The system of claim 1 , wherein the operations further comprise obtaining an output from the machine learning model based on at least the input value.

8. A method, comprising:
receiving, by one or more hardware processors and via a user interface of a device, a user interaction with a graphical element representing at least a portion of a graph associated with a service provider, wherein the graph represents transactions conducted among a plurality of accounts with a service provider, and wherein the user interaction specifies (i) a traversal route comprising a number of hops from a seed vertex in the graph and (ii) a calculation based on attributes associated with one or more vertices along the traversal route;
determining, by the one or more hardware processors and based on the user interaction with the graphical element, a feature candidate for a machine learning model, wherein the feature candidate specifies the traversal route and the calculation;
configuring, by the one or more hardware processors, the machine learning model to use the feature candidate as an input feature to perform a task, wherein the configuring the machine learning model comprises (i) generating programming code that performs the graph traversal route and the calculation and (ii) incorporating the programming code into the machine learning model;
in response to receiving a request to perform the task associated with an account with the service provider, generating, using the programming code incorporated into the machine learning model, an input value corresponding to the input feature for the machine learning model, wherein the generating the input value comprises (i) identifying a set of vertices in the graph based on traversing the graph from a vertex representing the account according to the traversal route, and (ii) performing the calculation based on a plurality of attributes associated with the set of vertices; and
processing, by the machine learning model, the request based on the input value.

9. The method of claim 8 , wherein the calculation is based on at least one of a sum, an average, a maximum, a minimum, or a count.

10. The method of claim 8 , wherein the user interaction further specifies a type of edge to traverse from the seed vertex.

11. The method of claim 8 , further comprising:
obtaining an output from the machine learning model based on at least the input value.

12. The method of claim 11 , further comprising:
processing a transaction associated with the account with the service provider based on the output.

13. The method of claim 8 , further comprising:
modifying a structure of the machine learning model based on the input feature.

14. The method of claim 13 , wherein the machine learning model comprises an artificial neural network, and wherein the modifying the structure of the machine learning model comprises adding an input node to an input layer of the machine learning model.

15. A non-transitory machine-readable medium having stored thereon machine-readable instructions executable to cause a machine to perform operations comprising:
accessing, from a data storage, graph data associated with a graph, wherein the graph represents relationships among a plurality of user accounts with a service provider;
providing, on a device, a user interface based on the graph data;
receiving a user input via the user interface, wherein the user input is associated with (i) a graph traversal route comprising a number of hops from a seed vertex in the graph and (ii) a calculation based on attributes associated with one or more vertices along the graph traversal route;
determining, based on the user input, a feature candidate for a machine learning model, wherein the feature candidate specifies the graph traversal route and the calculation;
configuring the machine learning model to use the feature candidate as an input feature to perform a task, wherein the configuring the machine learning model comprises (i) generating programming code that performs the graph traversal route and the calculation and (ii) incorporating the programming code into the machine learning model;
in response to receiving a request to perform the task associated with a user account with the service provider, generating, using the programming code incorporated into the machine learning model, an input value corresponding to the input feature for the machine learning model, wherein the generating the input value comprises (i) identifying a set of vertices in the graph based on traversing the gr

Assignees

• Paypal Inc

Inventors

• Zhang Haoran
• Zhang Pengshan
• Guo Junshi
• Lian Changle
• Luan Xiaojun
• Zhang Xia
• Zhang Yu
• Fang Jiaxin

Classifications

• G06F16/2428

  Query predicate definition using graphical user interfaces, including menus and forms (G06F16/2423 takes precedence) · CPC title

• G06N20/20

  Ensemble learning · CPC title

• G06N5/01

  Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound · CPC title

• G06F16/9024 Primary

  Graphs; Linked lists (G06F16/9027 takes precedence) · CPC title

• G06N20/00 Primary

  Machine learning · CPC title