Processing of machine learning modeling data to improve accuracy of categorization

Patent metadata

Field	Value
Publication number	US-12566997-B2
Application number	US-202117798152-A
Country	US
Kind code	B2
Filing date	Apr 9, 2021
Priority date	Apr 9, 2021
Publication date	Mar 3, 2026
Grant date	Mar 3, 2026

Abstract

A first multi-party computation (MPC) system of an MPC cluster can receive, from an application on a client device, an inference request comprising a first share of a given user profile for a user of the application and a performance threshold. A set of nearest neighbors to the user profile can be identified by performing a secure MPC process using a trained machine learning model in collaboration with one or more second MPC systems. One or more nearest neighbors having a performance measure that satisfies the performance threshold can be selected from the set of nearest neighbors. The first MPC system can transmit data derived from the one or more nearest neighbors to the application.

First claim

The invention claimed is:

1 . A method comprising:
detecting user interactions and events for multiple digital components based on data received from client devices of users; determining performance measures for the multiple digital components based on the detected user interactions and events; receiving, by a first multi-party computation (MPC) system of an MPC cluster and from an application on a client device, an inference request comprising a first share of a given user profile for a user of the application and a performance threshold; executing, by the first MPC system, a trained machine learning model using a secure MPC process in collaboration with one or more second MPC systems, wherein the first MPC system and the one or more second MPC systems perform machine learning computations using secret shares of data according to a secure MPC protocol; obtaining, by the first MPC system and as an output of the trained machine learning model, data identifying a first share of a set of nearest neighbors to the user profile; selecting, from the set of nearest neighbors, one or more nearest neighbors having a performance measure that satisfies the performance threshold, wherein the performance measure of each nearest neighbor comprises at least one of (i) a user interaction rate that indicates a rate at which users interact with one or more digital components when the one or more digital components are presented to the users or (ii) a conversion rate that indicates a rate at which the users perform a specified action after the one or more digital components are presented to the users; and transmitting, by the first MPC system, data derived from the one or more nearest neighbors to the application, wherein the data derived from the one or more nearest neighbors to the application comprises a first share of a label identifying one or more user interest groups corresponding to each of the one or more digital components.

2 . The method of claim 1 , wherein the user profile is generated by the application, wherein the user profile comprises data indicative of interactions between a user of the application and digital content rendered on the application, wherein the interactions comprise conversions and lack of conversions.

3 . The method of claim 1 , wherein the machine learning model is a nearest neighbors model, wherein nearest neighbors of the nearest neighbors model are represented by respective centroids associated with corresponding user groups.

4 . The method of claim 3 , wherein the first MPC system allocates a weight to each user of the corresponding user groups to compute a respective centroid, wherein the weight is based on at least one of interactions by the user or user information related to the performance measure.

5 . The method of claim 4 , wherein a centroid for each user group is a center, represented by an average, of user profiles for users that are members of the user group.

6 . The method of claim 1 , wherein the machine learning model is one or more of a centroid model or a nearest neighbors model.

7 . The method of claim 1 , wherein the machine learning model comprises a k-nearest neighbors model and each neighbor in the k-nearest neighbors model represents a user profile of a user.

8 . The method of claim 1 , wherein the machine learning model comprises a k-nearest neighbors model and each neighbor in the k-nearest neighbors model represents a user group for a plurality of users.

9 . The method of claim 1 , wherein the performance threshold is a threshold value, wherein each conversion rate for the one or more digital components is a number of conversions divided by a number of times the one or more digital components were displayed to users in a user group, wherein the inference request is a request to infer whether the user is to be added to a user group.

10 . The method of claim 1 , wherein each digital component of the one or more digital components corresponds to a user interest group and each nearest neighbor comprises a respective performance measure for a digital components corresponding to each user interest group to which a user corresponding to the nearest neighbor is assigned.

11 . The method of claim 1 , wherein the client device is configured to:
identify the one or more user interest groups by combining the first share of the label with one or more second shares of the label received from the one or more second MPC systems; and add the user of the client device to each of the one or more user interest groups.

12 . A system comprising:
at least one programmable processor; and a machine-readable medium storing instructions that, when executed by the at least one programmable processor, cause the at least one programmable processor to perform operations comprising:
detecting user interactions and events for multiple digital components based on data received from client devices of users;
determining performance measures for the multiple digital components based on the detected user interactions and events;
receiving, by a first multi-party computation (MPC) system of an MPC cluster and from an application on a client device, an inference request comprising a first share of a given user profile for a user of the application and a performance threshold;
executing, by the first MPC system, a trained machine learning model using a secure MPC process in collaboration with one or more second MPC systems, wherein the first MPC system and the one or more second MPC systems perform machine learning computations using secret shares of data according to a secure MPC protocol;
obtaining, by the first MPC system and as an output of the trained machine learning model, data identifying a first share of a set of nearest neighbors to the user profile;
selecting, from the set of nearest neighbors, one or more nearest neighbors having a performance measure that satisfies the performance threshold, wherein the performance measure of each nearest neighbor comprises at least one of (i) a user interaction rate that indicates a rate at which users interact with one or more digital components when the one or more digital components are presented to the users or (ii) a conversion rate that indicates a rate at which the users perform a specified action after the one or more digital components are presented to the users; and
transmitting, by the first MPC system, data derived from the one or more nearest neighbors to the application, wherein the data derived from the one or more nearest neighbors to the application comprises a first share of a label identifying one or more user interest groups corresponding to each of the one or more digital components.

13 . The system of claim 12 , wherein the user profile is generated by the application, wherein the user profile comprises data indicative of interactions between a user of the application and digital content rendered on the application, wherein the interactions comprise conversions and lack of conversions.

14 . The system of claim 12 , wherein the machine learning model is a nearest neighbors model, wherein nearest neighbors of the nearest neighbors model are represented by respective centroids associated with corresponding user groups.

15 . The system of claim 14 , wherein the first MPC system allocates a weight to each user of the corresponding user groups to compute a respective centroid, wherein the weight is based on at least one of interactions by the user or user information related to the performance measure.

16 . The system of claim 15 , wherein a centroid for each user group is a center, represe

Assignees

• Google Llc

Inventors

• Mauser Arne
• Wang Gang

Classifications

• G06F16/9535

  Search customisation based on user profiles and personalisation · CPC title

• G06N5/04

  Inference or reasoning models · CPC title

• G06N20/00 Primary

  Machine learning · CPC title

• H04W12/02

  Protecting privacy or anonymity, e.g. protecting personally identifiable information [PII] · CPC title

• H04L67/306

  User profiles · CPC title