Systems and methods to manage feedback for a multi-arm bandit algorithm

Patent metadata

Field	Value
Publication number	US-2022156784-A1
Application number	US-202017133050-A
Country	US
Kind code	A1
Filing date	Dec 23, 2020
Priority date	Dec 4, 2019
Publication date	May 19, 2022
Grant date	—

Abstract

Systems and methods for managing feedback for a multi-ARM bandit algorithm are disclosed. For example, the system may include one or more memory units storing instructions and one or more processors configured to execute the instructions to perform operations. The operations may include sending, to a device, a creative configured for display on the device. The operations may include receiving, from the device, feedback data associated with the creative, wherein the feedback data indicates a degree of user interaction with the creative. The operations may include checking the feedback data for a baked time associated with the creative. The operations may include sending the feedback data to a node based on the baked time. The operations may include updating, by the node, a model associated with the feedback data.

First claim

1 - 20 . (canceled)

21 . A computer cluster, comprising:
at least one computer cluster including at least one computing node, wherein the at least one computing node comprises: an interface database containing a plurality of graphical user interfaces (GUIs), the plurality of GUIs including a creation interface, an editor interface, an upload interface, a plurality of approval interfaces, one or more preview interfaces, and one or more save interfaces; a self-serve tool in data communication with the interface database and configured to be accessed by a user through a portal, the self-server tool comprising one or more of the plurality of GUIs and provide the one or more of the plurality of GUIs for the user upon receipt of an input by the user through the portal; a multi-armed bandit application programming interface (API) in data communication with the self-serve tool, the multi-armed bandit engine API comprising rules for analyzing creatives published by the self-server tool and for determining a winning creative from the creatives; and a listener continually or periodically polling feedback data of the creatives for processing by the multi-armed bandit API, and wherein:
the self-server tool is configured to send, to a device, a creative configured for display on the device,
the multi-armed bandit API is configured to receive, from the device, feedback data associated with the creative, the feedback data indicating a degree of user interaction with the creative,
the multi-armed bandit API is configured to check the feedback data for a baked time associated with the creative. the baked time being a time when an age of the feedback data is equal to or greater than a delay time associated with the feedback data,
the listener is configured to detect the feedback data based on the baked time,
the multi-armed bandit API is configured to process the feedback data by comparing the feedback data to one or more performance criteria of the creative upon the feedback data being detected by the listener, and
the multi-armed bandit API is configured to be dynamically updated based on the processing of the feedback data.

Assignees

• Capital One Services Llc

Inventors

• Patel Gunjan
• Konduru Anil
• Kulkarni Kirankumar

Classifications

• G06Q30/0243 Primary

  Comparative campaigns · CPC title

• G06Q30/0244 Primary

  Optimization · CPC title

• G06F18/2185

  the supervisor being an automated module, e.g. intelligent oracle · CPC title

• G06N7/01

  Probabilistic graphical models, e.g. probabilistic networks · CPC title

• G06Q30/0272

  Period of advertisement exposure · CPC title