Using machine-learning large language models to perform smart order updates

Patent metadata

Field	Value
Publication number	US-2025191051-A1
Application number	US-202418972522-A
Country	US
Kind code	A1
Filing date	Dec 6, 2024
Priority date	Dec 7, 2023
Publication date	Jun 12, 2025
Grant date	—

Abstract

An online system includes an interface which facilitates communication between customers and pickers who are servicing the user's order. The customer may request a modification to their order through the interface. The online system performs an inference task in conjunction with the model serving system or the interface system to continuously monitor conversations between users and pickers to infer whether a customer requested to modify their order to maintain an updated order and an updated in-store transaction estimate for the order. The online system determines if the order has been updated to account for the requested changes. If the order has not been updated, the online system automatically updates the customer's order and computes an updated in-store transaction estimate based on the changes made.

First claim

What is claimed is:

1 . A method comprising:
receiving, from one or more client devices, one or more messages from a conversation sent from a sending party to a receiving party, the one or more messages associated with an order; generating a prompt for input to a machine-learning language model, the prompt specifying at least the one or more messages, order data of the order, and a request to infer whether the one or more messages includes a request to modify the order; parsing a response to extract data associated with the request to modify the order based on the one or more messages, the data including one or more modified items and a quantity of the one or more modified items; identifying, based on the order data, whether the order was updated to incorporate the one or more modified items; and responsive to identifying that the order was not updated to incorporate the one or more modified items:
identifying a cost of each of the one or more modified items in the order,
generating, based on the cost of each of the one or more modified items in the order, an updated estimate for the order, and
updating the order data to reflect the updated estimate.

2 . The method of claim 1 , further comprising:
transmitting instructions to a picker device to cause display of a user interface that presents one or more of: the one or more modified items or the updated estimate of the order; and responsive to identifying that a cost for the order corresponds to the updated estimate for the order, approving checkout of the order.

3 . The method of claim 2 , wherein the user interface presents a removing item container indicating an item to be replaced in the order and a replacing item container indicating a replacement item to replace the item in the order.

4 . The method of claim 1 , generating the updated estimate for the order further comprises:
generating a total cost of the order including the cost of the one or more modified items and remaining items in the order; generating a buffer amount for the order, wherein the buffer amount is an amount to be added or subtracted from the total cost; and combining the total cost of the order and the buffer amount to generate the updated estimate for the order.

5 . The method of claim 1 , wherein generating the updated estimate for the order further comprises:
obtaining a plurality of orders, wherein the plurality of orders has been fulfilled; for each order in the plurality of orders:
obtaining a cost for the order when a respective user submitted the order to an online system,
obtaining a fulfilled cost for the order that was billed to the respective user, and
identifying a difference between the fulfilled cost and the cost for the order when the respective user submitted the order; and
selecting the order for analysis responsive to identifying that the difference for the order is above a threshold.

6 . The method of claim 5 , further comprising:
identifying whether the updated estimate of the order is within a threshold difference with the fulfilled cost for the order; and responsive to identifying that the updated estimate is not within the threshold difference, providing the order for review.

7 . The method of claim 1 , further comprising:
verifying that the response generated by the machine-learning language model is accurate responsive to receiving an indication from a client device confirming the updated estimate of the order; generating a training example including the prompt for the order and the response; and finetuning parameters of the machine-learning language model based on the training example.

8 . The method of claim 1 , wherein the one or more modified items are one or more additional items to the order or one or more replacement items for the order.

9 . The method of claim 1 , further comprising responsive to identifying that the order was updated to incorporate the one or more modified items, transmitting instructions to a picker device to cause display of a user interface that presents an estimate for the order.

10 . A non-transitory computer-readable medium storing instructions that, when executed by a computer processor, cause the computer processor to perform operations comprising:
receiving, from one or more client devices, one or more messages from a conversation sent from a sending party to a receiving party, the one or more messages associated with an order; generating a prompt for input to a machine-learning language model, the prompt specifying at least the one or more messages, order data of the order, and a request to infer whether the one or more messages includes a request to modify the order; parsing a response to extract data associated with the request to modify the order based on the one or more messages, the data including one or more modified items and a quantity of the one or more modified items; identifying, based on the order data, whether the order was updated to incorporate the one or more modified items; and responsive to identifying that the order was not updated to incorporate the one or more modified items:
identifying a cost of each of the one or more modified items in the order,
generating, based on the cost of each of the one or more modified items in the order, an updated estimate for the order, and
updating, the order data to reflect the updated estimate.

11 . The non-transitory computer-readable medium of claim 10 , the operations further comprising:
transmitting instructions to a picker device to cause display of a user interface that presents one or more of: the one or more modified items or the updated estimate of the order; and responsive to identifying that a cost for the order corresponds to the updated estimate for the order, approving checkout of the order.

12 . The non-transitory computer-readable medium of claim 11 , wherein the user interface displays a removing item container indicating an item to be replace in the order and a replacing item container indicating a replacement item to replace the item in the order.

13 . The non-transitory computer-readable medium of claim 10 , wherein generating the updated estimate for the order further comprises:
generating, a total cost of the order including the cost of the one or more modified items and remaining items in the order; generating, a buffer amount for the order, wherein the buffer amount is an amount to be added or subtracted from the total cost; and combining, the total cost of the order and the buffer amount to generate the updated estimate for the order.

14 . The non-transitory computer-readable medium of claim 10 , wherein generating the updated estimate for the order further comprises:
obtaining, a plurality of orders wherein the plurality of orders has been fulfilled; for each order in the plurality of orders:
obtaining a cost for the order when respective user submitted the order to an online system,
obtaining a fulfilled cost for the order that was billed to the respective user,
identifying a difference between the fulfilled cost and the cost for the order when the respective user submitted the order, and
selecting, the order for analysis responsive to identifying that the difference for the order is above a threshold.

15 . The non-transitory computer-readable medium of claim 14 , wherein generating the updated estimate for the order further comprises:
identifying, whether the updated estimate of the order is within a threshold difference with the fulfilled cost for the order; and responsive to identifying that the updated estimate is not within the threshold differe

Assignees

• Maplebear Inc

Inventors

• Riso Rebecca
• Knight Benjamin
• Sanchez Kenneth Jason
• Negrin Matthew
• Yin Licheng
• Billman Christopher

Classifications

• G06Q30/0633 Primary

  Managing shopping lists, e.g. compiling or processing purchase lists (shipping orders G06Q10/083; order filling G06Q10/087) · CPC title

• G06Q30/0283 Primary

  Price estimation or determination · CPC title