Systems and methods for checking and confirming the purchase of merchandise items

Patent metadata

Field	Value
Publication number	US-12002080-B2
Application number	US-202017775414-A
Country	US
Kind code	B2
Filing date	Nov 12, 2020
Priority date	Nov 12, 2019
Publication date	Jun 4, 2024
Grant date	Jun 4, 2024

Abstract

There are provided systems and methods relating to checking and confirming merchandise purchased at shopping facilities. In one form, the system includes: a shopping cart containing merchandise items to be purchased; a sales transaction database; a point-of-sales system that creates transaction records identified by transaction identifiers; and a mobile device used by an employee that includes a sensor to scan a paper or digital receipt to obtain the transaction identifier and a camera to capture images of the items in the shopping cart. The system also includes a control circuit that receives the transaction identifier, accesses the database using the identifier to determine the purchased items; analyzes the images of the merchandise items in the shopping cart and creates a computer vision receipt listing detected items; compares the purchased items with the detected items; and takes an action if there is a discrepancy.

First claim

What is claimed is:

1. A system for checking and confirming the purchase of merchandise at shopping facilities, the system comprising:
a shopping cart containing a plurality of merchandise items that are to be purchased by a customer at a shopping facility;
a sales transaction database configured to store electronic transaction records involving the sales of one or more merchandise items at the shopping facility;
a point-of-sales system that records a sales transaction of the plurality of merchandise items and that generates a barcode or QR code on a paper or digital receipt corresponding to the sales transaction, the point-of-sales system creating an electronic transaction record identified by the barcode or QR code, the electronic transaction record being stored in the sales transaction database;
a mobile electronics device comprising:
a barcode or QR code scanner; and
a camera configured to capture an image sequence of the merchandise items in the shopping cart;
a control circuit at the mobile electronics device configured to:
receive the barcode or QR code;
access the sales transaction database using the barcode or QR code to determine the purchased merchandise items;
analyze the image sequence of the merchandise items in the shopping cart using a computer vision algorithm to identify the merchandise items based on the image sequence and create a computer vision receipt listing the merchandise items identified from the image sequence;
compare the purchased merchandise items indicated by the barcode or QR code on the paper or digital receipt with the identified merchandise items from the computer vision receipt, and determine a discrepancy; and
cause to display on the mobile electronics device the discrepancy, the display including one or both of a list of unpaid items or images of unpaid items; and

an automated vehicle configured to receive a control signal for retrieving an unpaid merchandise item.

2. The system of claim 1 , wherein the control circuit analyzes the image sequence using one or more convolutional neural networks (CNNs).

3. The system of claim 1 , further comprising one or more checkout stations in the shopping facility, the one or more checkout stations configured for at least one of checkout by a cashier and self-checkout by the customer, the point-of-sales system comprising a point-of-sales device being located at the one or more checkout stations.

4. The system of claim 1 , further comprising:
a mobile electronics device of the customer used to purchase the merchandise items and configured to display a digital receipt at the mobile electronics device following purchase of the merchandise items.

5. The system of claim 4 , further comprising an application provided by a retailer and downloaded by the customer to the customer's mobile electronics device for purchase of merchandise at shopping facilities using the customer's mobile electronics device.

6. A method for checking and confirming the purchase of merchandise at shopping facilities, the method comprising:
providing a shopping cart, the shopping cart containing a plurality of merchandise items that are to be purchased by a customer at a shopping facility;
providing a sales transaction database configured to store electronic transaction records involving the sales of one or more merchandise items at the shopping facility;
providing a point-of-sales system that records a sales transaction of the plurality of merchandise items and that generates a barcode or QR code on a paper or digital receipt corresponding to the sales transaction, the point-of-sales system creating an electronic transaction record identified by the barcode or QR code, the electronic transaction record being stored in the sales transaction database;
providing a mobile electronics device including a barcode or QR code scanner and a camera configured to capture an image sequence of the merchandise items in the shopping cart;
by a control circuit at the mobile electronics device:
receiving the barcode or QR code;
accessing the sales transaction database using the barcode or QR code to determine the purchased merchandise items;
analyzing the image sequence of the merchandise items in the shopping cart using a computer vision algorithm to identify the merchandise items based on the image sequence and create a computer vision receipt listing the merchandise items identified from the image sequence;
comparing the purchased merchandise items indicated by the barcode or QR code on the paper or digital receipt with the identified merchandise items from the computer vision receipt, and determine a discrepancy; and
causing to display on the mobile electronics device the discrepancy, the display including one or both of a list of unpaid items or images of unpaid items; and

receiving, by an automated vehicle, a control signal for retrieving an unpaid merchandise item.

7. The method of claim 6 , wherein the control circuit analyzes the image sequence using one or more convolutional neural networks (CNNs).

8. The method of claim 6 , further comprising providing one or more checkout stations in the shopping facility, the one or more checkout stations configured for at least one of checkout by a cashier and self-checkout by the customer, the point-of-sales system comprising a point-of-sales device being located at the one or more checkout stations.

9. The method of claim 6 , further comprising:
by a mobile electronics device of the customer, purchasing the merchandise items and displaying a digital receipt at the mobile electronics device following purchase of the merchandise items.

10. The method of claim 9 , further comprising providing an application for download by the customer to the customer's mobile electronics device for purchase of merchandise at shopping facilities using the customer's mobile electronics device.

11. A system for checking and confirming the purchase of merchandise at shopping facilities, the system comprising:
a shopping cart containing a plurality of merchandise items that are to be purchased by a customer at a shopping facility;
a sales transaction database configured to store electronic transaction records involving the sales of one or more merchandise items at the shopping facility;
a point-of-sales system that records a sales transaction of the plurality of merchandise items and that generates a barcode or QR code on a paper or digital receipt corresponding to the sales transaction, the point-of-sales system creating an electronic transaction record identified by the barcode or QR code, the electronic transaction record being stored in the sales transaction database;
a mobile electronics device comprising:
a barcode or QR code scanner;
a camera configured to capture an image sequence of the merchandise items in the shopping cart; and
a local control circuit configured to:
receive the barcode or QR code;
analyze the image sequence of the merchandise items in the shopping cart using a computer vision algorithm to identify the merchandise items based on the image sequence and create a computer vision receipt listing the merchandise items identified from the image sequence;
transmit the barcode or QR code and the computer vision receipt;

a central control circuit configured to:
access the sales transaction database using the barcode or QR code to determine the purchased merchandise items;
compare the purchased merchandise items indicated by the barcode or QR code on the paper or digital receipt with the identified merchandise items from the computer vision receipt, and determine a discrepancy; and
cause to display on the mobile electronics device the discrepancy, the display including one or bo

Assignees

• Walmart Apollo Llc

Inventors

• Xiao Zhichun
• Zhang Lingfeng
• Liu Yao
• Hammer Jon
• Tang Yutao
• Fang Sicong
• Liu Haining
• Sun Yijing
• Yuan Mingquan
• Zhang Shouyi
• Yu Pingjian
• Reagan Ryan B
• Mao Tianyi
• Ravichandran Susseelaa Shangeetha
• Wang Zhenyu
• Zhu Feiyun

Classifications

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06Q30/0629 Primary

  by pre-processing results, e.g. ranking or ordering results · CPC title

• G06Q20/209

  Specified transaction journal output feature, e.g. printed receipt or voice output · CPC title

• G06Q30/0633

  Managing shopping lists, e.g. compiling or processing purchase lists (shipping orders G06Q10/083; order filling G06Q10/087) · CPC title

• G06Q30/06 Primary

  Buying, selling or leasing transactions · CPC title