Using shopping lists to resolve ambiguities in visual product recognition

Patent metadata

Field	Value
Publication number	US-12417486-B2
Application number	US-202418659497-A
Country	US
Kind code	B2
Filing date	May 9, 2024
Priority date	Oct 13, 2020
Publication date	Sep 16, 2025
Grant date	Sep 16, 2025

Abstract

A method for using an electronic shopping list to resolve ambiguity associated with a selected product may include accessing an electronic shopping list associated with a customer of a retail store; receiving image data captured using one or more image sensors in the retail store; analyzing the image data to detect a product selection event involving a shopper; identifying a product associated with the detected product selection event based on analysis of the image data and further based on the electronic shopping list; and based on the identification of the product, updating a virtual shopping cart associated with the shopper.

First claim

The invention claimed is:

1. A non-transitory computer-readable medium including instructions that when executed by at least one processor cause the at least one processor to perform a method for using an electronic shopping list to resolve ambiguity associated with a selected product, the method comprising:
accessing an electronic shopping list associated with a customer of a retail store;
receiving image data captured using one or more image sensors in the retail store;
analyzing the image data to detect a product selection event involving a shopper;
identifying a product associated with the detected product selection event based on analysis of the image data and further based on the electronic shopping list;
based on the identification of the product, updating a virtual shopping cart associated with the shopper;
determining an indicator of a confidence level associated with the identification of the product; and
maintaining a friction shopping eligibility status for the shopper if the indicator of the confidence level is above a predetermined threshold, wherein the predetermined threshold varies based on product type.

2. The non-transitory computer-readable medium of claim 1 , wherein the electronic shopping list is generated by the customer.

3. The non-transitory computer-readable medium of claim 2 , wherein the customer is also the shopper.

4. The non-transitory computer-readable medium of claim 1 , wherein the electronic shopping list is automatically generated based on the customer's shopping history in the retail store.

5. The non-transitory computer-readable medium of claim 1 , wherein the shopper is a proxy for the customer and shops for the customer based on the electronic shopping list.

6. The non-transitory computer-readable medium of claim 5 , wherein the shopper is a robot.

7. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises automatically updating the electronic shopping list to indicate that the product from the electronic shopping list has been selected.

8. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises: accessing inventory information associated with the retail store and further basing the identification of the product on the inventory information.

9. The non-transitory computer-readable medium of claim 1 , wherein the electronic shopping list includes ranking information associated with the customer's past purchases of products of a particular product type group.

10. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises: accessing inventory information associated with the retail store; and updating the electronic shopping list based on the inventory information; and further basing the identification of the product on the updated electronic shopping list.

11. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises: analyzing the image data to determine a location of the shopper during the product selection event; and further basing the identification of the product on the determined location of the shopper.

12. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises: accessing planogram information indicative of a desired placement of products on shelves of the retail store; and further basing the identification of the product on the planogram information.

13. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises: receiving product affinity information associated with the customer; and further basing the identification of the product on the product affinity information of the customer.

14. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises in response to identification of the product, maintaining a frictionless shopping eligibility status associated with the shopper.

15. The non-transitory computer-readable medium of claim 1 , wherein the shopper is associated with a plurality of different electronic shopping lists, and wherein the method further comprises: analyzing the image data to select the electronic shopping list from the plurality of different electronic shopping lists, the electronic shopping list corresponds to the detected product selection event.

16. The non-transitory computer-readable medium of claim 15 , wherein the selection of the electronic shopping list is based on a receptacle corresponding to the detected product selection event.

17. The non-transitory computer-readable medium of claim 15 , wherein the different electronic shopping lists corresponds to different customers.

18. A system for using an electronic shopping list to resolve ambiguity associated with a selected product, the system comprising:
at least one processing unit configured to:
access an electronic shopping list associated with a customer of a retail store;
receive image data captured using one or more image sensors in the retail store;
analyze the image data to detect a product selection event involving a shopper;
identify a product associated with the detected product selection event based on analysis of the image data and further based on the electronic shopping list;
based on the identification of the product, update a virtual shopping cart associated with the shopper;
determine an indicator of a confidence level associated with the identification of the product; and
maintain a friction shopping eligibility status for the shopper if the indicator of the confidence level is above a predetermined threshold, wherein the predetermined threshold varies based on product type.

19. A method for using an electronic shopping list to resolve ambiguity associated with a selected product, the method comprising:
accessing an electronic shopping list associated with a customer of a retail store;
receiving image data captured using one or more image sensors in the retail store;
analyzing the image data to detect a product selection event involving a shopper;
identifying a product associated with the detected product selection event based on analysis of the image data and further based on the electronic shopping list;
in response to based on the identification of the product, updating a virtual shopping cart associated with the shopper;
determining an indicator of a confidence level associated with the identification of the product; and
maintaining a friction shopping eligibility status for the shopper if the indicator of the confidence level is above a predetermined threshold, wherein the predetermined threshold varies based on product type.

Assignees

• Trax Technology Solutions Pte Ltd

Inventors

• Bronicki Youval
• Bendler Dan

Classifications

• G08B5/36

  using visible light sources · CPC title

• G07G1/0063

  with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration · CPC title

• G06Q30/0639

  Locating goods or services, e.g. based on physical position of the goods or services within a shopping facility · CPC title

• G06Q30/0633

  Managing shopping lists, e.g. compiling or processing purchase lists (shipping orders G06Q10/083; order filling G06Q10/087) · CPC title

• G06Q30/0623

  by investigating goods or services · CPC title