Capturing transaction context

Patent metadata

Field	Value
Publication number	US-11776268-B2
Application number	US-202117239103-A
Country	US
Kind code	B2
Filing date	Apr 23, 2021
Priority date	Jun 25, 2018
Publication date	Oct 3, 2023
Grant date	Oct 3, 2023

Abstract

Disclosed are systems and methods of capturing sensor data associated with a retail location. The systems and methods further include a point-of-sale device for processing customer transactions and generating an event trigger for capturing sensor data from one or more of the sensors at the retail location. In response to the event trigger, the systems and methods capture data from the one or more sensors at the retail location and provide access to the stored sensor data and event triggers via a user interface of the point-of-sale device for review of the stored sensor data and event trigger.

First claim

What is claimed is:

1. A method at a network element, the method comprising:
receiving a trigger from a portable point of sale terminal;
obtaining, at the network element, image data from at least one image capture device;
determining a location of the portable point of sale terminal based on analysis of appearance of the point of sale terminal in the image data;
correlating the location of the portable point of sale terminal with data from sensors associated with the network element; and
presenting the correlated data to a merchant.

2. The method of claim 1 , wherein the image data is obtained from the point of sales terminal.

3. The method of claim 1 , wherein the image data is obtained directly from the image capture device.

4. The method of claim 1 , wherein the location of the portable point of sale terminal is determined based on which image capture device from among the at least one image capture device includes a frame showing the portable point of sales terminal therein.

5. The method of claim 1 , wherein the trigger comprises at least one of:
a transaction at the portable point of sale terminal;
a motion sensor detecting motion at portable point of sale terminal;
a change in location data for the portable point of sale terminal;
a break in a wired connection to the portable point of sale terminal; or
a change in a camera image for a camera on the portable point of sale terminal.

6. The method of claim 1 , wherein the sensors associated with the network element include a plurality of cameras at a merchant location.

7. The method of claim 1 , wherein the correlating is based on at least one of:
a number of customers in a location of a store;
sales conversion statistics;
demographics information based on sales at the location;
value of merchandise sold;
traffic patterns at the location; or
information about shoppers at the location.

8. The method of claim 1 , further comprising:
limiting transaction types available at a subset of point of sales terminals based on the correlating.

9. The method of claim 1 , further comprising:
providing sales incentives or discounts to the portable point of sales terminal based on the correlating.

10. A network element comprising:
a processor; and
a communications interface;

wherein the network element is configured to:
receive a trigger from a portable point of sale terminal;
obtain, at the network element, image data from at least one image capture device;
determine a location of the portable point of sale terminal based on analysis of appearance of the point of sale terminal in the image data;
correlate the location of the portable point of sale terminal with data from sensors associated with the network element; and
present the correlated data to a merchant.

11. The network element of claim 10 , wherein the image data is obtained from the point of sales terminal.

12. The network element of claim 10 , wherein the image data is obtained directly from the image capture device.

13. The network element of claim 10 , wherein the location of the portable point of sale terminal is determined based on which image capture device from among the at least one image capture device includes a frame showing the portable point of sales terminal therein.

14. The network element of claim 10 , wherein the trigger comprises at least one of:
a transaction at the portable point of sale terminal;
a motion sensor detecting motion at portable point of sale terminal;
a change in location data for the portable point of sale terminal;
a break in a wired connection to the portable point of sale terminal; or
a change in a camera image for a camera on the portable point of sale terminal.

15. The network element of claim 10 , wherein the sensors associated with the network element include a plurality of cameras at a merchant location.

16. The network element of claim 10 , wherein the network element is configured to correlate based on at least one of:
a number of customers in a location of a store;
sales conversion statistics;
demographics information based on sales at the location;
value of merchandise sold;
traffic patterns at the location; or
information about shoppers at the location.

17. The network element of claim 10 , wherein the network element is further configured to:
limit transaction types available at a subset of point of sales terminals based on the correlating.

18. The network element of claim 10 , wherein the network element is further configured to:
provide sales incentives or discounts to the portable point of sales terminal based on the correlating.

19. A non-transitory computer readable medium for storing instruction code which, when executed by a processor of a network element cause the network element to:
receive a trigger from a portable point of sale terminal;
obtain, at the network element, image data from at least one image capture device;
determine a location of the portable point of sale terminal based on analysis of appearance of the point of sale terminal in the image data;
correlate the location of the portable point of sale terminal with data from sensors associated with the network element; and
present the correlated data to a merchant.

20. The non-transitory computer readable medium of claim 19 , wherein the image data is obtained from the point of sales terminal.

Assignees

• Shopify Inc

Inventors

• Maan Daanish
• Vazquez Ricardo
• Nitsch Peter
• Fang Zhi Hui
• Salvetti Djoume

Classifications

• G06V20/46 Primary

  Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames · CPC title

• G06Q20/20

  Point-of-sale [POS] network systems · CPC title

• G06V20/53

  Recognition of crowd images, e.g. recognition of crowd congestion · CPC title

• G06V40/161

  Detection; Localisation; Normalisation · CPC title

• G07G1/0009

  Details of the software in the checkout register, electronic cash register [ECR] or point of sale terminal [POS] · CPC title