Capturing transactional context

Patent metadata

Field	Value
Publication number	US-11017238-B2
Application number	US-201816220022-A
Country	US
Kind code	B2
Filing date	Dec 14, 2018
Priority date	Jun 25, 2018
Publication date	May 25, 2021
Grant date	May 25, 2021

Abstract

Disclosed are systems and methods of capturing sensor data associated with a retail location. The systems and methods further include a point-of-sale device for processing customer transactions and generating an event trigger for capturing sensor data from one or more of the sensors at the retail location. In response to the event trigger, the systems and methods capture data from the one or more sensors at the retail location and provide access to the stored sensor data and event triggers via a user interface of the point-of-sale device for review of the stored sensor data and event trigger.

First claim

What is claimed is:

1. A method of capturing sensor data associated with a retail location comprising the steps of:
with a point-of-sale device for processing a customer transaction, generating an event trigger for capturing sensor data from one or more sensors at the retail location;
in response to the event trigger, capturing the sensor data from the one or more sensors at the retail location;
determining a stock level of a product for the customer transaction;
in response to the stock level of the product being at or above a threshold value, storing a first subset of sensor data from the captured sensor data;
in response to the stock level of the product being below the threshold value, storing a second subset of sensor data from the captured sensor data, wherein the first subset of sensor data is larger than the second subset of sensor data; and
providing access to the first subset of sensor data or the second subset of sensor data and event triggers via a user interface of the point-of-sale device for review.

2. The method of claim 1 wherein the one or more sensors comprises a plurality of sensors further comprising the step of determining a subset of the plurality of sensors from which to capture sensor data.

3. The method of claim 1 wherein the sensor data is stored on a remote data storage server.

4. The method of claim 1 wherein one or more of the sensors is a camera and the sensor data is at least one of image data and video data.

5. The method of claim 1 wherein one of the sensors is a camera and the sensor data is video data from a predetermined period of time before and after the event trigger.

6. The method of claim 1 wherein one or more of the sensors is a camera integrated within the point-of-sale device and the sensor data is at least one of image data and video data.

7. The method of claim 1 where in the point-of-sale device communicates directly with the sensors.

8. The method of claim 1 where in the point-of-sale device communicates with the sensors indirectly through an intermediate server.

9. The method of claim 1 wherein the event trigger is at least one of: an occurrence of a transaction, a clearance or denial of a payment transaction, a voiding of a sales transaction, a turning on or off of the point-of-sale device, an opening of a cash drawer, a change in network connection, a product return or refund, a printing of a sales receipt, an entry of a new customer profile or address, a redemption of rewards or customer loyalty program points, a purchase of a specific product, a purchase of products over a price threshold, a purchase of products by a specific customer or customer matching certain criteria, an entry of a layaway transaction, an entry of a special order transaction, a purchase of an extended product warranty, scanning of a product bar code, movement of the point-of-sale device to a location or a predetermined distance from a home location, or removal from a stand, and/or an identification of a face in a camera frame.

10. A system for capturing sensor data associated with a retail location comprising:
a point-of-sale device for processing a transaction wherein the point-of-sale device comprises a display, the point-of-sale device adapted to transmit, in response to user input at the point-of-sale device, an event trigger for capturing sensor data from one or more sensors located at the retail location, the point-of-sale device further being in data communication with a data storage medium that stores the captured sensor data from the one or more sensors and the event trigger, wherein range and type of data stored is based in part on a stock level of a product associated with the transaction, and wherein a user interface displays the stored sensor data and the event trigger.

11. The system of claim 10 wherein the one or more sensors are located within the retail location for capturing data about the retail location.

12. The system of claim 10 wherein the one or more sensors comprises a plurality of sensors and wherein the point-of-sale device is adapted to determine a subset of the plurality of sensors from which to capture sensor data.

13. The system of claim 10 further comprising a remote data storage server in data communication with the point-of-sale device and the sensor and wherein the sensor data is stored on the remote data storage server.

14. The system of claim 13 wherein the one or more sensors comprises a plurality of sensors and wherein the remote data storage server is adapted to determine a subset of the plurality of sensors from which to capture sensor data.

15. The system of claim 10 wherein one or more of the sensors is a camera and the sensor data is at least one of image data and video data.

16. The system of claim 10 wherein one or more of the sensors is a camera and the sensor data is video data from a predetermined period of time before and after the event trigger.

17. The system of claim 10 wherein the point-of-sale device further comprises an integrated camera and one of the sensors comprises the integrated camera and the sensor data is at least one of image data and video data.

18. The system of claim 10 where in the point-of-sale device communicates directly with the sensors.

19. The system of claim 10 where in the point-of-sale device communicates with the sensors indirectly through an intermediate server.

20. The system of claim 10 wherein the event trigger is at least one of: an occurrence of a transaction, a clearance or denial of a payment transaction, a voiding of a sales transaction, a turning on or off of the point-of-sale device, an opening of a cash drawer, a change in network connection, a product return or refund, a printing of a sales receipt, an entry of a new customer profile or address, a redemption of rewards or customer loyalty program points, a purchase of a specific product, a purchase of products over a price threshold, a purchase of products by a specific customer or customer matching certain criteria, an entry of a layaway transaction, an entry of a special order transaction, a purchase of an extended product warranty, scanning of a product bar code, movement of the point-of-sale device to a location or a predetermined distance from a home location, or removal from a stand, and/or an identification of a face in a camera frame.

21. A system for capturing camera data associated with a retail location comprising:
a point-of-sale device for processing a transaction, wherein the point-of-sale device is adapted to transmit an event trigger for capturing at least one of image and video data from one or more cameras located at the retail location, the point-of-sale device further being in data communication with a data storage medium that stores the captured image and video data from the one or more cameras, wherein range and type of the image and video data stored is based in part on an associated type of event trigger and a stock level of a product associated with the transaction, and wherein a user interface of the point-of-sale device displays the stored image and video data and the associated type of event trigger.

22. The system of claim 21 wherein the one or more cameras are located within the retail location for capturing at least one of an image or video about the retail location.

23. The system of claim 21 wherein the one or more cameras comprises a plurality of cameras and wherein the point-of-sale device is adapted to determine a subset of the plurality of cam

Assignees

• Shopify Inc

Inventors

• Maan Daanish Bilal
• Nitsch Peter
• Fang Zhi Hui
• Vazquez Ricardo
• Salvetti Djoume

Classifications

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• G06V20/46 Primary

  Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames · CPC title

• G06V40/161

  Detection; Localisation; Normalisation · CPC title

• G06V20/53

  Recognition of crowd images, e.g. recognition of crowd congestion · CPC title

• G06V20/44

  Event detection · CPC title