Analyzing layouts using sensor data

Patent metadata

Field	Value
Publication number	US-11663570-B2
Application number	US-201916730974-A
Country	US
Kind code	B2
Filing date	Dec 30, 2019
Priority date	Apr 24, 2017
Publication date	May 30, 2023
Grant date	May 30, 2023

Abstract

This disclosure describes an enhanced user interface. For instance, a system may present a user interface indicating a first layout of a physical establishment and receive a first input indicating an object is located at a first geographic location within the physical establishment. The system may receive a recommended location corresponding to a second geographic location within the physical establishment and present the indication of the recommended location for the object on the user interface indicating the first layout. The system may receive image data associated with the physical establishment and determine based at least in part on analyzing the image data that the object is located at the second geographic location within the physical establishment. The system may further display a second layout of the physical establishment, where the second layout includes an indication of the object at the second geographic location within the physical establishment.

First claim

What is claimed is:

1. One or more non-transitory computer-readable media storing instructions executable by one or more processors, wherein the instructions program the one or more processors to perform acts comprising:
presenting, on a device associated with a first merchant, a user interface indicating a first layout of a first physical establishment of the first merchant;
receiving, via the user interface, first input indicating an object is located at a first geographic location within the first physical establishment;
receiving, from the one or more processors, a recommended location corresponding to a second geographic location within the first physical establishment, the second geographic location being different from the first geographic location;
presenting, on the user interface indicating the first layout, the indication of the recommended location for the object;
receiving, by the device associated with the first merchant and from one or more image-capturing devices within the first physical establishment, image data associated with the first physical establishment;
determining, by the device associated with the first merchant and based at least in part on analyzing, by the device associated with the first merchant, the image data, that the object is located at the second geographic location within the first physical establishment; and
displaying, by the device associated with the first merchant and based at least in part on the determining, a second layout of the first physical establishment, wherein the second layout includes an indication of the object at the second geographic location within the first physical establishment.

2. The one or more non-transitory computer-readable media of claim 1 ,
wherein determining that the object is located at the second geographic location is based at least in part on receiving, via the user interface, a second input indicating that the object has been physically moved to the second geographic location, and the acts further comprising:
presenting, on the user interface, a graphical element corresponding to the object at the recommended location.

3. The one or more non-transitory computer-readable media of claim 1 , wherein the recommended location is based at least in part on sensor data that comprises location data representing movements of one or more users in the first physical establishment.

4. The one or more non-transitory computer-readable media of claim 3 , wherein the location data is received from at least one of a plurality of electronic devices associated with the one or more users in the first physical establishment or at least one of the one or more image-capturing devices in the first physical establishment.

5. The one or more non-transitory computer-readable media of claim 3 , wherein the determining that the first geographic location is separate from the recommended location is further based at least in part on:
determining, based at least in part on the location data, one or more clustering locations within the first physical establishment; and
determining, based at least in part on the one or more clustering locations, that the first geographic location is separate from the recommended location within the first physical establishment for placing the object.

6. The one or more non-transitory computer-readable media of claim 1 , wherein the first layout comprises an arrangement of at least one of one or more objects or one or more designated sections.

7. The one or more non-transitory computer-readable media of claim 1 , wherein analyzing the image data comprises one or more image processing techniques.

8. A method comprising:
presenting, on a merchant device associated with a first merchant, a user interface indicating a first layout of a first physical establishment associated with the first merchant;
receiving, via the user interface, a first input indicating an object is located at a first geographic location within the first physical establishment;
presenting, on the user interface, a first graphical element corresponding to the object at the first geographic location;
sending, to a processor, an indication of the first geographic location of the object;
receiving, from the processor, a second indication of a recommended location for the object, the recommended location comprising a second geographic location within the first physical establishment that is different from the first geographic location;
presenting, on the user interface, the second indication;
receiving, by the merchant device associated with the first merchant, image data associated with the first physical establishment, the image data being generated by one or more image-capturing devices;
determining, by the merchant device associated with the first merchant and based at least in part on analyzing, by the merchant device associated with the first merchant, the image data, that the object is physically located at the recommended location within the first physical establishment; and
presenting, on the user interface, a second graphical element indicating that the object is physically located at the recommended location.

9. The method of claim 8 , wherein analyzing the image data comprises one or more image processing techniques.

10. The method of claim 8 , wherein the first layout and comprises an arrangement of at least one of one or more objects or one or more designated sections.

11. The method of claim 8 , wherein the indication is based at least in part on analyzing the first layout with respect to a second layout associated with a second physical establishment of a second merchant, the analyzing comprising comparing at least one of a first number of objects in a designated section in the first physical establishment in which the first merchant desires to place the object with a second number of objects in a similarly designated section of the second physical establishment.

12. The method of claim 8 , wherein the second indication is further based at least in part on determining that the recommended location is in a same designated area at the first physical establishment and a second physical establishment of a second merchant.

13. The method of claim 8 , wherein the second indication is further based at least in part on transaction data received from a second merchant.

14. The method of claim 8 , wherein the second indication is further based at least in part on location data representing movements of users in the first physical establishment.

15. The method of claim 14 , wherein the location data is received from at least one of one or more electronic devices associated with the users or the one or more image-capturing devices in the first physical establishment.

16. The method of claim 14 , wherein the second indication is further based at least in part on:
determining, based at least in part on the location data, one or more clustering locations within the first physical establishment; and
determining, based at least in part on the one or more clustering locations, that the recommended location is an optimal geographical location within the first physical establishment for placing the object.

17. A system comprising:
one or more processors; and
one or more computer-readable media storing instructions executable by the one or more processors, wherein the instructions program the one or more processors to implement a merchant device of a first merchant to:
present, on the merchant device of the first merchant, a user interface indicating a first layout of a first physical establishment of the first merchant;

Assignees

• Block Inc

Inventors

• Bell Bruce
• Partridge Brian
• Abu-Ghaida Ghassan
• Dhingra Amar
• Bautista Alfred
• Yien Kevin

Classifications

• G06Q20/202 Primary

  Interconnection or interaction of plural electronic cash registers [ECR] or to host computer, e.g. network details, transfer of information from host to ECR or from ECR to ECR · CPC title