User interface for acquisition of group data

Patent metadata

Field	Value
Publication number	US-10445593-B1
Application number	US-201615193552-A
Country	US
Kind code	B1
Filing date	Jun 27, 2016
Priority date	Jun 27, 2016
Publication date	Oct 15, 2019
Grant date	Oct 15, 2019

Abstract

Users may enter a facility singly or in groups. A user interface may be presented to an associate that includes information obtained from sensors in the facility. The associate may utilize the information presented to determine if a user is alone, or to associate that user with a particular group of users. Input from the associate obtained from this user interface may then be used by a facility management system during operation to attribute the actions of the users to a particular account.

First claim

What is claimed is:

1. A system comprising:
one or more cameras with a field of view including at least a portion of an entry area of a facility;
a memory, storing computer-executable instructions; and
a hardware processor configured to execute the computer-executable instructions to:
access image data acquired by the one or more cameras;
determine presence of a first user in the image data;
determine presence of a second user in the image data;
generate a user interface that presents:
a first section comprising:
one or more image interface elements;
at least a portion of the image data;
first designator indicia associated with a depiction of the first user in the at least a portion of the image data;
first identifier indicia associated with the first designator indicia, wherein the first identifier indicia provides a human-readable designation of the first user;
second designator indicia associated with a depiction of the second user in the at least a portion of the image data; and
second identifier indicia associated with the second designator indicia, wherein the second identifier indicia provides a human-readable designation of the second user; and

a second section comprising:
a first image of the first user; and
a second image of the second user;

accept input indicative of an association between the first user and the second user;
generate group data indicative of user input; and
based on the group data, associate the first user and the second user with a billing account number.

2. The system of claim 1 , wherein the at least a portion of the image data presented in the first section comprises video of one or more of the first user or the second user in the entry area.

3. The system of claim 1 , further comprising computer-executable instructions to:
determine a wearable computing device of an associate; and
send instructions to cause presentation of the user interface to the wearable computing device.

4. A system comprising:
an input device;
a display device;
a memory, storing computer-executable instructions; and
a hardware processor to execute the computer-executable instructions to:
access image data acquired by one or more sensors associated with a facility;
cause display of a user interface on the display device, the user interface comprising:
a first image of a portion of the facility; and
one or more interface elements;

obtain input from the input device, wherein the input is associated with at least one of the one or more interface elements; and
generate, using the input, group data indicative of a group comprising two or more users at the facility that share a common billing account.

5. The system of claim 4 , further comprising computer-executable instructions to:
based on the group data, associate a first user and a second user with a common session identifier.

6. The system of claim 4 , wherein the one or more interface elements comprise designator indicia, each of the designator indicia associated with a depiction of a user in the first image.

7. The system of claim 6 , wherein the designator indicia comprise one or more of:
a bounding box,
a change in background color,
an outline,
an icon,
an arrow, or
a visual effect.

8. The system of claim 4 , the user interface further comprising:
first identifier indicia associated with a depiction of a first user in the first image;
second identifier indicia associated with a depiction of a second user in the first image;
a first interface element outside of a boundary of the first image that is labeled with the first identifier indicia; and
a second interface element outside of the boundary of the first image that is labeled with the second identifier indicia.

9. The system of claim 4 , the one or more interface elements comprising one or more of:
a refresh element associated with presentation of more recently acquired image data;
a view element associated with presentation of second image data acquired from a camera;
a forward element associated with presentation of the image data to images acquired at a later time; or
a rewind element associated with presentation of the image data to images acquired at an earlier time.

10. The system of claim 4 , the user interface further comprising:
information indicative of predicted group data that is based at least in part on one or more of:
physical distance between a plurality of users to one another,
resemblance between the two or more users,
sequential entry of the two or more users at the facility, or
entry credential data obtained from the two or more users during entry of the two or more users to the facility.

11. The system of claim 4 , the user interface further comprising:
identifier indicia or designator indicia indicative of an associate affiliated with the facility.

12. The system of claim 4 , the user interface further comprising:
information indicative of a user account associated with a user at the facility.

13. The system of claim 4 , the user interface further comprising:
an image gallery section comprising a plurality of second images of people wherein at least one of the plurality of second images is associated with a particular user identifier; and
wherein the group data is indicative of an association between the particular user identifier and a user depicted in the first image of the portion of the facility.

14. A method comprising:
causing display in a user interface of first image data obtained at a first time that depicts a first user and a second user at a facility;
causing display of one or more interface elements in the user interface;
receiving input from an input device;
associating the input with the one or more interface elements, wherein the input is indicative of an association between the first user and the second user; and
generating, using the input, group data indicative of the association between the first user and the second user and a common billing account for the first user and the second user.

15. The method of claim 14 , further comprising:
causing a display of first designator indicia associated with the first user; and
causing a display of second designator indicia associated with the second user.

16. The method of claim 14 , further comprising:
causing a display of first identifier indicia associated with the first user; and
causing a display of second identifier indicia associated with the second user.

17. The method of claim 14 , further comprising:
accessing data indicative of identification of an associate depicted in the first image data who is affiliated with the facility; and
causing a display of one or more of identifier indicia or designator indicia indicative of the associate.

18. The method of claim 14 , further comprising:
causing a display in the user interface of second image data that depicts an image of the first user as obtained at a second time; and
causing a display in the user interface of third image data that depicts an image of the second user as obtained at a third time.

19. The method of claim 14 , further comprising:
determining predicted group data based at least in part on one or more of:
determined physical distance in the facility between the first user and the second user,
determined resemblance between the first user and the second user,
sequential entry of the first user and the second user at the facility, or
entry credential data obtained from the first user and the second user during entry to the facility; and

cau

Assignees

• Amazon Tech Inc

Inventors

• Mathiesen Thomas Meilandt
• Costa Maren Marie
• Desai Nishitkumar Ashokkumar
• Fescoe Christopher Richard
• Thurston Casey Louis
• Famularo Jason Michael
• Raghavan Sudarshan Narasimha
• Ahmed Waqas
• Guan Danny

Classifications

• G06V10/945

  User interactive design; Environments; Toolboxes · CPC title

• G06V20/53

  Recognition of crowd images, e.g. recognition of crowd congestion · CPC title

• H04N7/181 Primary

  for receiving images from a plurality of remote sources · CPC title

• G06T2207/30196

  Human being; Person · CPC title

• G06F3/04817

  using icons (graphical or visual programming using iconic symbols G06F8/34) · CPC title