Method, system, and computer-readable medium for using facial recognition to analyze in-store activity of a user

Patent metadata

Field	Value
Publication number	US-10706446-B2
Application number	US-201615160910-A
Country	US
Kind code	B2
Filing date	May 20, 2016
Priority date	May 20, 2016
Publication date	Jul 7, 2020
Grant date	Jul 7, 2020

Abstract

One or more embodiments of the disclosure provide systems and methods providing improved customer service to visiting customers of a brick-and-mortar merchant location. For example, a customer recognition system intelligently detects and notifies a merchant when a customer is in need of assistance based on the customer's facial expression. The customer recognition system can also identify a product associated with the customer need. In some examples, the customer recognition system identifies a user profile associated with a customer shopping at a merchant location, determines a trust level for the customer based on user profile information, and based on the trust level, causes a secured product display to provide a customer access to a secured product.

First claim

What is claimed is:

1. A method comprising:
receiving, by at least one processor of a social networking system and from a merchant, an image that portrays a customer and an indication that the customer desires to access a secured product within a secured product display associated with a dispensing terminal at a physical location of the merchant;
analyzing, by the at least one processor of the social networking system, the image to identify the customer portrayed in the image from a plurality of images corresponding to a plurality of users of the social networking system;
accessing, by the at least one processor of the social networking system and based on identifying the customer, profile information associated with the customer;
generating, by the at least one processor of the social networking system, a trust level for the customer based on:
analyzing the profile information associated with the customer to identify one or more attributes;
identifying a plurality of users that share the one or more attributes with the customer, the plurality of users each having a known trust level; and

determining the trust level for the customer based on the trust levels of the plurality of users; and
sending, by the at least one processor of the social networking system and based on the indication and the trust level for the customer, a communication to the merchant that causes the dispensing terminal to physically provide the secured product to the customer for purchase at a point-of-sale device at the physical location of the merchant.

2. The method of claim 1 , wherein determining the trust level for the customer based on the trust levels of the plurality of users comprises:
determining a trust level formula that weights attributes of the user comprising the one or more attributes;
modifying the weight of the one or more attributes in the trust level formula based on the known trust level of the plurality of users that share the one or more attributes with the customer; and
determining the trust level for the customer by utilizing the modified trust level formula.

3. The method of claim 1 , wherein accessing profile information associated with the customer comprises accessing social networking data of the customer.

4. The method of claim 1 , further comprising providing a notification to a client device associated with the customer indicating granted access to the secure product.

5. The method of claim 1 , wherein generating the trust level for the customer further comprises modifying the trust level from a previous trust level of untrustworthy to a new trust level of trustworthy.

6. The method of claim 5 , further comprising determining, by the at least one processor of the social networking system, the new trust level of trustworthy for the customer further based on the customer previously purchasing the secured product at the physical location of the merchant while having the previous trust level of untrustworthy.

7. The method of claim 1 , wherein causing the dispensing terminal to physically provide the secured product to the customer for purchase at the point-of-sale device comprises unlocking a display door of the secured product display that prevented the customer from accessing to the secured products.

8. The method of claim 1 , further comprising generating, by the at least one processor of the social networking system, a first access code that the customer provides at the dispensing terminal, and wherein sending the communication to cause the dispensing terminal to physically provide the secured product to the customer for purchase at the point-of-sale device comprises sending the first access code to a client device corresponding to the customer.

9. The method of claim 8 , wherein the point-of-sale device is a separate computing device from the dispensing terminal.

10. The method of claim 1 , wherein generating, by the at least one processor of the social networking system, the trust level for the customer is further based on the customer previously purchasing the secured product within a threshold time period.

11. A system comprising:
at least one processor; and
a non-transitory computer readable medium storing instructions that, when executed by the at least one processor, cause the system to:
receive, at a social networking system, an image from a merchant that portrays a customer and an indication that the customer desires to access a secured product within a secured product display associated with a dispensing terminal at a physical location of the merchant;
analyze, by the social networking system, the image to identify the customer portrayed in the image from a plurality of images corresponding to a plurality of users of the social networking system;
access, by the social networking system and based on identifying the customer, profile information associated with the customer;
generate, by the social networking system, a trust level for the customer based on:
analyzing the profile information associated with the customer to identify one or more attributes;
identifying a plurality of users that share the one or more attributes with the customer, the plurality of users each having a known trust level; and
determining the trust level for the customer based on the trust levels of the plurality of users; and

send, by the social networking system and based on the indication and the trust level for the customer, a communication to the merchant that causes the dispensing terminal to physically provide the secured product to the customer for purchase at a point-of-sale device at the physical location of the merchant.

12. The system of claim 11 , wherein analyzing the image to identify the customer from the plurality of images corresponding to the plurality of users of the social networking system comprises comparing the image that portrays the customer with one or more social networking user profile images of the plurality of users.

13. The system of claim 12 , further comprising instructions that, when executed by the at least one processor, cause the system to identify a subset of images corresponding to a subset of users of the social networking system based on the physical location of the merchant.

14. The system of claim 13 , wherein the instructions that, when executed by the at least one processor, cause the system to identify the subset of users of the social networking system by determining one or more users of the social networking system from the plurality of user of the social networking system are located within a defined proximity of the physical location of the merchant based on geo-location information.

15. The system of claim 12 , wherein comparing the image that portrays the customer with the plurality of images corresponding to the plurality of users of the social networking system comprises using facial recognition techniques to identify a user image that matches the image portraying the customer.

16. A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause a computer system to:
receive, at a social networking system, an image from a merchant that portrays a customer and an indication that the customer desires to access a secured product within a secured product display associated with a dispensing terminal at a physical location of the merchant;
analyze, by the social networking system, the image to identify the customer portrayed in the image from a plurality of images corresponding to a plurality of users of the social networking system;
access, by the social networking system and based on ident

Assignees

• Facebook Inc

Inventors

• Davis Stephen Moore

Classifications

• G06V40/174

  Facial expression recognition · CPC title

• G06V40/172

  Classification, e.g. identification · CPC title

• H04W4/02

  Services making use of location information · CPC title

• G06Q30/0607 Primary

  Regulating the sale of restricted items, e.g. alcohol · CPC title

• H04L67/306

  User profiles · CPC title