Object recognition based image overlays

Patent metadata

Field	Value
Publication number	US-11734342-B2
Application number	US-202217681395-A
Country	US
Kind code	B2
Filing date	Feb 25, 2022
Priority date	Jan 9, 2015
Publication date	Aug 22, 2023
Grant date	Aug 22, 2023

Abstract

Systems and methods for distributing photo filters based on the location of the object in the image are described. A photo filter publication system detects that a client device in communication with the system has captured an image, identifies an object in the image, identifies a location of the object in the image, identifies an image overlay associated with the identified location and having object criteria satisfied by the identified object, and provides the identified image overlay to the client device.

First claim

What is claimed is:

1. A computer-implemented method comprising:
receiving first image overlay data from a first merchant and second image overlay data from a second merchant;
identifying a common object criteria between a first object criteria associated with the first image overlay data and a second object criteria associated with the second image overlay data;
receiving a first bid amount and a first time duration from the first merchant and a second bid amount and a second time duration from the second merchant;
identifying that a prorated first bid amount based on the first time duration is higher than a prorated second bid amount based on the second time duration;
generating an image overlay based on the first image overlay data; and
providing the image overlay to a client device based on determining that an image captured by the client device comprises an object that satisfies the common object criteria.

2. The computer-implemented method of claim 1 , wherein the image overlay is a first image overlay and a second image overlay based on the second image overlay data is excluded from being provided to the client device, based on identifying that the prorated first bid amount is higher than the prorated second bid amount.

3. The computer-implemented method of claim 1 , wherein the image overlay is provided to the client device based on identifying that the client device has captured the image comprising the object that satisfies the first object criteria associated with the first image overlay data.

4. The computer-implemented method of claim 1 , wherein the image overlay is provided to the client device based on identifying that the client device has captured an image during the first time duration.

5. The computer-implemented method of claim 1 , wherein the image overlay is a first image overlay and further comprising:
generating a second image overlay based on the second image overlay data; and
providing the second image overlay to the client device based on identifying that the client device has captured an image during the second time duration.

6. The computer-implemented method of claim 1 , further comprising:
causing display of the image overlay as an option on a user interface of the client device.

7. The computer-implemented method of claim 1 , wherein before generating the image overlay based on the first image overlay data, the method comprises:
determining that the image captured by the client device comprises the object that satisfies the common object criteria.

8. The computer-implemented method of claim 1 , wherein the common object criteria includes a type of object for which the first merchant and the second merchant sell branded products.

9. The computer-implemented method of claim 1 , further comprising:
generating a ranking of image overlays associated with the common object criteria based on bid amounts associated with the image overlays; and
wherein providing the image overlay to the client device is based on the image overlay being ranked first in the ranking of the image overlays.

10. The computer-implemented method of claim 1 , wherein the image overlay is a first image overlay and further comprising:
generating a second image overlay based on the second image overlay data;
providing the second image overlay to the client device based on the image captured by the client device including the object that satisfies the first object criteria associated with the first image overlay data; and
causing display of the first image overlay as a first option and of the second image overlay as a second option on a user interface of the client device, the second option being displayed after the first option.

11. The computer-implemented method of claim 1 , further comprising:
receiving third image overlay data from a third merchant;
determining a quota of image overlays available for the common object criteria, the quota indicating a limited number of image overlays available for the common object criteria; and
based on the quota, providing both the image overlay based on the first image overlay data and a second image overlay generated based on the second image overlay data, but not a third image overlay generated based on the third image overlay data.

12. A system comprising:
a processor; and
a memory storing instructions that, when executed by the processor, configure the system to perform operations comprising:
receiving first image overlay data from a first merchant and second image overlay data from a second merchant;
identifying a common object criteria between a first object criteria associated with the first image overlay data and a second object criteria associated with the second image overlay data;
receiving a first bid amount and a first time duration from the first merchant and a second bid amount and a second time duration from the second merchant;
identifying that a prorated first bid amount based on the first time duration is higher than a prorated second bid amount based on the second time duration;
generating an image overlay based on the first image overlay data; and
providing the image overlay to a client device based on determining that an image captured by the client device comprises an object that satisfies the common object criteria.

13. The system of claim 12 , wherein the image overlay is a first image overlay and a second image overlay based on the second image overlay data is excluded from being provided to the client device, based on identifying that the prorated first bid amount is higher than the prorated second bid amount.

14. The system of claim 12 , wherein the image overlay is provided to the client device based on identifying that the client device has captured the image comprising the object that satisfies the first object criteria associated with the first image overlay data.

15. The system of claim 12 , wherein before generating the image overlay based on the first image overlay data, the method comprises:
determining that the image captured by the client device comprises the object that satisfies the common object criteria.

16. The system of claim 12 , wherein the common object criteria includes a type of object for which the first merchant and the second merchant sell branded products.

17. The system of claim 12 , the operations further comprising:
generating a ranking of image overlays associated with the common object criteria based on bid amounts associated with the image overlays; and
wherein providing the image overlay to the client device is based on the image overlay being ranked first in the ranking of the image overlays.

18. The system of claim 12 , wherein the image overlay is a first image overlay and the operations further comprise:
generating a second image overlay based on the second image overlay data;
providing the second image overlay to the client device based on the image captured by the client device including the object that satisfies the first object criteria associated with the first image overlay data; and
causing display of the first image overlay as a first option and of the second image overlay as a second option on a user interface of the client device, the second option being displayed after the first option.

19. The system of claim 12 , the operations further comprising:
receiving third image overlay data from a third merchant;
determining a quota of image overlays available for the common object criteria, the quota indicating a limited number of image overlays available for the common object criteria;

Assignees

• Snap Inc

Inventors

• Chang Sheldon
• Samaranayake Chamal
• Sehn Timothy Michael
• Yan Rong

Classifications

• G06F16/5838 Primary

  using colour · CPC title

• G06F16/538

  Presentation of query results · CPC title

• G06T5/20 Primary

  using local operators · CPC title

• G06T5/00 Primary

  Image enhancement or restoration · CPC title

• G06F16/50 Primary

  of still image data · CPC title