Dynamic contextual media filter

Patent metadata

Field	Value
Publication number	US-11710311-B2
Application number	US-202217827179-A
Country	US
Kind code	B2
Filing date	May 27, 2022
Priority date	Dec 26, 2018
Publication date	Jul 25, 2023
Grant date	Jul 25, 2023

Abstract

A contextual filter system configured to perform operations that include, capturing an image frame at a client device, wherein the image frame includes a depiction of an object, identifying an object category of the object based on the depiction of the object within the image frame, accessing media content associated with the object category within a media repository, generating a presentation of the media content, and causing display of the presentation of the media content within the image frame at the client device.

First claim

What is claimed is:

1. A method comprising:
causing display of image data within an image frame at a client device, the image data comprising a set of image features;
identifying a display of an object within the image frame based on the image features, the object corresponding with an object class;
accessing a media template that corresponds with the object class, the media template defining a position within the image frame to display media content;
causing display of a presentation of the media content at the position within the image frame based on the media template.

2. The method of claim 1 , wherein the causing display of the presentation of the media content at the position within the image frame based on the media template further comprises:
accessing the media content from among a collection of media content based on contextual data.

3. The method of claim 2 , wherein the contextual data includes one or more of:
location data;
temporal data;
image data; and
device data.

4. The method of claim 2 , wherein the image data comprises metadata, and the accessing the media content from among the collection of media content based on the contextual data further comprises:
determining a context based on the metadata of the image data; and
selecting the media content from among the collection of media content based on the context.

5. The method of claim 1 , further comprising:
generating a message that includes the presentation of the media content at the position within the image frame.

6. The method of claim 1 , wherein the identifying the display of the object within the image frame based on the image features further comprises:
receiving a request to identify one or more objects within the image frame; and
identifying the display of the object within the image frame responsive to the request.

7. The method of claim 6 , wherein the request includes a tactile input upon a graphical user interface of the client device.

8. A system comprising:
a memory; and
at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:
causing display of image data within an image frame at a client device, the image data comprising a set of image features;
identifying a display of an object within the image frame based on the image features, the object corresponding with an object class;
accessing a media template that corresponds with the object class, the media template defining a position within the image frame to display media content;
causing display of a presentation of the media content at the position within the image frame based on the media template.

9. The system of claim 8 , wherein the causing display of the presentation of the media content at the position within the image frame based on the media template further comprises:
accessing the media content from among a collection of media content based on contextual data.

10. The system of claim 9 , wherein the contextual data includes one or more of:
location data;
temporal data;
image data; and
device data.

11. The system of claim 9 , wherein the image data comprises metadata, and the accessing the media content from among the collection of media content based on the contextual data further comprises:
determining a context based on the metadata of the image data; and
selecting the media content from among the collection of media content based on the context.

12. The system of claim 8 , further comprising:
generating a message that includes the presentation of the media content at the position within the image frame.

13. The system of claim 8 , wherein the identifying the display of the object within the image frame based on the image features further comprises:
receiving a request to identify one or more objects within the image frame; and
identifying the display of the object within the image frame responsive to the request.

14. The system of claim 13 , wherein the request includes a tactile input upon a graphical user interface of the client device.

15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
causing display of image data within an image frame at a client device, the image data comprising a set of image features;
identifying a display of an object within the image frame based on the image features, the object corresponding with an object class;
accessing a media template that corresponds with the object class, the media template defining a position within the image frame to display media content;
causing display of a presentation of the media content at the position within the image frame based on the media template.

16. The non-transitory machine-readable storage medium of claim 15 , wherein the causing display of the presentation of the media content at the position within the image frame based on the media template further comprises:
accessing the media content from among a collection of media content based on contextual data.

17. The non-transitory machine-readable storage medium of claim 16 , wherein the contextual data includes one or more of:
location data;
temporal data;
image data; and
device data.

18. The non-transitory machine-readable storage medium of claim 16 , wherein the image data comprises metadata, and the accessing the media content from among the collection of media content based on the contextual data further comprises:
determining a context based on the metadata of the image data; and
selecting the media content from among the collection of media content based on the context.

19. The non-transitory machine-readable storage medium of claim 15 , further comprising:
generating a message that includes the presentation of the media content at the position within the image frame.

Assignees

• Snap Inc

Inventors

• Charlton Ebony James
• Mourkogiannis Celia Nicole
• Chen Travis
• Tang Kevin Dechau
• Anvaripour Kaveh

Classifications

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F16/5866

  using information manually generated, e.g. tags, keywords, comments, manually generated location and time information · CPC title

• G06F16/538

  Presentation of query results · CPC title

• G06F16/532

  Query formulation, e.g. graphical querying · CPC title

• G06F16/51

  Indexing; Data structures therefor; Storage structures · CPC title