Suggestion of content within augmented-reality environments

Patent metadata

Field	Value
Publication number	US-10719989-B2
Application number	US-201816112407-A
Country	US
Kind code	B2
Filing date	Aug 24, 2018
Priority date	Aug 24, 2018
Publication date	Jul 21, 2020
Grant date	Jul 21, 2020

Abstract

In one embodiment, a method includes rendering an augmented-reality environment on a display associated with a first computing device associated with a first user; identifying one or more objects within the augmented-reality environment; determining a suggested augmented-reality content item based on social-networking information associated with the first user, and further based on characteristics associated with the identified objects; and presenting the suggested augmented-reality content item on a display associated with the first computing device.

First claim

What is claimed is:

1. A method comprising:
rendering an augmented-reality environment on a display associated with a first computing device associated with a first user;
identifying one or more objects within the augmented-reality environment;
accessing a data store that comprises one or more augmented-reality content items;
calculating, for each of the augmented-reality content items, a relevance score based on:
one or more characteristics of one of more of the objects identified within the augmented-reality environment; and
social-networking information associated with the first user;

determining, based on their relevance scores, one or more augmented-reality content items to suggest to the first user for one or more of the objects identified within the augmented-reality environment; and
suggesting the one or more determined augmented-reality content items to the first user by presenting the one or more determined augmented-reality content items to the first user for selection to be included within the augmented-reality environment.

2. The method of claim 1 , wherein presenting the one or more determined augmented-reality content items to the first user comprises presenting the one or more determined augmented-reality content items within a suggestions interface rendered within a sub-region of the display.

3. The method of claim 1 , wherein
one or more of the augmented-reality content items are associated with a second user;
the social-networking information associated with the first user comprises information about a degree of separation between the first user and the second user; and
determining one or more augmented-reality content items to suggest to the first user is further based on information associated with the second user.

4. The method of claim 1 , wherein determining one or more augmented-reality content items based on their relevance scores comprises identifying one or more augmented-reality content items with scores greater than a pre-determined threshold.

5. The method of claim 1 , wherein determining one or more augmented-reality content items to suggest to the first user is further based on one or more of:
a current location of the first user;
an event that is determined to be occurring currently; or
a current date or time.

6. The method of claim 1 , wherein determining one or more augmented-reality content items based on their relevance scores comprises ranking the augmented-reality content items based on their relevance scores.

7. The method of claim 1 , wherein the social-networking information associated with the first user comprises one or more of:
an affinity coefficient between the first user and the augmented-reality content item; or
demographic information associated with the first user.

8. The method of claim 1 , wherein the identified objects are objects within the augmented-reality environment that are within a focal region of the display associated with the first computing device.

9. The method of claim 1 , further comprising:
receiving an input at the first computing device selecting one of the suggested augmented-reality content items; and
modifying a particular identified object, wherein the modifying comprises altering the particular identified object based on the selected suggested augmented-reality content item.

10. The method of claim 9 , wherein the selected suggested augmented-reality content item comprises a mask and the particular identified object comprises a face.

11. The method of claim 9 , wherein the selected suggested augmented-reality content item comprises a filter.

12. The method of claim 9 , wherein the selected suggested augmented-reality content item comprises a drawing.

13. The method of claim 1 , further comprising:
receiving a content-selection input at the first computing device that selects one of the suggested augmented-reality content items;
receiving a content-placement input at the first computing device that specifies a location within the augmented-reality environment; and
placing the suggested augmented-reality content item selected by the content-selection input at the location specified by the content-placement input.

14. The method of claim 1 , further comprising:
receiving a content-modification input at the first computing device that specifies a modification to one of the suggested augmented-reality content items;
causing an instance of the suggested augmented-reality content item to be modified.

15. The method of claim 14 , further comprising:
uploading the modified instance of the suggested augmented-reality content item to a server; and
receiving a privacy-settings input from the first user, wherein the privacy-settings input specifies criteria that authorizes one or more fourth users to access the modified instance of the suggested augmented-reality content item.

16. The method of claim 1 , wherein:
the augmented-reality environment is rendered on the display by the first computing device;
identifying one or more objects within the augmented-reality environment, accessing the data store that comprises the augmented-reality content items, calculating the relevance scores of the augmented-reality content items, and determining the augmented-reality content items to suggest to the first user comprises, by the first computing device, communicating one or more requests to one or more servers and receiving one or more responses from one or more of the servers; and
the determined augmented-reality content items are suggested to the first user by the first computing device by presenting the one or more determined augmented-reality content items to the first user for selection to be included within the augmented-reality environment.

17. The method of claim 1 , wherein:
the augmented-reality environment is rendered on the display by the first computing device;
the one or more objects within the augmented-reality environment are identified locally by the first computing device;
the data store that comprises one or more augmented-reality content items is accessed by the first computing device;
the relevance scores for the augmented-reality content items are calculated by the first computing device;
the augmented-reality content items to suggest to the first user are determined by the first computing device; and
the determined augmented-reality content items are suggested to the first user by the first computing device by presenting the one or more determined augmented-reality content items to the first user for selection to be included within the augmented-reality environment.

18. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:
render an augmented-reality environment on a display associated with a first computing device associated with a first user;
identify one or more objects within the augmented-reality environment;
access a data store that comprises one or more augmented-reality content items;
calculate, for each of the augmented-reality content items, a relevance score based on:
one or more characteristics of one of more of the objects identified within the augmented-reality environment; and
social-networking information associated with the first user;

determine, based on their relevance scores, one or more augmented-reality content items to suggest to the first user for one or more of the objects identified within the augmented-reality environment; and
suggest the one or more determined augmented-reality content items to the first user by presenting the one

Assignees

• Facebook Inc

Inventors

• Stahl Justin David
• Sead Narin
• Murrell Tullie
• Germe Gregory Daniel Louis
• Kish Steven

Classifications

• G06Q10/40

  Business processes related to social networking or social networking services · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• H04L51/18

  Commands or executable codes · CPC title

• H04L12/1827

  Network arrangements for conference optimisation or adaptation · CPC title

• H04L51/10

  Multimedia information · CPC title