Tag suggestions for images on online social networks

Patent metadata

Field	Value
Publication number	US-10423656-B2
Application number	US-201715491778-A
Country	US
Kind code	B2
Filing date	Apr 19, 2017
Priority date	Mar 20, 2008
Publication date	Sep 24, 2019
Grant date	Sep 24, 2019

Abstract

In one embodiment, a method includes sending, from a client system of a first user to a server of an online social network, an image portraying at least a first person and determining, for each user in a first set of users, a facial-recognition score with respect to the first person portrayed in the image. The facial-recognition score is based at least in part on a facial-representation associated with the user being compared with the image. The method further includes presenting, at the client system, one or more tag suggestions for the first person portrayed in the image based on the facial-recognition scores and a social-graph affinity associated with one or more users of the first set of users and receiving a selection of a particular tag suggestion by the first user. Each tag suggestion corresponds to a particular user of the first set of users.

First claim

What is claimed is:

1. A method comprising, by a client computing device of a first user:
sending, from the client computing device of the first user to a server of an online social network, an image portraying at least a first person;
determining, at the client computing device, for each user in a first set of users, a facial-recognition score with respect to the first person portrayed in the image, wherein the facial-recognition score is based at least in part on a facial-representation associated with the user, the facial-representation associated with the user being compared with the image;
presenting, at the client computing device, one or more tag suggestions for the first person portrayed in the image based on the facial-recognition scores and a social-graph affinity associated with one or more users of the first set of users, wherein each tag suggestion corresponds to a particular user of the first set of users; and
receiving, at the client computing device, a selection of a particular tag suggestion by the first user.

2. The method of claim 1 , further comprising sending the selection of the particular tag suggestion to the server of the online social network.

3. The method of claim 1 , wherein the social graph affinity is accessed from the server of the online social network.

4. The method of claim 1 , wherein the facial-recognition score is accessed from the server of the online social network.

5. The method of claim 1 , further comprising determining a social-graph affinity for each user in the first set of users.

6. The method of claim 1 , further comprising:
accessing a social graph comprising a plurality of nodes and a plurality of edges connecting the nodes, each of the edges between two of the nodes representing a single degree of separation between them, the nodes comprising:
a first node corresponding to the image; and
a plurality of second nodes corresponding to a plurality of users associated with the online social network, respectively.

7. The method of claim 6 , wherein the social-graph affinity for each user in the first set of users is based at least in part on a degree of separation between the second node corresponding to the user and the first node corresponding to the image.

8. The method of claim 6 , wherein the image comprises one or more tags corresponding to one or more second users of the plurality of users, respectively, and wherein the social-graph affinity for each user of the first set of users is based at least in part on a degree of separation between the second node corresponding to the user and the one or more second nodes corresponding to the one or more second users, respectively.

9. The method of claim 1 , further comprising receiving one or more characters of a character string at the client computing device as the first user enters the character string into a user interface associated with the image.

10. The method of claim 9 , further comprising determining one or more users of the online social network that substantially match the character string.

11. The method of claim 9 , further comprising:
sending, from the client computing device to the server, the character string entered by the first user; and
receiving, at the client computing device from the server of the online social network, information associated with one or more users of the online social network that substantially match the character string.

12. The method of claim 9 , wherein determining the facial-recognition score is further based at least in part on the character string.

13. The method of claim 1 , further comprising generating the one or more tag suggestions by identifying each user of the first set of users having a facial-recognition score greater than a threshold facial-recognition score, wherein each identified user is generated as one of the tag suggestions.

14. The method of claim 1 , further comprising rendering the image with a tag-label for the particular tag suggestion, wherein the tag-label comprises a description of the particular user corresponding to the particular tag suggestion.

15. The method of claim 1 , wherein the facial-recognition score for each user measures a probability that the user matches the first person portrayed in the image.

16. The method of claim 1 , wherein the social-graph affinity for each user is based at least in part on a tag-history information of the image.

17. The method of claim 1 , wherein the image is associated with a first set of images, and wherein the social-graph affinity for each user is based at least in part on a tag-history information of the other images in the first set of images.

18. The method of claim 1 , wherein the social-graph affinity for each user is based at least in part on a time-decay information associated with the image.

19. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:
send, from a client computing device of a first user to a server of an online social network, an image portraying at least a first person;
determine, at the client computing device, for each user in a first set of users, a facial-recognition score with respect to the first person portrayed in the image, wherein the facial-recognition score is based at least in part on a facial-representation associated with the user, the facial-representation associated with the user being compared with the image;
present, at the client computing device, one or more tag suggestions for the first person portrayed in the image based on the facial-recognition scores and a social-graph affinity associated with one or more users of the first set of users, wherein each tag suggestion corresponds to a particular user of the first set of users; and
receive, at the client computing device, a selection of a particular tag suggestion by the first user.

20. A system comprising: one or more processors; and a memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to:
send, from a client computing device of a first user to a server of an online social network, an image portraying at least a first person;
determine, at the client computing device, for each user in a first set of users, a facial-recognition score with respect to the first person portrayed in the image, wherein the facial-recognition score is based at least in part on a facial-representation associated with the user, the facial-representation associated with the user being compared with the image;
present, at the client computing device, one or more tag suggestions for the first person portrayed in the image based on the facial-recognition scores and a social-graph affinity associated with one or more users of the first set of users, wherein each tag suggestion corresponds to a particular user of the first set of users; and
receive, at the client computing device, a selection of a particular tag suggestion by the first user.

Assignees

• Facebook Inc

Inventors

• Barak Dan
• Taigman Yaniv N
• Hirsch Gil
• Van Dijk Jorn Martinus Johannes
• Stoop Dirk John

Classifications

• G06Q10/40

  Business processes related to social networking or social networking services · CPC title

• G06F16/51

  Indexing; Data structures therefor; Storage structures · CPC title

• G06F16/5866

  using information manually generated, e.g. tags, keywords, comments, manually generated location and time information · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title