Determining and providing feedback about communications from an application on a social networking platform

Patent metadata

Field	Value
Publication number	US-10147147-B2
Application number	US-201715691171-A
Country	US
Kind code	B2
Filing date	Aug 30, 2017
Priority date	Jun 27, 2012
Publication date	Dec 4, 2018
Grant date	Dec 4, 2018

Abstract

A social networking system (SNS) may determine the integrity of a social application. In particular, the SNS can receive communications and tags associated with different subsets of the communications from the social application. Thereafter, the SNS can distribute the communications, and monitor for user interactions performed on the communications. Subsequently, feedback indicating the integrity of the social application can be provided. The feedback can be based on the user interactions performed on the communications. The feedback can also be provided according to the tags. In particular, a set of feedback information can be provided for each tag, where the set is based on the user interactions performed on the subset of communications associated with the tag. By providing feedback in this manner, A-B testing can be performed. In one embodiment, the operating state for the social application can be determined based on the integrity of the SNS.

First claim

What is claimed is:

1. A computer-implemented method comprising:
receiving, at an online system, a plurality of communications from each of a plurality of applications operated by different entities, the communications each directed to one or more users of the online system, the plurality of communications from each of the applications including at least a first group of communications of a first type of content and a second group of communications of a second type of content;
for each of the applications:
receiving, from the application, a first tag and a second tag, wherein the first tag is associated with the first group of the communications, and the second tag is associated with the second group of the communications;
distributing the first group of the communications and the second group of the communications to the one or more users of the online system;
monitoring interactions with the first group of the communications and the second group of the communications by the one or more users of the online system;
computing, by a processor, a first integrity score for the first group of the communications associated with the first tag, wherein the first integrity score is based on the monitored interactions of the users with the first group of communications; computing, by the processor, a second integrity score for the second group of the communications associated with the second tag, wherein the second integrity score is based on the monitored interactions of the one or more users of the online system with the second group of communications;
determining an operating state for the application based at least in part on the first or the second integrity score;
comparing, by the processor, the first integrity score with the second integrity score to determine how the type of content of the first group and the type of content of the second group are perceived in relation to one another; and
generating feedback information based on the comparison of the first integrity score and the second integrity score and the determined operating state of the application; and

providing feedback for each of the applications to the entity that operates the application based on the generated feedback information.

2. The computer-implemented method of claim 1 , wherein the provided feedback includes aggregated information for the communications of the application.

3. The computer-implemented method of claim 1 , wherein the provided feedback includes information or statistics for the communications of the application organized by tag.

4. The computer-implemented method of claim 1 , wherein the provided feedback includes information or statistics organized by individual communication.

5. The computer-implemented method of claim 1 , wherein the provided feedback includes a count for a number of times a type of interaction is performed.

6. The computer-implemented method of claim 1 , wherein the first tag is for marking test content and the second tag is for marking baseline content.

7. The computer-implemented method of claim 1 , further comprising computing a set of integrity scores for at least one of a tag, a communication, and the application, wherein each integrity score in the set is based on a different category in a set of categories.

8. The computer-implemented method of claim 7 , wherein the categories in the set of categories includes at least a spam category, an offensive category, and an irrelevant category.

9. The computer-implemented method of claim 8 , wherein an integrity score for the spam category is based on a number of violation reports received from users.

10. The computer-implemented method of claim 8 , wherein an integrity score for the offensive category is based on a number of hide type interactions.

11. The computer-implemented method of claim 1 , wherein the provided feedback includes an integrity rating for at least one of a tag, a communication, and the application.

12. The computer-implemented method of claim 11 , wherein the integrity rating indicates whether the tag, the communication, or the application is one of excellent, fair, and unsatisfactory.

13. The computer-implemented method of claim 11 , wherein the integrity rating indicates that the tag, the communication, or the application is in a warning range.

14. The computer-implemented method of claim 1 , wherein the state for the application is at least one of a normal operating state, a warning state, and a disabled state, the method further comprising:
preventing the application from directing communications to the one or more users based on the determined operating state for the application.

15. The computer-implemented method of claim 14 , wherein a shift of the state for the application from the disabled state to the normal operating state occurs after a certain period of time.

16. The computer-implemented method of claim 14 , wherein a shift of the state for the application from the disabled state to the normal operating state occurs after a requirement is satisfied.

17. The computer-implemented method of claim 1 , wherein the provided feedback is presented on a user interface including a reporting dashboard.

18. The computer-implemented method of claim 1 , wherein the provided feedback is presented via a notification mechanism including email or SMS messaging.

19. A non-transitory computer-readable storage medium storing executable computer program instructions, the computer program instructions comprising instructions for:
receiving, at an online system, a plurality of communications from each of a plurality of applications operated by different entities, the communications each directed to one or more users of the online system, the plurality of communications from each of the applications including at least a first group of communications of a first type of content and a second group of communications of a second type of content;
for each of the applications:
receiving, from the application, a first tag and a second tag, wherein the first tag is associated with the first group of the communications, and the second tag is associated with the second group of the communications;
distributing the first group of the communications and the second group of the communications to the one or more users of the online system;
monitoring interactions with the first group of the communications and the second group of the communications by the one or more users of the online system;
computing, by a processor, a first integrity score for the first group of the communications associated with the first tag, wherein the first integrity score is based on the monitored interactions of the users with the first group of communications;
computing, by the processor, a second integrity score for the second group of the communications associated with the second tag, wherein the second integrity score is based on the monitored interactions of the one or more users of the online system with the second group of communications;
determining an operating state for the application based at least in part on the first or the second integrity score;
comparing, by the processor, the first integrity score with the second integrity score to determine how the type of content of the first group and the type of content of the second group are perceived in relation to one another; and
generating feedback information based on the comparison of the first integrity score and the second integrity score and the determined operating state of the application; and

providing feedback for each of

Assignees

• Facebook Inc

Inventors

• Himel Alex
• Levi Gabriel
• Sjogreen Carl Philip
• Kao Wayne

Classifications

• G06Q10/40 Primary

  Business processes related to social networking or social networking services · CPC title

• G06Q50/01 Primary

  Physics · mapped topic