Methods, systems, and media for providing automated review of incoming messages in a group messaging service

Patent metadata

Field	Value
Publication number	US-12301528-B2
Application number	US-202318243976-A
Country	US
Kind code	B2
Filing date	Sep 8, 2023
Priority date	Sep 8, 2022
Publication date	May 13, 2025
Grant date	May 13, 2025

Abstract

Methods, systems, and media for providing automated review of incoming messages in a group messaging service are provided. In some embodiments, the method includes: receiving, at a user device from a server, an incoming message to a particular message group in a group messaging service, wherein the user device is associated with the particular message group; determining, using a machine learning classifier at the user device, (i) a context of the particular message group based on a plurality of content items previously submitted by a plurality of users to the particular message group; (ii) a plurality of sentiments in the incoming message; (iii) a plurality of similarity scores, wherein each similarity score is a probability that a sentiment from the plurality of sentiments is similar to the context of the particular message group; and (iv) an aggregate similarity score based on the plurality of similarity scores is within a first range of predetermined values; and, in response to determining the aggregate similarity score is within the first range of predetermined values, displaying a preview of the incoming message on the user device, wherein the preview includes at least one sentiment from the plurality of sentiments.

First claim

What is claimed is:

1. A method for presenting messages in a group messaging service, the method comprising:
receiving, at a user device from a server, an incoming message to a particular message group in a group messaging service, wherein the user device is associated with the particular message group;
determining, using a machine learning classifier at the user device,
(i) a context of the particular message group based on a plurality of content items previously submitted by a plurality of users to the particular message group;
(ii) a plurality of sentiments in the incoming message;
(iii) a plurality of similarity scores, wherein each similarity score is a probability that a sentiment from the plurality of sentiments is similar to the context of the particular message group; and
(iv) an aggregate similarity score based on the plurality of similarity scores is within a first range of predetermined values; and

in response to determining the aggregate similarity score is within the first range of predetermined values, displaying a preview of the incoming message on the user device, wherein the preview includes at least one sentiment from the plurality of sentiments.

2. The method of claim 1 , wherein determining the plurality of similarity scores further comprises determining a cosine similarity score between a sentiment from the plurality of sentiments and the context of the particular message group.

3. The method of claim 1 , wherein determining the aggregate similarity score based on the plurality of similarity scores further comprises determining a plurality of statistics for the plurality of similarity scores and additionally determining that at least one statistic in the plurality of statistics is equivalent to a target statistical value from a plurality of target statistical values.

4. The method of claim 3 , further comprising:
determining, using the plurality of statistics, that a particular sentiment from the plurality of sentiments is an anomalous sentiment from the plurality of sentiments; and
in response to determining that the particular sentiment is the anomalous sentiment, sending the incoming message to the server with a request for review of the incoming message from an administrative user of the particular message group.

5. The method of claim 4 , further comprising:
receiving an indication from the server that the incoming message is approved by the administrative user; and
in response to receiving the indication that the incoming message is approved, displaying the preview of the incoming message on the user device.

6. The method of claim 4 , further comprising:
receiving an indication from the server that the incoming message is disapproved by the administrative user; and
in response to receiving the indication that the incoming message is rejected, discarding the incoming message without displaying the preview of the incoming message on the user device.

7. The method of claim 1 , further comprising:
determining that the aggregate similarity score based on the plurality of similarity scores is outside of the first range of predetermined values;
in response to determining that the aggregate similarity score is outside of the first range of predetermined values, sending the incoming message to the server with a request to review a membership status for the particular message group of a particular user that created the incoming message; and
discarding the incoming message without displaying the preview of the incoming message on the user device.

8. The method of claim 1 , further comprising:
determining that a second user device has reported the incoming message to the server as being incompatible with the context of the particular message group; and
in response to determining that the second user device has reported the incoming message, discarding the incoming message without displaying the preview of the incoming message on the user device.

9. The method of claim 8 , further comprising associating at least one of an indication of the second user device reporting the incoming message, the context of the particular message group, the plurality of sentiments from the incoming message, and the plurality of similarity scores with a training dataset for the machine learning model.

10. The method of claim 1 , wherein the machine learning classifier is trained at the server with a training dataset comprising a second plurality of content items from a second message group in the group messaging service, wherein the machine learning classifier, during training, determines the probability that a second plurality of sentiments from each content item in the second plurality of content items is similar to the context of the second message group.

11. The method of claim 1 , further comprising:
determining, using the machine learning classifier at the user device, a plurality of safety scores, wherein each safety score is a probability that a sentiment from the plurality of sentiments is similar to a reference message in a safety reference dataset;
determining an aggregate safety score;
identifying a second range of predetermined values corresponding to a safety threshold for the user device;
determining that the aggregate safety score is outside of the second range of predetermined values;
in response to determining that the aggregate safety score is outside the second range of predetermined values, displaying a preview of the incoming message with a safety warning message included in the preview of the incoming message.

12. A system for presenting messages in a group messaging service, the system comprising:
a hardware processor that is configured to:
receive, at a user device from a server, an incoming message to a particular message group in a group messaging service, wherein the user device is associated with the particular message group;
determine, using a machine learning classifier at the user device,
(i) a context of the particular message group based on a plurality of content items previously submitted by a plurality of users to the particular message group;
(ii) a plurality of sentiments in the incoming message;
(iii) a plurality of similarity scores, wherein each similarity score is a probability that a sentiment from the plurality of sentiments is similar to the context of the particular message group; and
(iv) an aggregate similarity score based on the plurality of similarity scores is within a first range of predetermined values; and

in response to determining the aggregate similarity score is within the first range of predetermined values, display a preview of the incoming message on the user device, wherein the preview includes at least one sentiment from the plurality of sentiments.

13. The system of claim 12 , wherein determining the plurality of similarity scores further comprises determining a cosine similarity score between a sentiment from the plurality of sentiments and the context of the particular message group.

14. The system of claim 12 , wherein determining the aggregate similarity score based on the plurality of similarity scores further comprises determining a plurality of statistics for the plurality of similarity scores and additionally determining that at least one statistic in the plurality of statistics is equivalent to a target statistical value from a plurality of target statistical values.

15. The system of claim 14 , wherein the hardware processor is further configured to:
determine, using the plurality of statistics, that a particular sentiment from the plurality of sentiments is an anomalous sentiment from the plurality of senti

Assignees

• Integral Ad Science Inc

Inventors

• Gupta Vikram
• Jawale Prashant
• Shah Bhavinkumar Jatinkumar

Classifications

• H04L51/216

  Handling conversation history, e.g. grouping of messages in sessions or threads · CPC title

• H04L51/212 Primary

  using filtering or selective blocking · CPC title

• H04L51/04 Primary

  Real-time or near real-time messaging, e.g. instant messaging [IM] · CPC title