Systems and methods for cross-media event detection and coreferencing

Patent metadata

Field	Value
Publication number	US-11061946-B2
Application number	US-201816130390-A
Country	US
Kind code	B2
Filing date	Sep 13, 2018
Priority date	May 8, 2015
Publication date	Jul 13, 2021
Grant date	Jul 13, 2021

Abstract

A method of providing cross-media event linking may include: receiving, at a first input of an event coreferencing system, a stream of social media postings, and at a second input, a stream of news articles; generating, by the event coreferencing system, a first set of event representations representing events referenced by the social media postings, and a second set of event representations representing events referenced by the news articles; determining, by the event coreferencing system, that at least one of the social media postings references a same event referenced by at least one of the news articles, the determining including determining at least one similarity using data of at least one of the first set of event representations corresponding to the at least one of the social media postings and data of at least one of the second set of event representations corresponding to the at least one of the news articles; and transmitting, by an output of the event resolution system to the user system, an alert including at least one coreferenced event representation representing the event referenced by the at least one of the social media postings and the at least one of the news articles.

First claim

What is claimed is:

1. A method of providing cross-media event linking, the method comprising:
receiving, at a first input of an event coreferencing system, a stream of social media postings, and at a second input of the event coreferencing system, a stream of news articles;
generating, by the event coreferencing system, a first set of event representations representing events referenced by the social media postings, and a second set of event representations representing events referenced by the news articles;
determining, by the event coreferencing system, that at least one of the social media postings references a same event referenced by at least one of the news articles, the determining including determining at least one similarity using data of at least one of the first set of event representations corresponding to the at least one of the social media postings and data of at least one of the second set of event representations corresponding to the at least one of the news articles; and
transmitting, by an output of the event resolution system to a user system, an alert including at least one coreferenced event representation representing the event referenced by the at least one of the social media postings and the at least one of the news articles.

2. The method of claim 1 , the determining including performing a classification of whether at least one of the social media postings references a same event referenced by at least one of the news articles based on the at least one similarity.

3. The method of claim 1 , wherein the coreferenced event representation includes at least one of: links to the at least one of the social media postings and at least one of the news articles, or the at least one of the social media postings and the at least one of the news articles.

4. The method of claim 1 , wherein transmitting the alert includes at least one of:
transmitting an email including the alert to the user system, transmitting a text message including the alert to the user system, or transmitting a feed including the alert to the user system.

5. The method of claim 1 , wherein transmitting the alert includes transmitting the alert by an application programming interface (API) of the event coreferencing system.

6. The method of claim 5 , wherein the API transmits the alert in response to a request by the user system.

7. The method of claim 1 , further comprising controlling by the user system at least one component of the user system based on the alert.

8. The method of claim 7 , wherein the controlling includes at least one of:
operating a supply chain scheduling controller to schedule a supply chain delivery based on the alert;
operating a financial trading controller to execute a trade of a financial commodity based on the alert; or
operating a manufacturing system controller to power down a manufacturing system component based on the alert.

9. The method of claim 1 , wherein each event representation includes a plurality of attributes representing the corresponding event.

10. The method of claim 9 , wherein each event representation includes a location of the event, a time of the event, and an impact of the event.

11. The method of claim 1 , wherein the determining the at least one similarity includes determining at least one of:
a temporal similarity between at least one time extracted from the at least one social media posting and at least one time extracted from the at least one news article;
a spatial similarity between at least one location extracted from the at least one social media posting and at least one location extracted from the at least one news article;
a person entity similarity between at least one person entity extracted from the at least one social media posting and at least one person entity extracted from the at least one news article;
an organization entity similarity between at least one organization entity extracted from the at least one social media posting and at least one organization entity extracted from the at least one news article; or
a text similarity between a text of the at least one social media posting and a text of the at least one news article.

12. The method of claim 1 , wherein the determining the at least one similarity includes determining a temporal similarity between the at least one social media posting and the at least one news article, a spatial similarity between the at least one social media posting and the at least one news article, an entity similarity between the at least one social media posting and the at least one news article, and a text similarity between the at least one social media posting and the at least one news article.

13. The method of claim 1 , wherein the determining the at least one similarity includes determining a spatial similarity between the at least one social media posting and the at least one news article by:
determining feature vectors fora social media cluster and the at least one news article based on locations extracted from the at least one social media posting and the at least one news article, the social media cluster including the at least one social media posting;
calculating similarities between each pair of locations of the at least one news article and the social media cluster using the feature vectors; and
determining the spatial similarity as function of the determined similarities.

14. The method of claim 1 , wherein the determining the at least one similarity includes determining a temporal similarity between the at least one social media posting and the at least one news article by:
determining feature vectors for temporal expressions extracted from the at least one social media posting and the at least one news article; and
determining the temporal similarity based on a minimum time difference between the temporal expressions in the feature vectors for the at least one social media posting and the at least one news article.

15. The method of claim 1 , wherein the determining the at least one similarity includes determining a person entity similarity between the at least one social media posting and the at least one news article by:
determining sets of person entities extracted from the at least one social media posting and the at least one news article; and
determining a similarity between the sets of extracted persons for the at least one social media posting and the at least one news article.

16. The method of claim 1 , wherein the determining the at least one similarity includes determining an organization entity similarity between the at least one social media posting and the at least one news article, including by:
determining sets of organization entities extracted from the at least one social media posting and the at least one news article; and
determining a similarity between the sets of extracted organization entities for the at least one social media posting and the at least one news article.

17. The method of claim 1 , wherein the determining the at least one similarity includes determining a text similarity between the at least one social media posting and the at least one news article, including generating vectors for tokenized text of the at least one social media posting and the at least one news article based on word embeddings, and determining a similarity between the generated vectors.

18. The method of claim 1 , wherein the generating the second set of event representations representing events referenced by the news articles includes:
filtering out non-event related news articles;
classifying types of events refer

Assignees

• Refinitiv Us Organization Llc

Inventors

• Petroni Fabio
• Raman Natraj
• Nourbakhsh Armineh
• Nugent Tim
• Carstens Lucas
• Duprey John
• Leidner Jochen
• Shah Sameena
• Panic Zarko

Classifications

• G06Q10/40

  Business processes related to social networking or social networking services · CPC title

• G06Q40/04 Primary

  Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange · CPC title

• G06N5/022

  Knowledge engineering; Knowledge acquisition · CPC title

• G06F16/9038

  Presentation of query results · CPC title

• G06F16/90332

  Natural language query formulation or dialogue systems · CPC title