Domain-specific named entity extraction and mapping

Patent metadata

Field	Value
Publication number	US-2025094718-A1
Application number	US-202318470921-A
Country	US
Kind code	A1
Filing date	Sep 20, 2023
Priority date	Sep 20, 2023
Publication date	Mar 20, 2025
Grant date	—

Abstract

A text from a predetermined domain is taken and converted to canonical named entities based on an established taxonomy. Using a shared machine learning encoder model, contextual embeddings for these named entities are produced. These embeddings are then fed into a domain-specific scoring model related to the text's domain. This model ranks the embeddings based on relevance. The derived relevance scores, along with the entities, are sent to another system for further tasks. For instance, a recommendation system might use these scores to suggest relevant named entities.

First claim

What is claimed is:

1 . A method comprising:
receiving a text; determining one or more named entities based on the text, the one or more named entities in a named entity taxonomy; generating, using a shared encoder, a respective contextual embedding for each named entity of the one or more named entities; determining a respective relevance score for each named entity of the one or more named entities using: (a) a text domain-specific machine learning model, and (b) the respective contextual embedding generated for the named entity; and providing the respective relevance score determined for a named entity of the one or more named entities to a named entity recommendation system for further processing.

2 . The method of claim 1 , wherein determining one or more named entities based on the text comprises determining a named entity of the one or more named entities based on:
matching a sequence of characters of the text to a sequence of characters associated with the named entity in an index data structure.

3 . The method of claim 1 , wherein determining one or more named entities based on the text comprises determining a named entity of the one or more named entities based on:
generating a first embedding representing the named entity; generating a second embedding representing a portion of the text; and comparing the first embedding to second embedding according to a similarity function.

4 . The method of claim 1 , wherein generating, using the shared encoder, the respective contextual embedding for each named entity of the one or more named entities comprises generating, using the shared encoder, a respective contextual embedding for a named entity of the one or more named entities based on:
generating, by a contextual text encoder of the shared encoder, a contextual text embedding for the named entity; generating, by a contextual entity encoder of the shared encoder, contextual entity embedding for the named entity; and combining the contextual text embedding and the contextual entity embedding to yield the respective contextual embedding for the named entity.

5 . The method of claim 1 , further comprising:
determining a text domain of a plurality of pre-determined text domains to which the text belongs; wherein each text domain of the plurality of pre-determined text domains corresponds to a respective text domain-specific machine learning model; and selecting the text domain-specific machine learning model to use to determine the respective relevance score for each named entity of the one or more named entities based on the determined text domain to which the text belongs.

6 . The method of claim 1 , wherein determining the one or more named entities based on the text comprises determining a parent named entity, a sibling named entity, or a child named entity in the named entity taxonomy of a named entity of the one or more named entities.

7 . The method of claim 1 , wherein the named entity recommendation system to which the respective relevance score determined for the named entity is provided determines to recommend the named entity based on the respective relevance score.

8 . A system, comprising:
at least one computer comprising at least one processor and at least one memory, the at least one computer configured to: receive a text belonging to a particular text domain; determine one or more named entities based on the text, the one or more named entities in a named entity taxonomy; generating, using a shared encoder, a respective contextual embedding for each named entity of the one or more named entities; determine a respective relevance score for each named entity of the one or more named entities using: (a) a text domain-specific neural network model specific to the particular text domain to which the text belongs, and (b) the respective contextual embedding generated for the named entity; and send the respective relevance score determined for a named entity of the one or more named entities to a named entity recommendation system for further processing.

9 . The system of claim 8 , wherein the at least one computer configured to determine one or more named entities based on the text comprises at least one computer configured to determine a named entity of the one or more named entities based on:
matching a sequence of characters of the text to a sequence of characters associated with the named entity in an index.

10 . The system of claim 8 , wherein the at least one computer configured determine one or more named entities based on the text comprises at least one computer configured determine a named entity of the one or more named entities based on:
generating a first embedding representing the named entity; generating a second embedding representing a portion of the text; and comparing the first embedding to second embedding according to a similarity function.

11 . The system of claim 8 , wherein the at least one computer configured to generate, using the shared encoder, the respective contextual embedding for each named entity of the one or more named entities comprises at least one computer configured to generate, using the shared encoder, a respective contextual embedding for a named entity of the one or more named entities based on:
generating, by a contextual text encoder of the shared encoder, a contextual text embedding for the named entity; generating, by a contextual entity encoder of the shared encoder, contextual entity embedding for the named entity; and combining the contextual text embedding and the contextual entity embedding to yield the respective contextual embedding for the named entity.

12 . The system of claim 8 , further comprising at least one computer configured to:
determine a text domain of a plurality of pre-determined text domains to which the text belongs; wherein each text domain of the plurality of pre-determined text domains corresponds to a respective text domain-specific machine learning model; and select the text domain-specific machine learning model to use to determine the respective relevance score for each named entity of the one or more named entities based on the determined text domain to which the text belongs.

13 . The system of claim 8 , wherein the at least one computer configured to determine the one or more named entities based on the text comprises at least one computer configured to determine a parent named entity, a sibling named entity, or a child named entity in the named entity taxonomy of a named entity of the one or more named entities.

14 . The system of claim 8 , wherein the named entity recommendation system to which the respective relevance score determined for the named entity is provided is configured to determine to recommend the named entity based on the respective relevance score.

15 . One or more non-transitory computer-readable media comprising computer-executable instructions that, when executed, cause at least one processor to perform actions comprising:
receiving a text; determining a text domain to which the text belongs; determining one or more named entities based on the text, the one or more named entities in a named entity taxonomy; generating, using a shared encoder, a respective contextual embedding for each named entity of the one or more named entities; determining a respective relevance score for each named entity of the one or more named entities using: (a) a text domain-specific machine learning model specific to the text domain to which the text belongs, and (b) the respective contextual embedding generated for the named entity; and providing the re

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Yan Ji
• Kou Rui
• Zhou Di
• Sun Lu

Classifications

• G06F40/30

  Semantic analysis · CPC title

• G06F40/295 Primary

  Named entity recognition · CPC title