Calculating expertise confidence based on content and social proximity

Patent metadata

Field	Value
Publication number	US-10146839-B2
Application number	US-201414573561-A
Country	US
Kind code	B2
Filing date	Dec 17, 2014
Priority date	Dec 17, 2014
Publication date	Dec 4, 2018
Grant date	Dec 4, 2018

Abstract

A method includes executing, via a processor, a document-oriented search based on a query in an index of documents to generate a set of document results, each document associated with at least one potential expert. The method includes analyzing the document results to produce a list of potential experts. The method includes calculating an expertise score for each potential expert based on a calculated content score and metadata score for each potential expert. The method includes calculating an evidence diversity score for each potential expert. The method includes calculating a confidence score for each potential expert based on a diversity-constrained content score and a diversity-constrained metadata score for each potential expert. The method includes displaying a list of potential experts with associated confidence scores.

First claim

What is claimed is:

1. A system, comprising a processor configured to:
execute a document-oriented search based on a query in an index of documents to generate a set of document results, each document in the set of document results is associated with at least one potential expert;
analyze the document results to produce a list of potential experts;
calculate an expertise score for each potential expert based on a content score and a metadata score for each potential expert;
calculate a confidence score for each potential expert based on a diversity-constrained content score and a diversity-constrained metadata score for each potential expert, wherein
the diversity-constrained content score is calculated using an evidence diversity score, comprising a predetermined threshold number of different activities associated with the potential expert, and the content score for the potential expert,
the diversity-constrained metadata score is calculated using the evidence diversity score and the metadata score for the potential expert,
the content score is calculated based on a number of different content document types and associations associated with the potential expert, the content document types and associations are gathered by parsing websites and stored in a data repository,
the metadata score is calculated based on profile-related information associated with the potential expert, and
the confidence score is further calculated based on a social score,

wherein the processor is configured to generate a graph of connections between the predetermined number of selected experts, the social score for each selected expert is calculated using the graph and based on a number of connections to other selected experts; and
send a list of experts with associated confidence scores that are above a confidence score threshold to a client device.

2. The system of claim 1 , the processor further configured to:
select a predetermined number of potential experts with expertise scores above a threshold from the list of potential experts and calculate the evidence diversity score for each selected expert; and
calculate the confidence score for each selected expert using the evidence diversity score for each selected expert.

3. The system of claim 1 , wherein the confidence scores are calculated based on preconfigured thresholds.

4. The system of claim 1 . wherein the query comprising an expertise, and the confidence score is used to indicate a level of certainty in the expertise for each potential expert.

5. The system of claim 1 , wherein the list of experts is filtered according to the confidence scores and sorted by the expertise scores.

6. A computer program product for calculating confidence scores, the computer program product comprising a computer-readable storage medium having program code embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program code executable by a processor to cause the processor to:
execute, via the processor, a document-oriented search based on a query in an index of documents to generate a set of document results, each document in the set of document results is associated with at least one potential expert;
analyze, via the processor, the document results to produce a list of potential experts;
calculate, via the processor, an expertise score for each potential expert based on a calculated content score and metadata score for each potential expert and sorting the potential experts by the expertise scores;
select, via the processor, a predetermined number of potential experts with higher expertise scores from the list of potential experts;
calculate, via the processor, an evidence diversity score for each selected expert, wherein the evidence diversity score comprising a predetermined threshold number of different activities associated with the selected expert;
calculate a confidence score for each potential expert based on diversity constrained content score and a diversity-constrained metadata score for each potential expert, wherein
the diversity-constrained content score is calculated using the evidence diversity score and the content score for the potential expert,
the diversity-constrained metadata score is calculated using the evidence diversity score and the metadata score the potential expert,
the content score is calculated based on a number of different content document types and associations associate with the potential expert, the content document types and associations are gathered by parsing websites and stored in a data repository,
the metadata score is calculated based on profile-related information associated with the potential expert, and
the confidence score is further calculated based on a social score,

wherein the processor is configured to generate a graph of connections between the predetermined number of selected experts, the social score for each selected expert is calculated using the graph and based on a number of connections to other selected experts; and
send a list of experts with associated confidence scores that are above a confidence score threshold to a client device.

7. The computer program product of claim 6 , wherein the query comprising an expertise, the confidence score is used to indicate a relative level of the expertise for each selected expert.

8. The computer program product of claim 6 , the content score is calculated based on contributions including wiki entries, comments, and likes stored in a data repository.

Assignees

• IBM

Inventors

• Bolshinsky Leonid
• Ronen Inbal
• Shapiro Eitan
• Yogev Arnon

Classifications

• G06Q10/40 Primary

  Business processes related to social networking or social networking services · CPC title

• G06F16/24578

  using ranking · CPC title

• G06F16/248

  Presentation of query results · CPC title

• G06F16/951

  Indexing; Web crawling techniques · CPC title

• G06F16/33 Primary

  Querying · CPC title