Processing and Cross Reference of Realtime Natural Language Dialog for Live Annotations

Patent metadata

Field	Value
Publication number	US-2016171983-A1
Application number	US-201414566900-A
Country	US
Kind code	A1
Filing date	Dec 11, 2014
Priority date	Dec 11, 2014
Publication date	Jun 16, 2016
Grant date	—

Abstract

An approach is provided to receive audible speech and convert the received speech to text while the audible speech is being delivered to a user. An annotation candidate is identified in the text and an annotation reference relating to the identified annotation candidate is retrieved and presented to the user.

First claim

1 . A method implemented by an information handling system that includes a memory and a processor, the method comprising:
receiving audible speech and converting received speech to text, wherein the audible speech is being delivered to a user; identifying an annotation candidate included in the text; retrieving an annotation reference relating to the identified annotation candidate; and presenting the annotation reference to the user.

2 . The method of claim 1 wherein the annotation reference is presented to the user while the audible speech is still being delivered.

3 . The method of claim 1 further comprising:
parsing the text into a plurality of parts;
identifying a locatable entity as one of the parts; and
filtering the locatable entity, wherein the filtering results in the annotation candidate.

4 . The method of claim 3 wherein the filtering further comprises:
identifying that the locatable entity is an uncommon entity.

5 . The method of claim 4 further comprising:
generating a rarity score pertaining to the uncommon entity;
generating a phrase matching score pertaining to the uncommon entity;
generating a signal strength score pertaining to a context of the uncommon entity;
combining the rarity score, the phrase matching score, and signal strength score into an overall score; and
comparing the overall score to a threshold, wherein the retrieval of the annotation reference is performed in response to the overall score exceeding the threshold.

6 . The method of claim 1 further comprising:
determining whether to present the annotation reference based on a number of a plurality of annotation references previously presented to the user in a given amount of time;
presenting the annotation reference in response to the number of the plurality of annotation references not exceeding a threshold; and
refraining from presenting the annotation reference in response to the number of the plurality of annotation references exceeding the threshold.

7 . The method of claim 1 further comprising:
retrieving a delivery preference pertaining to the user, wherein the delivery preference is selected from the group consisting of a link and a text;
presenting an annotation link to the annotation reference in response to the delivery preference being the link; and
presenting an descriptive text of the annotation reference in response to the delivery preference being the text.

8 . An information handling system comprising:
one or more processors; one or more data stores accessible by at least one of the processors; a memory coupled to at least one of the processors; and a set of computer program instructions stored in the memory and executed by at least one of the processors in order to perform actions of:
receiving audible speech and converting received speech to text, wherein the audible speech is being delivered to a user;
identifying an annotation candidate included in the text;
retrieving an annotation reference relating to the identified annotation candidate; and
presenting the annotation reference to the user.

9 . The information handling system of claim 8 wherein the annotation reference is presented to the user while the audible speech is still being delivered.

10 . The information handling system of claim 8 wherein the actions further comprise:
parsing the text into a plurality of parts;
identifying a locatable entity as one of the parts; and
filtering the locatable entity, wherein the filtering results in the annotation candidate.

11 . The information handling system of claim 10 wherein the filtering further comprises:
identifying that the locatable entity is an uncommon entity.

12 . The information handling system of claim 11 wherein the actions further comprise:
generating a rarity score pertaining to the uncommon entity;
generating a phrase matching score pertaining to the uncommon entity;
generating a signal strength score pertaining to a context of the uncommon entity;
combining the rarity score, the phrase matching score, and signal strength score into an overall score; and
comparing the overall score to a threshold, wherein the retrieval of the annotation reference is performed in response to the overall score exceeding the threshold.

13 . The information handling system of claim 8 wherein the actions further comprise:
determining whether to present the annotation reference based on a number of a plurality of annotation references previously presented to the user in a given amount of time;
presenting the annotation reference in response to the number of the plurality of annotation references not exceeding a threshold; and
refraining from presenting the annotation reference in response to the number of the plurality of annotation references exceeding the threshold.

14 . The information handling system of claim 8 wherein the actions further comprise:
retrieving a delivery preference pertaining to the user, wherein the delivery preference is selected from the group consisting of a link and a text;
presenting an annotation link to the annotation reference in response to the delivery preference being the link; and
presenting an descriptive text of the annotation reference in response to the delivery preference being the text.

15 . A computer program product stored in a computer readable storage medium, comprising computer program code that, when executed by an information handling system, causes the information handling system to perform actions comprising:
receiving audible speech and converting received speech to text, wherein the audible speech is being delivered to a user; identifying an annotation candidate included in the text; retrieving an annotation reference relating to the identified annotation candidate; and presenting the annotation reference to the user.

16 . The computer program product of claim 15 wherein the annotation reference is presented to the user while the audible speech is still being delivered.

17 . The computer program product of claim 15 wherein the actions further comprise:
parsing the text into a plurality of parts;
identifying a locatable entity as one of the parts; and
filtering the locatable entity, wherein the filtering results in the annotation candidate.

18 . The computer program product of claim 17 wherein the filtering further comprises:
identifying that the locatable entity is an uncommon entity.

19 . The computer program product of claim 18 wherein the actions further comprise:
generating a rarity score pertaining to the uncommon entity;
generating a phrase matching score pertaining to the uncommon entity;
generating a signal strength score pertaining to a context of the uncommon entity;
combining the rarity score, the phrase matching score, and signal strength score into an overall score; and
comparing the overall score to a threshold, wherein the retrieval of the annotation reference is performed in response to the overall score exceeding the threshold.

20 . The computer program product of claim 15 wherein the actions further comprise:
determining whether to present the annotation reference based on a number of a plurality of annotation references previously presented to the user in a given amount of time;
presenting the annotation reference in response to the number of the plurality of annotation references not exceeding a threshold; and
refraining from presenting the annotation reference in response to the number of the plurality of annotati

Assignees

• IBM

Inventors

• Bufe John P
• Byron Donna K
• Pikovsky Alexander
• Winkler Timothy

Classifications

• G10L15/26 Primary

  Speech to text systems (G10L15/08 takes precedence) · CPC title