Automatic accuracy estimation for audio transcriptions

Patent metadata

Field	Value
Publication number	US-2016284342-A1
Application number	US-201615172531-A
Country	US
Kind code	A1
Filing date	Jun 3, 2016
Priority date	May 3, 2012
Publication date	Sep 29, 2016
Grant date	—

Abstract

Embodiments of the present invention provide an approach for estimating the accuracy of a transcription of a voice recording. Specifically, in a typical embodiment, each word of a transcription of a voice recording is checked against a customer-specific dictionary and/or a common language dictionary. The number of words not found in either dictionary is determined. An accuracy number for the transcription is calculated from the number of said words not found and the total number of words in the transcription.

First claim

What is claimed is:

1 . A method of assigning a confidence level to at least one axiom extracted from a text, comprising:
comparing at least one word from the text to a dictionary; determining a number of accurate words based on the comparing; dividing the number of accurate words by a total number of words in the transcription; assigning a greater weight to at least one word exceeding a predetermined number of characters as compared to at least one other word below the predetermined number of characters; retrieving, from a data structure, at least one axiom associated with at least one word from the text; and assigning the confidence level to the at least one axiom based on a result of the dividing and the assigning.

2 . The method of claim 1 , wherein the dictionary comprises a customer specific dictionary.

3 . The method of claim 1 , wherein the dictionary comprises a dictionary of common language words.

4 . The method of claim 1 , further comprising determining a number of inaccurately spelled words in the transcription based on the comparing;

5 . The method of claim 4 , wherein the determining the number of inaccurate comprises identifying a number of words not found in the dictionary.

6 . The method of claim 1 , wherein the confidence level is assigned based on an output of a Gaussian function applied to a result of the dividing and the assigning.

7 . The method of claim 1 , wherein the at least one axiom comprises a computer-parsable definition of a relationship of data to the at least one of the words in the transcription.

8 . The method of claim 1 , wherein a solution service provider provides a computer infrasture operable to perform the method.

9 . A system for assigning a confidence level to at least one axiom extracted from a text, comprising:
a memory medium comprising instructions; a bus coupled to the memory medium; and an audio transcription tool coupled to the bus that when executing the instructions causes the system to:
compare at least one word from the text to a dictionary;
determine a number of accurate words based on the comparing;
divide the number of accurate words by a total number of words in the transcription;
assign a greater weight to at least one word exceeding a predetermined number of characters as compared to at least one other word below the predetermined number of characters;
retrieve, from a data structure, at least one axiom associated with at least one word from the text; and
assign the confidence level to the at least one axiom based on a result of the dividing and the assigning.

10 . The system of claim 9 , wherein the dictionary comprises a customer specific dictionary.

11 . The system of claim 9 , wherein the dictionary comprises a dictionary of common language words.

12 . The system of claim 9 , the an audio transcription tool coupled to the bus that when executing the instructions further causes the system to determine a number of inaccurately spelled words in the transcription based on the comparing.

13 . The system of claim 9 , wherein the confidence level is assigned based on an output of a Gaussian function applied to a result of the dividing and the assigning.

14 . The system of claim 9 , wherein the at least one axiom comprises a computer-parsable definition of a relationship of data to the at least one of the words in the transcription.

15 . A computer program product for assigning a confidence level to at least one axiom extracted from a text, the computer program product comprising a computer readable storage medium, and program instructions stored on the computer readable storage medium, to:
compare at least one word from the text to a dictionary; determine a number of accurate words based on the comparing; divide the number of accurate words by a total number of words in the transcription; assign a greater weight to at least one word exceeding a predetermined number of characters as compared to at least one other word below the predetermined number of characters; retrieve, from a data structure, at least one axiom associated with at least one word from the text; and assign the confidence level to the at least one axiom based on a result of the dividing and the assigning.

16 . The computer program product of claim 15 , wherein the dictionary comprises a customer specific dictionary.

17 . The computer program product of claim 15 , wherein the dictionary comprises a dictionary of common language words.

18 . The computer program product of claim 15 , the computer program product comprising a computer readable storage medium, and program instructions stored on the computer readable storage medium, to determine a number of inaccurately spelled words in the transcription based on the comparing.

19 . The computer program product of claim 15 , wherein the confidence level is assigned based on an output of a Gaussian function applied to a result of the dividing and the assigning.

20 . The computer program product of claim 15 , wherein the at least one axiom comprises a computer-parsable definition of a relationship of data to the at least one of the words in the transcription.

Assignees

• IBM

Inventors

• Bostick James E
• Ganci Jr John M
• Kaemmerer John P
• Trim Craig M

Classifications

• G10L15/26

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• G10L15/01 Primary

  Assessment or evaluation of speech recognition systems · CPC title

• G06F40/157

  using dictionaries or tables · CPC title

• G10L15/1822

  Parsing for meaning understanding · CPC title

• G06F40/226

  Validation · CPC title