Apparatus and method for creating dictionary for speech synthesis utilizing a display to aid in assessing synthesis quality

Patent metadata

Field	Value
Publication number	US-9129596-B2
Application number	US-201213535782-A
Country	US
Kind code	B2
Filing date	Jun 28, 2012
Priority date	Sep 26, 2011
Publication date	Sep 8, 2015
Grant date	Sep 8, 2015

Abstract

Apparatus for creating a dictionary for speech synthesis includes a sentence storage unit configured to store N sentences, a sentence display unit configured to selectively display a first sentence which is one of the N sentences, a recording unit configured to record each user speech, a necessity determination unit configured to make a determination of whether to create the dictionary, a dictionary creation unit configured to create the dictionary by utilizing the user speech, and a speech synthesis unit configured to convert a second sentence to a synthesized speech with the dictionary. The display unit is configured to stop displaying the currently displayed sentence according to an evaluation of a quality of its synthesis. The determination unit makes the determination under a condition that the recording unit records the user speech of M first sentences (M is less than N) and the determination is based on at least one of an instruction from the user, M and an amount of the recorded user speech.

First claim

What is claimed is:

1. An apparatus for creating a dictionary for speech synthesis, comprising:
a sentence storage unit configured to store N sentences where N is a counting number, each sentence being prepared in advance to prompt a user to utter;
a sentence display unit configured to selectively display at least one first sentence, each first sentence being one of the N sentences;
a recording unit configured to record each user speech corresponding to each first sentence;
a necessity determination unit, under a condition that the recording unit records the user speech of M first sentences, M being a counting number less than N, configured to make a determination of whether to create the dictionary based on at least one of an instruction from the user, the counting number M, and an amount of the user speech recorded;
a dictionary creation unit configured to create the dictionary by utilizing the user speech and the first sentences corresponding to the user speech when the necessity determining unit makes the determination that the dictionary creation unit needs to create the dictionary;
a speech synthesis unit configured to convert a second sentence, which is the same as the displayed at least one first sentence, to a synthesized speech by utilizing the dictionary; and
a quality evaluation unit configured to evaluate a sound quality of the synthesized speech, wherein
the sentence display unit is configured to stop displaying the currently displayed at least one first sentence when the quality evaluation unit evaluates that the sound quality of the synthesized speech has reached a certain high quality.

2. The apparatus according to claim 1 , wherein
the recording unit stops recording the user speech when the quality evaluation unit evaluates that the sound quality of the synthesized speech has reached a certain high quality.

3. The apparatus according to claim 2 , wherein
the quality evaluation unit is configured to obtain an evaluation of the sound quality of the synthesized speech from a user who previews the synthesized speech.

4. The apparatus according to claim 1 , wherein
the second sentence is one of the N sentences, and
the quality evaluation unit evaluates the sound quality of the synthesized speech based on a similarity between the synthesized speech and user speech corresponding to the second sentence.

5. An apparatus for creating a dictionary for speech synthesis, comprising:
a sentence storage unit configured to store N sentences where N is a counting number, each sentence being prepared in advance to prompt a user to utter;
a sentence display unit configured to selectively display at least one first sentence, each first sentence being one of the N sentences;
a recording unit configured to record each user speech corresponding to each first sentence;
a necessity determination unit, under a condition that the recording unit records the user speech of M first sentences, M being a counting number less than N, configured to make a determination of whether to create the dictionary based on at least one of an instruction from the user, the counting number M, and an amount of the user speech recorded;
a dictionary creation unit configured to create the dictionary by utilizing the user speech and the first sentences corresponding to the user speech when the necessity determining unit makes the determination that the dictionary creation unit needs to create the dictionary; and
a speech synthesis unit configured to convert a second sentence, which is the same as the displayed at least one first sentence, to a synthesized speech by utilizing the dictionary, wherein
the dictionary creation unit is configured to select an algorithm between an adaptive algorithm and a training algorithm based on the counting number M or the amount of the user speech recorded and to create the dictionary with the selected algorithm;
wherein the sentence display unit is configured to stop displaying the currently displayed at least one first sentence when the quality evaluation unit evaluates that the sound quality of the synthesized speech has reached a certain high quality.

6. An apparatus for creating a dictionary for speech synthesis, comprising:
a sentence storage unit configured to store N sentences where N is a counting number, each sentence being prepared in advance to prompt a user to utter;
a sentence display unit configured to selectively display at least one first sentence, each first sentence being one of the N sentences;
a recording unit configured to record each user speech corresponding to each first sentence;
a necessity determination unit, under a condition that the recording unit records the user speech of M first sentences, M being a counting number less than N, configured to make a determination of whether to create the dictionary based on at least one of an instruction from the user, the counting number M, and an amount of the user speech recorded;
a dictionary creation unit configured to create the dictionary by utilizing the user speech and the first sentences corresponding to the user speech when the necessity determining unit makes the determination that the dictionary creation unit needs to create the dictionary;
a speech synthesis unit configured to convert a second sentence, which is the same as the displayed at least one first sentence, to a synthesized speech by utilizing the dictionary, wherein
the recording unit judges a recording condition of the user speech, and records the user speech when the recording condition of the user speech is judged to be appropriate;
wherein the sentence display unit is configured to stop displaying the currently displayed at least one first sentence when the quality evaluation unit evaluates that the sound quality of the synthesized speech has reached a certain high quality.

7. A method for creating a dictionary for speech synthesis, the method comprising:
displaying at least one first sentence to a user, each first sentence being selected from N sentences in series where N is a counting number, the N sentences being stored in a sentence storage unit;
recording each user speech corresponding to each first sentence;
making a determination of whether to create the dictionary under a condition that the user speech of M first sentences is recorded, M being a counting number less than N, the determination being based on at least one of an instruction from the user, the counting number M, and an amount of the user speech being recorded;
creating the dictionary by utilizing the user speech and the first sentences corresponding to the user speech when the determination to create the dictionary is made;
converting, using a computer, a second sentence, which is the same as the displayed at least one first sentence, to a synthesized speech by utilizing the dictionary;
evaluating a sound quality of the synthesized speech; and
stopping the displaying of the currently displayed at least one first sentence when the evaluated sound quality of the synthesized speech has reached a certain high quality.

8. A method for creating a dictionary for speech synthesis, the method comprising:
displaying at least one first sentence to a user, the first sentence being selected from N sentences in series where N is a counting number, the N sentences being stored in a sentence storage unit;
recording each user speech corresponding to each first sentence;
making a determination of whether to create the dictionary under a condition that the user speech of M first sentences is recorded, M being a counting number less than N, the determination being based on at least one of an instruction from the user, the counting number M, and an amount of the user speech being recorded;
selecting an algorithm betwee

Assignees

• Tachibana Kentaro
• Morita Masahiro
• Kagoshima Takehiko
• Toshiba Kk

Inventors

• Tachibana Kentaro
• Morita Masahiro
• Kagoshima Takehiko

Classifications

• G10L25/60

  for measuring the quality of voice signals · CPC title

• G10L13/06

  Elementary speech units used in speech synthesisers; Concatenation rules · CPC title

• G10L13/02 Primary

  Methods for producing synthetic speech; Speech synthesisers · CPC title