Language delay treatment system and control method for the same

Patent metadata

Field	Value
Publication number	US-9875668-B2
Application number	US-201314047177-A
Country	US
Kind code	B2
Filing date	Oct 7, 2013
Priority date	Sep 5, 2013
Publication date	Jan 23, 2018
Grant date	Jan 23, 2018

Abstract

The present disclosures relates to a control terminal, comprising: a data communication unit for receiving a first user voice by data communication with a first audio device and receiving a second user voice by data communication with a second audio device; a turn information generating unit for generating turn information, which is voice unit information, by using the first and second user voices; and a metalanguage processing unit for determining a conversation pattern of the first and second users by using the turn information, and outputting a reminder message corresponding to a reminder event to the first user when the conversation pattern corresponds to a preset reminder event occurrence condition.

First claim

What is claimed is:

1. A control terminal comprising:
a data communication unit for receiving a first user voice by data communication with a first audio device and receiving a second user voice by data communication with a second audio device;
a turn information generating unit for generating turn information, which is voice unit information, by using the first and second user voices; and
a meta-language processing unit for determining a conversation pattern of the first and second users by using the turn information, and outputting a reminder message corresponding to a reminder event to the first user when the conversation pattern corresponds to a preset reminder event occurrence condition,
wherein the reminder event occurrence condition includes:
a first reminder event occurrence condition, which is triggered when the first user's turn repeats N dominance times in which pauses between adjacent turns are shorter than T wait and no second user's turns appear during the first user's turns, wherein
N dominance represents a preset repetition number of the first user's turns, and
T wait represents a preset interval time of the first user's turns;

a second reminder event occurrence condition, which is triggered when for the second user's given turn, neither the first nor the second user's turns appear within T neglect , for N grace2 times, wherein
N grace2 represents a preset repetition number of the second user's turns, and
T neglect represents a preset interval time of the second user's turns;

a third reminder event occurrence condition, which is triggered when the first user's turns begin before the second user's turns end, for N grace3 times, wherein
N grace3 represents a preset number of the first user's turns which occur before the second user's turns end;

a fourth reminder event occurrence condition, which is triggered when a duration time of the first user's turns is longer than T long and no second user's turns appear within T response4 after the first user's turns ends, wherein
T long represents a preset duration time of the first user's turns, and
T response4 represents a preset generation time of the second user's turns; and

a fifth reminder event occurrence condition, which is triggered when a syllable rate of the first user's turns is higher than R fast and no second user's turns appear within T response5 after the first user's turns end, wherein
R fast represents a preset voice speed, and
T response5 represents a preset generation time of the second user's turns.

2. The control terminal of claim 1 , further comprising a preprocessing unit for optionally processing the first and second user voices with respect to a voice range.

3. The control terminal of claim 1 , wherein the turn information includes at least one of speaker identification information, time, accent, loudness and speed of a unit voice.

4. The control terminal of claim 3 , wherein the turn information generating unit determines speaker identification information of the turn information according to a ratio of the first user voice and the second user voice.

5. The control terminal of claim 1 , wherein the turn information generating unit generates the turn information when the first user voice or the second user voice is equal to or greater than a preset loudness.

6. The control terminal of claim 1 , wherein the reminder event occurrence condition includes at least one of a case in which only a turn of the first user occurs during a preset time, a case in which only a turn of the second user occurs during a preset time, a case in which the turn of the first user occurs over a preset number before the turn of the second user ends, a case in which the turn of the first user continues over a preset time, and a case in which the turn of the first user is equal to or greater than a preset speed.

7. The control terminal of claim 2 , wherein the turn information includes at least one of speaker identification information, time, accent, loudness and speed of a unit voice.

8. The control terminal of claim 7 , wherein the turn information generating unit determines speaker identification information of the turn information according to a ratio of the first user voice and the second user voice.

9. The control terminal of claim 2 , wherein the turn information generating unit generates the turn information when the first user voice or the second user voice is equal to or greater than a preset loudness.

10. The control terminal of claim 2 , wherein the reminder event occurrence condition includes at least one of a case in which only a turn of the first user occurs during a preset time, a case in which only a turn of the second user occurs during a preset time, a case in which the turn of the first user occurs over a preset number before the turn of the second user ends, a case in which the turn of the first user continues over a preset time, and a case in which the turn of the first user is equal to or greater than a preset speed.

11. A control method for a language delay treatment system, which includes a first audio device for receiving a voice of a first user, a second audio device for receiving a voice of a second user, and a control terminal, the control method comprising:
receiving, by the control terminal, the first user voice by data communication with the first audio device;
receiving, by the control terminal, the second user voice by data communication with the second audio device;
generating, by the control terminal, turn information which is voice unit information by using the first and second user voices;
determining, by the control terminal, a conversation pattern of the first and second users by using the turn information; and
outputting, by the control terminal, a reminder message corresponding to a reminder event to the first user when the conversation pattern corresponds to a preset reminder event occurrence condition, which includes:
a first reminder event occurrence condition, which is triggered when the first user's turn repeats N dominance times in which pauses between adjacent turns are shorter than T wait and no second user's turns appear during the first user's turns, wherein
N dominance represents a preset repetition number of the first user's turns, and
T wait represents a preset interval time of the first user's turns;

a second reminder event occurrence condition, which is triggered when for the second user's given turn, neither the first nor the second user's turns appear within T neglect , for N grace2 times, wherein
N grace2 represents a preset repetition number of the second user's turns, and
T neglect represents a preset interval time of the second user's turns;

a third reminder event occurrence condition, which is triggered when the first user's turns begin before the second user's turns end, for N grace3 times, wherein
N grace3 represents a preset number of the first user's turns which occur before the second user's turns end;

a fourth reminder event occurrence condition, which is triggered when a duration time of the first user's turns is longer than T long and no second user's turns appear within T response4 after the first user's turns ends, wherein
T long represents a preset duration time of the first user's turns, and
T response4 represents a preset generation time of the second user's turns; and

a fifth reminder event occurrence condition, which is triggered when a syllable rate of the first user's turns is higher than R fast and no second user's turns appear within T response5 after the first user's turns end, wherein
R fast represents a preset voice speed, and
T response5 represents a preset generation time of th

Assignees

• Korea Advanced Inst Sci & Tech
• Korea Advanced Institute Of Science & Tech (Kaist)

Inventors

• Song June Hwa
• Hwang In Seok
• Yoo Chung Kuk
• Hwang Chan You
• Lee Young Ki
• Kim John Dong Jun
• Yim Dong Sun Jennifer
• Min Chul Hong

Classifications

• G09B5/04

  with audible presentation of the material to be studied (sound recording or reproducing G11B) · CPC title

• G09B5/14

  with provision for individual teacher-student communication · CPC title

• G10L25/78

  Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10) · CPC title

• G09B19/04 Primary

  Speaking (with audible presentation of the material to be studied G09B5/04) · CPC title