Mobile terminal and controlling method thereof

Patent metadata

Field	Value
Publication number	US-9401139-B2
Application number	US-201314012732-A
Country	US
Kind code	B2
Filing date	Aug 28, 2013
Priority date	Sep 24, 2012
Publication date	Jul 26, 2016
Grant date	Jul 26, 2016

Abstract

A mobile terminal and controlling method thereof are disclosed, by which a feedback matching a meaning of a natural language is outputted in the course of outputting a sound corresponding to the natural language by sentence unit. The present invention includes a display unit configured to display a text by sentence unit, an audio output module configured to output a synthetic sound generated from converting the text to a sound, and a controller configured to generate the synthetic sound, extract a meaning of the text, and control a feedback matching the meaning of the text to be outputted while the synthetic sound is outputted via the audio output module.

First claim

What is claimed is:

1. A mobile terminal comprising:
a display unit configured to display a text corresponding to a sentence unit;
an audio output module configured to output a synthetic sound generated from converting the text to a sound; and
a controller configured to:
generate the synthetic sound;
extract a meaning of the text;
cause a feedback to be output corresponding to the meaning of the text while the synthetic sound is output via the audio output module, wherein the feedback comprises a background sound of the synthetic sound;
analyze a sound wave of the background sound and set an exceeding interval in which an amplitude of the sound wave is greater than a threshold, wherein the threshold comprises an average amplitude of the sound wave;
cause a vibration to be output while the background sound is output, wherein the vibration is output when the exceeding interval is output via the audio output unit; and
adjust an output strength of the vibration based on a rate between the average amplitude of the sound wave and a maximum amplitude in the exceeding interval.

2. The mobile terminal of claim 1 , wherein the controller is further configured to cause the feedback to be output when an output of synthetic sound corresponding to a core word associated with the feedback is started.

3. The mobile terminal of claim 1 , wherein the controller is further configured to add a silence period to at least before starting the output of the synthetic sound or after completion of the output of the synthetic sound if a play time of the feedback is longer than that of the synthetic sound,
wherein a total play time of the silence period and the synthetic sound is equal to or greater than the play time of the feedback.

4. The mobile terminal of claim 1 , wherein the output strength of the vibration is determined by formulas as follows:

N
level

=

Int
⁡

(

Local_MaxAmp
Threshold

)

,

⁢

if
⁢

(

N
Maxlevel

≥

Global_MaxAmp
Threshold

)

;

N
level

=

Int
⁡

(

1
Step

×

(

Local_MaxAmp
Threshold

)

)

,

⁢

if
⁢

(

N
Maxlevel

<

Global_MaxAmp
Threshold

)

;

and

Step
=

1

N
Maxlevel

×

Int
⁡

(

Global_MaxAmp
Threshold

)

wherein:
N level indicates a vibration strength level in the exceeding interval;
Int indicates an integer function;
Local_Max Amp indicates a maximum amplitude in the exceeding interval;
Threshold indicates a threshold; and
N Maxlevel indicates a settable maximum vibration strength level.

5. The mobile terminal of claim 1 , wherein the feedback further comprises displaying an image corresponding to the meaning of the text, and wherein the controller is further configured to cause the image to be displayed as a background screen of the display unit while the synthetic sound is output.

6. The mobile terminal of claim 1 , wherein the controller is further configured to cause the feedback to be output in a manner of changing an output color of the display unit or adjusting a brightness of the display unit.

7. The mobile terminal of claim 1 , wherein the feedback further comprises a flickering of a light source, and the light source comprises a camera flash configured to provide light.

8. A method of controlling a mobile terminal, the method comprising:
displaying a text corresponding to a sentence unit;
generating a synthetic sound by converting the text to a sound;
extracting a meaning of the text;
determining a feedback corresponding to the meaning of the text;
outputting the synthetic sound;
outputting the feedback while the synthetic sound is output, wherein the feedback comprises a background sound of the synthetic sound;
analyzing a sound wave of the background sound and setting an exceeding interval in which an amplitude of the sound wave is greater than a threshold, wherein the threshold comprises an average amplitude of the sound wave;
outputting a vibration while the background sound is output, wherein the vibration is output when the exceeding interval is output via an audio output unit; and
adjusting an output strength of the vibration based on a rate between the average amplitude of the sound wave and a maximum amplitude in the exceeding interval.

Assignees

• Lg Electronics Inc

Inventors

• Kim Taejun
• Nam Yunae

Classifications

• H04M1/72522

  Electricity · mapped topic

• G10L13/086 Primary

  Detection of language · CPC title

• H04B1/40

  Circuits · CPC title

• G10L13/08 Primary

  Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination · CPC title

• G10L13/00 Primary

  Speech synthesis; Text to speech systems · CPC title