Method and apparatus for recording and playing user voice in mobile terminal by synchronizing with text

Patent metadata

Field	Value
Publication number	US-9786267-B2
Application number	US-201313934973-A
Country	US
Kind code	B2
Filing date	Jul 3, 2013
Priority date	Jul 6, 2012
Publication date	Oct 10, 2017
Grant date	Oct 10, 2017

Abstract

A method and an apparatus for recording and playing a user voice in a mobile terminal are provided. The method for recording and storing a user voice in a mobile terminal includes entering a page by executing an electronic book, identifying whether a user voice record file related to the page exists, generating a user voice record file related to the page by recording a text included in the page to a user voice if the user voice record file does not exist, and playing by synchronizing the user voice stored in the user voice record file with the text if the user voice record file exists. Accordingly, a user voice can be recorded corresponding to a text of a page when recording a specific record of an electronic book, and the text corresponding to the user voice being played can be highlighted by synchronizing the user voice and the text.

First claim

What is claimed is:

1. A method for recording and playing a user voice in a mobile terminal, the method comprising:
entering a page by executing an electronic book;
identifying, by the mobile terminal, whether a first user voice record file related to the page exists;
generating the first user voice record file related to the page by recording a text included in the page to a user voice if the first user voice record file does not exist;
playing the user voice by synchronizing the user voice stored in the first user voice record file with the text if the first user voice record file exists;
generating a phonemic voice file by classifying the user voice stored in the first user voice record file by phoneme;
comparing the phonemic voice file with all the text included in the electronic book; and
generating a second user voice record file related to remaining pages without a stored user voice record file if a percentage of the phonemic voice file for all the text is higher than a predetermined level,
wherein if a required phoneme is not stored in a Text To Speech (TTS) database, then informing a user by a suggestion to record phoneme.

2. The method of claim 1 , wherein the generating of the first user voice record file comprises recording a text included in the page to a user voice and a synchronization file including text location information corresponding to each time section of the first user voice record file.

3. The method of claim 1 , wherein the generating of the first user voice record file further comprises:
identifying whether a touch input corresponding to a text location is detected if a record command for the text is received; and
starting to record a user voice if the touch input is not detected within a predetermined time elapse.

4. The method of claim 3 , further comprising setting the text location detected by the touch input as an initial location starting to record a user voice if the touch input corresponding to the text location is detected.

5. The method of claim 1 , further comprising:
informing a user that the auto complete of recording is possible, if the percentage of the phonemic voice file for all the text is higher than the predetermined level.

6. The method of claim 1 , wherein the playing of the user voice comprises highlighting a text corresponding to the user voice stored in the first user voice record file.

7. The method of claim 1 , wherein the playing of the user voice further comprises:
identifying whether a synchronization file related to the first user voice record file exists if a play command is received;
identifying text location information corresponding to each time section of the first user voice record file included in the synchronization file if the synchronization file exists; and
playing the user voice by synchronizing the user voice recorded in the first user voice record file with the text according to the result of the identification.

8. The method of claim 7 , further comprising:
converting a user voice recorded in the first user voice record file related to the page to the text if the synchronization file does not exist; and
playing the user voice by synchronizing the converted text with the text included in the page.

9. An apparatus for recording and playing a user voice in a mobile terminal, the apparatus comprising:
an input device configured to receive a user input;
a display configured to display a text included in an electronic book; and
at least one processor configured to:
identify whether a first user voice record file related to the page exists when entering a page of the electronic book,
generate the first user voice record file by recording a text included in the page to a user voice if the user voice record file does not exist,
play the user voice by synchronizing the user voice stored in the first user voice record file with the text if the first user voice record file exists,
generate a phonemic voice file by classifying the user voice by phoneme,
compare the phonemic voice file with all the text included in the electronic book, and
generate a second user voice record file related to remaining pages without a stored user voice record file if a percentage of the phonemic voice file for all the text is higher than a predetermined level,

wherein if a required phoneme is not stored in a Text To Speech (TTS) database, then informing a user by a suggestion to record phoneme.

10. The apparatus of claim 9 , wherein the at least one processor is further configured to generate the first user voice record file by recording a text included in the page to a user voice and a synchronization file including text location information corresponding to each time section of the first user voice record file.

11. The apparatus of claim 9 , wherein the at least one processor is further configured to:
identify whether a touch input corresponding to a text location is detected if a record command for the text is received, and
start recording a user voice if the touch input is not detected within a predetermined time elapse.

12. The apparatus of claim 11 , wherein the at least one processor is further configured to set the text location detected by the touch input as an initial location starting to record a user voice if the touch input corresponding to the text location is detected.

13. The apparatus of claim 9 , wherein the at least one processor is further configured to:
inform a user that the auto complete of recording is possible, if the percentage of the phonemic voice file for all the text is higher than the predetermined level.

14. The apparatus of claim 9 , wherein the at least one processor is further configured to highlight a text corresponding to the user voice stored in the first user voice record file.

15. The apparatus of claim 9 , wherein the at least one processor is further configured to:
identify whether a synchronization file related to the first user voice record file exists if a play command is received,
identify text location information corresponding to each time section of the first user voice record file included in the synchronization file if the synchronization file exists, and
play the user voice by synchronizing the user voice recorded in the first user voice record file with the text according to the result of the identification.

16. The apparatus of claim 15 , wherein the at least one processor is further configured to:
convert a user voice recorded in the first user voice record file related to the page to the text if the synchronization file does not exist, and
play, by synchronizing the converted text with the text included in the page.

17. A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one processor to perform a method comprising:
entering a page by executing an electronic book;
identifying whether a first user voice record file related to the page exists;
generating the first user voice record file related to the page by recording a text included in the page to a user voice if the first user voice record file does not exist;
playing the user voice by synchronizing the user voice stored in the first user voice record file with the text if the first user voice record file exists;
generating a phonemic voice file by classifying the user voice by phoneme;
comparing the phonemic voice file with all the text included in the electronic book; and
generating a second user voice record file related to remaining pages without a stored user voice record file if a percentage of the phonemic voic

Assignees

• Samsung Electronics Co Ltd
• Samsung Electronics Co Ltd

Inventors

• Mok Jieun
• Kwak Byeonghoon

Classifications

• G11B27/10

  Indexing; Addressing; Timing or synchronising; Measuring tape travel · CPC title

• G10L13/00 Primary

  Speech synthesis; Text to speech systems · CPC title

• G06F3/14

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title

• G11B20/10 Primary

  Digital recording or reproducing · CPC title