Mobile terminal and method of controlling the mobile terminal for moving image playback

Patent metadata

Field	Value
Publication number	US-9639251-B2
Application number	US-201414147906-A
Country	US
Kind code	B2
Filing date	Jan 6, 2014
Priority date	Jul 11, 2013
Publication date	May 2, 2017
Grant date	May 2, 2017

Abstract

Provided is a mobile terminal including a display unit on which a moving image is output; a user input unit through which a moving image segment of the moving image is selected; and a controller that outputs video information corresponding to audio information that is output from the selected moving image segment, on the display unit. The controller converts voice information that is output from the selected moving image segment into text information and outputs the text information on the display unit.

First claim

What is claimed is:

1. A mobile terminal comprising:
a display unit configured to display a moving image and a search bar that adjusts a point in time for playback of the moving image, wherein positions of the search bar correspond to points in time for playback of the moving image, respectively; and
a controller configured to:
detect a touch input applied to a position of the search bar,
select a point in time for the playback of the moving image corresponding to the position of the touch input in response to the detection of the touch input applied to the search bar,
convert audio information that is output from the selected point in time for the playback of the moving image into text information,
display, on the display unit, a scene image of the moving image corresponding to the selected point in time together with the text information while maintaining the touch input, and
in response to dragging the touch input to another position of the search bar, change the displayed scene image and the text information into another scene image of the moving image corresponding to the changed point in time and another text information corresponding to audio information that is output from the changed point in time while dragging the touch input,
wherein the text information is displayed on a selected position of the search bar that corresponds to the selected point in time or the changed point in time for the playback of the moving image,
wherein the controller adjusts a size of the text information based on a speed of the dragging applied on the search bar for increasing readability,
wherein an image including the text information is differently displayed based on a characteristic of the audio information that is output from the selected point in time or the changed point in time while dragging the touch input, and
wherein the characteristic of the audio information includes an amount of voice and/or a voice tone of the audio information corresponding to the text information.

2. The mobile terminal of claim 1 , wherein the controller is further configured to display a keyword in the text information corresponding to the converted text information depending on the speed of the dragging applied on the search bar.

3. The mobile terminal of claim 1 , wherein the controller is further configured to enter a search mode when the touch input is applied to the search bar.

4. The mobile terminal of claim 1 , wherein the controller is further configured to display multiple audio bars corresponding to multiple audio information input when playing back the moving image, respectively, and
wherein, with respect to each of the audio bars, the controller outputs items of text information corresponding to items of audio information that are output from the selected point in time for the playback of the moving image, on positions of the audio bar corresponding to the points in time for the playback, respectively.

5. The mobile terminal of claim 1 , wherein when the speed of the dragging applied on the search bar exceeds a predetermined speed, the controller converts a part of the audio information into the text information and displays the resulting part of the text information.

6. A method of controlling a mobile terminal, the method comprising:
displaying, on a display unit of the mobile terminal, a moving image and a search bar that adjusts a point in time for playback of the moving image, wherein positions of the search bar correspond to points in time for playback of the moving image, respectively;
detecting a touch input applied to a position of the displayed search bar;
selecting a point in time for the playback of the moving image corresponding to the position of the touch input in response to the detection of the drag input applied to the search bar;
converting audio information that is output from the selected point in time for the playback of the moving image into text information;
displaying together with a scene image of the moving image corresponding to the selected point in time and the text information while maintaining the touch input; and
in response to dragging the touch input to another position of the search bar, changing the displayed scene image and the text information into another scene image of the moving image corresponding to the changed point in time and another text information corresponding to audio information that is output from the changed point in time while dragging the touch input,
wherein the text information is displayed on a selected position of the search bar that corresponds to the selected point in time or the changed point in time for the playback of the moving image,
wherein the a size of the text information is differently adjusted based on a speed of the dragging applied on the search bar for increasing readability,
wherein an image including the text information is differently displayed based on a characteristic of the audio information that is output from the selected point in time or the changed point in time while dragging the touch input, and
wherein the characteristic of the audio information includes an amount of voice and/or a voice tone of the audio information corresponding to the text information.

7. The method of claim 6 , wherein the displaying of the text information includes displaying a keyword in the text information corresponding to the converted text information depending on the speed of the dragging applied to the search bar, on the display unit.

8. The method of claim 6 , wherein, as a result of the selected point in time for the playback of the moving image being selected, a search mode is entered.

9. The method of claim 6 , wherein the selecting of the point in time for the playback of the moving image includes displaying multiple audio bars corresponding to the multiple audio information that are input when playing back the moving image, respectively, and
wherein the displaying of the text information includes displaying items of text information corresponding to the items of audio information that are output from the points in time for the playback, on positions of the audio bar corresponding to the points in time for the playback of the moving image, respectively, with respect to each of the audio bars.

Assignees

• Lg Electronics Inc

Inventors

• Lee Jungbin
• Han Miran
• Lee Seulah
• Rhee Jeongyoon

Classifications

• H04N21/440236

  by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text · CPC title

• G11B27/34

  Indicating arrangements  {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} · CPC title

• G11B27/28

  by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)} · CPC title

• G11B27/11

  by using information not detectable on the record carrier · CPC title

• G11B27/005

  Reproducing at a different information rate from the information rate of recording (for television signals H04N5/783) · CPC title