Mobile terminal and method of controlling the operation of the mobile terminal

Patent metadata

Field	Value
Publication number	US-9456205-B2
Application number	US-201113229590-A
Country	US
Kind code	B2
Filing date	Sep 9, 2011
Priority date	Sep 20, 2010
Publication date	Sep 27, 2016
Grant date	Sep 27, 2016

Abstract

A mobile terminal and a method of controlling the operation of the mobile terminal are provided. The method includes dividing each of first and second images into a plurality of blocks, the first and second images capable of realizing a three-dimensional (3D) image using binocular disparity; searching the first and second images for pairs of matching blocks and calculating depth information of each of the pairs of matching blocks based on a difference in position between each of the pairs of matching blocks; and calculating stereoscopic information of the 3D image based on the depth information of each of the pairs of matching blocks. Therefore, it is possible to effectively provide stereoscopic information of a 3D image for various purposes.

First claim

What is claimed is:

1. A method of controlling operation of a mobile terminal, the method comprising:
dividing at least a first and second image into a plurality of blocks, the first and second images capable of producing a three-dimensional (3D) image using binocular disparity;
searching the at least first and second image for at least one pair of matching blocks based on a block matching algorithm using an evaluation function;
calculating depth information related to each of the at least one pair of matching blocks based on a difference in position between each of the at least one pair of matching blocks;
calculating stereoscopic information related to the 3D image based on the calculated depth information, the stereoscopic information calculated as an average or standard deviation of the calculated depth information of each of the at least one pair of matching blocks;
displaying a playback screen of the 3D image in a color mode on a display module, the playback screen comprising a plurality of objects;
displaying one or more objects selected from the playback screen three-dimensionally and non-selected objects two-dimensionally during the color mode;
converting the playback screen from the color mode into a gray mode and displaying a stereoscopic information gauge on the playback screen when a user command for displaying the stereoscopic information related to the 3D image is detected, the stereoscopic information gauge divided into a plurality of sections filled with different brightness; and
adjusting a degree of three-dimensionality of the playback screen in response to a user input detected on the stereoscopic information gauge during the gray mode.

2. The method of claim 1 , wherein the stereoscopic information is further calculated in units of playback segments.

3. The method of claim 1 , further comprising displaying the stereoscopic information as at least numeric data, a graph or an image.

4. The method of claim 1 , further comprising displaying an indicator of the stereoscopic information on the display module.

5. A mobile terminal comprising:
a display module configured to display a three-dimensional (3D) image based on at least a first and second image using binocular disparity; and
a controller configured to:
divide the at least first and second image into a plurality of blocks;
search the at least first and second image for at least one pair of matching blocks based on a block matching algorithm using an evaluation function;
calculate depth information related to each of the at least one pair of matching blocks based on a difference in position between each of the at least one pair of matching blocks;
calculate stereoscopic information related to the 3D image based on the calculated depth information, the stereoscopic information calculated as an average or standard deviation of the calculated depth information of each of the at least one pair of matching blocks;
display a playback screen of the 3D image in a color mode on the display module, the playback screen comprising a plurality of objects;
display one or more objects selected from the playback screen three-dimensionally and non-selected objects two-dimensionally during the color mode;
convert the playback screen from the color mode into a gray mode and display a stereoscopic information gauge on the playback screen when a user command for displaying the stereoscopic information related to the 3D image is detected, the stereoscopic information gauge divided into a plurality of sections filled with different brightness; and
adjust a degree of three-dimensionality of the playback screen in response to a user input detected on the stereoscopic information gauge during the gray mode.

6. The mobile terminal of claim 5 , wherein the controller is further configured to display the stereoscopic information on the display module as at least numeric data, a graph or an image.

7. The mobile terminal of claim 5 , further comprising a memory configured to store the at least first and second image and the stereoscopic information.

8. A method of controlling operation of a mobile terminal, the method comprising:
dividing at least a first and second image into a plurality of blocks, the first and second images capable of producing a three-dimensional (3D) image using binocular disparity;
searching the at least first and second image for at least one pair of matching blocks based on a block matching algorithm using an evaluation function;
calculating depth information related to each of the at least one pair of matching blocks based on a difference in position between each of the at least one pair of matching blocks;
calculating stereoscopic information related to the 3D image based on the calculated depth information, the stereoscopic information calculated as an average or standard deviation of the calculated depth information of each of the at least one pair of matching blocks and in units of Intra-coded frames (I-frames) of a moving image;
inserting the stereoscopic information into a transport packet of the I-frames; and transmitting the transport packet to another device;
displaying a playback screen of the 3D image in a color mode on a display module, the playback screen comprising a plurality of objects;
displaying one or more objects selected from the playback screen three-dimensionally and non-selected objects two-dimensionally during the color mode;
converting the playback screen from the color mode into a gray mode and displaying a stereoscopic information gauge on the playback screen when a user command for displaying the stereoscopic information related to the 3D image is detected, the stereoscopic information gauge divided into a plurality of sections filled with different brightness; and
adjusting a degree of three-dimensionality of the playback screen in response to a user input detected on the stereoscopic information gauge during the gray mode.

9. The method of claim 8 , further comprising displaying an indicator of the stereoscopic information on the display module.

10. The method of claim 8 , wherein the stereoscopic information gauge is displayed in response to a particular user command or when the stereoscopic information satisfies a predefined set of conditions.

11. A mobile terminal comprising:
a display module configured to display information; and
a controller configured to:
divide each of the at least first and second image into a plurality of blocks, the first and second images capable of producing a three-dimensional (3D) image using binocular disparity;
search the at least first and second image for at least one pair of matching blocks based on a block matching algorithm using an evaluation function;
calculate depth information related to each of the at least one pair of matching blocks based on a difference in position between each of the at least one pair of matching blocks;
calculate stereoscopic information related to the 3D image based on the calculated depth information, the stereoscopic information calculated as an average or standard deviation of the calculated depth information of each of the at least one pair of matching blocks and in units of Intra-coded frames (I-frames) of a moving image;
insert the stereoscopic information into a transport packet of the I-frames and transmit the transport packet to another device;
display a playback screen of the 3D image in a color mode on the display module, the playback screen comprising a plurality of objects;
display one or more objects selected from the playback screen three-dimensionally and non-selected objects two-dimensionally during the color mode;
convert the playback screen from the color mode into a gray mode

Assignees

• Seen Seungmin
• Lee Jinsool
• Kim Taeyun
• Lg Electronics Inc

Inventors

• Seen Seungmin
• Lee Jinsool
• Kim Taeyun

Classifications

• H04N13/0239

  Electricity · mapped topic

• H04N13/0022

  Electricity · mapped topic

• G06T2207/10012

  Stereo images · CPC title

• G06T7/0022

  Physics · mapped topic

• G06T7/0075

  Physics · mapped topic