Mobile terminal and operation control method thereof

Patent metadata

Field	Value
Publication number	US-9323324-B2
Application number	US-201113190691-A
Country	US
Kind code	B2
Filing date	Jul 26, 2011
Priority date	Oct 5, 2010
Publication date	Apr 26, 2016
Grant date	Apr 26, 2016

Abstract

A mobile terminal and an operation control method thereof are provided. The operation control method includes displaying a stereoscopic 3D image, which is created based on the disparity between left- and right-eye images, on a display module; determining a position of a user's gaze on the stereoscopic 3D image by performing eye tracking; and varying a 3D effect of a portion of the stereoscopic 3D image corresponding to the determined gaze position. Therefore, it is possible to effectively control various operations performed by a mobile terminal in connection with a stereoscopic 3D image by using eye tracking.

First claim

What is claimed is:

1. An operation control method of a mobile terminal, the operation control method comprising:
displaying a stereoscopic three-dimensional (3D) image, the stereoscopic 3D image being created by disparity between left- and right-eye images, on a display module;
driving a camera in response to an object being detected within a close vicinity of the camera by a proximity sensor;
determining a position of a user's gaze on the stereoscopic 3D image by performing eye tracking based on an image of the user captured by the camera; and
varying a 3D effect of a portion of the stereoscopic 3D image corresponding to the determined gaze position,
wherein varying the 3D effect comprises highlighting the portion of the stereoscopic 3D image corresponding to the detected gaze position such that the portion of the stereoscopic 3D image appears to protrude further than the rest of the stereoscopic 3D image.

2. The operation control method of claim 1 , further comprising, in response to the position of the user's gaze on the stereoscopic 3D image moving, displaying the stereoscopic 3D image portion corresponding to the determined gaze position with an original 3D effect.

3. The operation control method of claim 1 , further varying a 3D effect of an object corresponding to the determined gaze position.

4. The operation control method of claim 1 , further comprising highlighting a part of the stereoscopic 3D image according to a setting in the mobile terminal.

5. The operation control method of claim 1 , further comprising:
receiving an input from the user and controlling an operation corresponding to the input.

6. The operation control method of claim 1 , further comprising:
receiving an incoming communication event and controlling an operation corresponding to the incoming communication event.

7. The operation control method of claim 1 , further comprising:
repeating the steps of displaying a stereoscopic three-dimensional (3D) image, determining a position of a user's gaze on the stereoscopic 3D image by performing eye tracking, and varying a 3D effect of a portion of the stereoscopic 3D image corresponding to the determined gaze position until the user chooses to stop displaying the stereoscopic 3D image.

8. The operation control method of claim 1 , further comprising:
emphasizing the 3D effect on the portion gazed upon by the user.

9. The operation control method of claim 1 , further comprising:
receiving a touch input to select a gaze position; and
moving the determined position of a user's gaze to a position of the touch input.

10. A mobile terminal, comprising:
a camera;
a display configured to display a stereoscopic 3D image, the stereoscopic 3D image being created by disparity between left- and right-eye images; and
a proximity sensor configured to detect an object within a close vicinity of the camera; and
a controller configured to:
drive the camera in response to detection of the object;
determine a position of a user's gaze on the stereoscopic 3D image by performing eye tracking based on an image of the user captured by the camera;
vary a 3D effect of a portion of the stereoscopic 3D image corresponding to the determined gaze position; and
highlight the portion of the stereoscopic 3D image corresponding to the detected gaze position such that the portion of the stereoscopic 3D image appears to protrude further than the rest of the stereoscopic 3D image.

11. The mobile terminal of claim 10 , wherein the controller is further configured to, in response to the position of the user's gaze on the stereoscopic 3D image moving, display the stereoscopic 3D image portion corresponding to the determined gaze position with an original 3D effect.

Assignees

• Kim Jonghwan
• Lg Electronics Inc

Inventors

• Kim Jonghwan

Classifications

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G02B13/001

  Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras (G02B23/243 takes precedence) · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• H04N13/383

  for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes · CPC title

• G02B30/27

  involving lenticular arrays · CPC title