Mobile terminal and method for controlling the same

Patent metadata

Field	Value
Publication number	US-10261671-B2
Application number	US-201615184223-A
Country	US
Kind code	B2
Filing date	Jun 16, 2016
Priority date	Oct 21, 2015
Publication date	Apr 16, 2019
Grant date	Apr 16, 2019

Abstract

The present invention relates to a mobile terminal, capable of controlling a head mounted display (HMD), and a method for controlling the same. The mobile terminal capable of controlling the HMD includes an interface unit capable of allowing for a wired connection with the head mounted display, and a controller capable of detecting an eye motion of a user wearing the head mounted display using a sensing unit provided in the head mounted display, and controlling a display unit of the head mounted display by a preset method when the eye motion corresponds to a preset motion.

First claim

What is claimed is:

1. A mobile terminal for controlling a head mounted display (HMD) having a display and a first sensor, the mobile terminal comprising:
an interface to provide a wired connection with the head mounted display; and
a controller configured to detect an eye motion of a user wearing the head mounted display based on information from the first sensor at the head mounted display, and the controller to control the display at the head mounted display when the detected eye motion corresponds to a preset motion,
wherein the controller is configured to control the display of the head mounted display to output a first part of a virtual space, wherein the virtual space includes at least one graphic object linked to a preset function, and
wherein the controller is configured to:
determine whether the at least one graphic object linked to the preset function is included in the first part of the virtual space,
control the display to reduce output brightness of the display of the head mounted display when the at least one graphic object is determined to not be included in the first part of the virtual space displayed on the display of the head mounted display,
display a second part, different from the first part, of the virtual space on the display of the head mounted display in response to movement of the head mounted display,
determine whether the at least one graphic object linked to the preset function is included in the second part of the virtual space, and
control the display to restore the reduced output brightness of the display to an original output brightness of the display when the at least one graphic object is determined to be included in the second part of the virtual space displayed on the head mounted display.

2. The terminal of claim 1 , wherein the preset motion corresponds to a motion of the user closing at least one eye.

3. The terminal of claim 2 , wherein the controller is configured to control brightness of the display at the head mounted display when the detected motion is the closing of the at least one eye.

4. The terminal of claim 2 , wherein in response to the detected motion of the at least one eye, the controller is configured to stop a video when screen information output on the display corresponds to the video.

5. The terminal of claim 1 , wherein the controller detects movement of the head mounted display based on the first sensor at the head mounted display, and
wherein when the head mounted display is moved in a preset manner while first screen information is output, the display at the head mounted display outputs second screen information, different from the first screen information.

6. The terminal of claim 5 , wherein in response to detection of the user closing at least one eye after the head mounted display moves in the preset motion, the controller outputs the second screen information on the display.

7. The terminal of claim 5 , wherein the controller controls the display to output a graphic object linked to a function of outputting the second screen information on the display when the head mounted display moves in the preset motion.

8. The terminal of claim 7 , further comprising:
a terminal body; and
a second sensor to detect movement of a terminal body,
wherein the controller detects the eyes of the user based on the first sensor of the head mounted display, and
wherein the controller controls the display to output the second screen information on the display when the terminal body is moved in a specific manner while the graphic object is viewed.

9. The terminal of claim 5 , wherein the controller controls the display to output a graphic object linked to a function of outputting the first screen information on the display when a motion of the eyes being opened is detected by the first sensor of the head mounted display while the second screen information is output on the display at the head mounted display.

10. The terminal of claim 1 , further comprising:
a terminal body; and
a second sensor to detect movement of a terminal body, and
wherein the controller controls the display to reduce output brightness of the display when the terminal body is moved in a specific manner.

11. The terminal of claim 1 , wherein the controller is configured to control the display of the head mounted display to display a first screen information,
when a movement of the head mounted display is sensed by the controller while a motion of the eyes being opened is detected via the first sensor, the controller controls the display of the head mounted display to display a second screen information rather than the first screen information, and
when the movement of the head mounted display is sensed by the controller while a motion of the eyes being closed is detected via the first sensor, the controller controls the display of the head mounted display to fix the first screen information displayed on the display of the head mounted display without change.

12. A method of controlling a mobile terminal for controlling a head mounted display (HMD) that is coupled to the mobile terminal by a wire, the head mounted display having a display and a first sensor, the method comprising:
detecting an eye motion of a user wearing the head mounted display based on information from the first sensor at the head mounted display;
controlling the display at the head mounted display when the detected motion corresponds to a preset motion;
controlling the display of the head mounted display to output a first part of a virtual space, wherein the virtual space includes at least one graphic object linked to a preset function;
determining whether the at least one graphic object linked to the preset function is included in the first part of the virtual space;
controlling the display to reduce output brightness of the display of the head mounted display when the at least one graphic object is determined to not be included in the first part of the virtual space displayed on the display of the head mounted display;
displaying a second part, different from the first part, of the virtual space on the display of the head mounted display in response to movement of the head mounted display;
determining whether the at least one graphic object linked to the preset function is included in the second part of the virtual space; and
controlling the display to restore the reduced output brightness of the display to an original output brightness of the display when the at least one graphic object is determined to be included in the second part of the virtual space displayed on the head mounted display.

13. The method of claim 12 , wherein the preset motion corresponds to a motion of the user closing at least one eye.

14. The method of claim 13 , comprising changing brightness of the display at the head mounted display when the detected motion is the closing of the at least one eye.

15. The method of claim 13 , further comprising in response to the detected motion of the at least one eye, stopping a video when screen information output on the display corresponds to the video.

16. The method of claim 13 , further comprising:
varying screen information output on the display based on movement of the head mounted display; and
maintaining the screen information output on the display without varying the screen information when the head mounted display is moved while the user closes at least one of the eyes.

17. The method of claim 12 , further comprising:
reducing output brightness of the display when an output of a part, without including the at least graphic object, o

Assignees

• Lg Electronics Inc

Inventors

• Park Cheongha
• Joo Goeun

Classifications

• G06F3/03547

  Touch pads, in which fingers can move on a surface · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/033

  Pointing devices displaced or positioned by the user {, e.g. mice, trackballs, pens or joysticks}; Accessories therefor (digitisers characterised by the transducing means G06F3/041) · CPC title

• G06F3/0484 Primary

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G02B27/017

  Head mounted · CPC title