Head mounted display with separate wire connected controller

Patent metadata

Field	Value
Publication number	US-10185390-B2
Application number	US-201615214096-A
Country	US
Kind code	B2
Filing date	Jul 19, 2016
Priority date	Oct 26, 2015
Publication date	Jan 22, 2019
Grant date	Jan 22, 2019

Abstract

A system includes a head mounted display (HMD) having at least one of a display unit and a sensing unit and configured to be connected to a mobile terminal in a wired manner, and a mobile terminal configured to control the HMD, wherein the mobile terminal includes a terminal body, an interface unit provided in the terminal body and configured to be connected to the HMD in a wired manner, a sensing unit configured to sense a movement of the terminal body, and a controller configured to output a preset first region of a virtual space on the display unit of the HMD and control the display unit of the HMD to display a second region of the virtual space different from the first region of the virtual space on the basis of a movement of the HMD sensed through the sensing unit of the HMD.

First claim

What is claimed is:

1. A system comprising:
a head mounted display (HMD) having a display and a sensing unit; and
a mobile terminal configured to be coupled to the HMD for controlling the HMD, wherein the mobile terminal comprises:
a terminal body;
an interface unit configured to couple with the HMD;
a sensing unit configured to sense movement of the terminal body; and
a controller configured to:
cause output of a preset first region of a virtual space on the display of the HMD;
cause output of a second region of the virtual space on the display, different from the preset first region, based on movement of the HMD sensed through the sensing unit of the HMD;
control the display of the HMD based on a movement of the mobile terminal;
cause output of the preset first region, instead of the second region, on the display of the HMD when the mobile terminal is moved as a preset movement without the movement of the HMD,
perform a first operation related to the HMD when the mobile terminal is moved in a first direction; and
perform a second operation related to the HMD different from the first operation when the mobile terminal is moved in a second direction different from the first direction.

2. The system of claim 1 , wherein the controller is further configured to:
cause the output of the preset first region, instead of the second region, on the display of the HMD based upon the movement of the mobile terminal that corresponds to a preset movement, even when movement of the HMD is not sensed.

3. The system of claim 2 , wherein the controller is further configured to:
rotate the virtual space with respect to the HMD such that the preset first region is output on the display of the HMD in response to the preset movement.

4. The system of claim 1 , wherein the preset first region is at least one of a default region of the virtual space, a region including a specific object among objects included in the virtual space, or a specific region set by a user.

5. The system of claim 1 , wherein the movement of the HMD is sensed using the sensing unit of the mobile terminal.

6. The system of claim 1 , further comprising:
a wireless communication unit,
wherein the controller is further configured to:
cause the display of the HMD to display event information related to an event occurring in response to a signal received via the wireless communication unit.

7. The system of claim 6 , wherein the controller is further configured to:
increase a size of one portion of the event information displayed on the display of the HMD when the HMD is rotated in a direction in which the event information is displayed.

8. The system of claim 6 , wherein the controller is further configured to:
perform an operation related to the event when the terminal body is moved according to a specific movement while the event information is displayed.

9. The system of claim 1 , wherein
the sensing unit of the HMD senses eyes of the user who wears the HMD and the virtual space includes at least one graphic object associated with a preset function, and wherein the controller is further configured to:
perform a function associated with a first one of the at least one graphic object when the sensing unit of the HMD senses that the user gazes at the first one of the at least one graphic object for a defined time period.

10. The system of claim 1 , wherein the controller is further configured to:
cause the display of the HMD to display a selection window for selecting any one of at least two operations; and
perform any one of the at least two operations according to a direction in which the terminal body is moved while the selection window is displayed.

11. A system comprising:
a head mounted display (HMD) having a display, a sensing unit, and a user input unit; and
a mobile terminal configured to be coupled to the HMD for controlling the HMD, wherein the mobile terminal comprises:
an interface unit configured to couple with the HMD;
a touch screen; and
a controller configured to:
cause output of a first portion of a virtual space on the display of the HMD;
cause output of a second portion of the virtual space different from the first portion of the virtual space on the display of the HMD when the HMD is moved in a state in which a user input is not applied to the touch screen and the user input unit of the HMD; and
not change the first portion of the virtual space output to the display of the HMD when the HMD is moved in a state in which a user input is applied to the touch screen of the mobile terminal and the user input is maintained on the touch screen of the mobile terminal.

12. A method for controlling a system including a mobile terminal and a head mounted display (HMD), the method comprising:
outputting a preset first region of a virtual space on a display of the HMD;
outputting a second region of the virtual space on the display of the HMD, different from the preset first region, based on movement of the HMD sensed through a sensing unit of the HMD;
controlling the display of the HMD based on a movement of the mobile terminal;
outputting the preset first region, instead of the second region, on the display of the HMD when the mobile terminal is moved as a preset movement without the movement of the HMD,
performing a first operation related to the HMD when the mobile terminal is moved in a first direction; and
performing a second operation related to the HMD different from the first operation when the mobile terminal is moved in a second direction different from the first direction.

13. The method of claim 12 , further comprising:
outputting the preset first region, instead of the second region, on the display of the HMD based upon the movement of the mobile terminal that corresponds to a preset movement, even when movement of the HMD is not sensed.

Assignees

• Lg Electronics Inc

Inventors

• Park Cheongha
• Joo Goeun

Classifications

• G02B27/017

  Head mounted · CPC title

• H04M1/7253

  Electricity · mapped topic

• G06T3/60

  Rotation of whole images or parts thereof · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/0487

  using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser · CPC title