Tethering type head mounted display and method for controlling the same

Patent metadata

Field	Value
Publication number	US-9996308-B2
Application number	US-201615284931-A
Country	US
Kind code	B2
Filing date	Oct 4, 2016
Priority date	Nov 2, 2015
Publication date	Jun 12, 2018
Grant date	Jun 12, 2018

Abstract

Provided are a tethering-type head-mounted display (HMD), and a control method thereof. The HMD is in communications with a mobile terminal and includes a display to selectively display content. A sensor detects a state in which the HMD is worn by a user, and the HMD presents notification information about an event detected in the mobile terminal. The controller further pauses, when the sensor senses a change in the state in which the HMD is worn by the user while the notification information is being presented by the display, the presentation of the content, and generates, based on pausing the presentation of the content, bookmark information identifying the content and a point in time when the sensor senses the change in the state in which the HMD is worn by the user.

First claim

What is claimed is:

1. A head-mounted display (HMD) in communications with a mobile terminal, the HMD comprising:
a display configured to selectively present content;
a sensor configured to sense a state in which the HMD is worn by a user; and
a controller configured to:
present, on the display, notification information about an event detected by the mobile terminal,
when the sensor senses a change in the state in which the HMD is worn by the user while the notification information is being presented by the display, pause the presentation of the content on the display, and
generate, based on pausing the presentation of the content on the HMD, bookmark information identifying the content and a point in time when the sensor senses the change in the state in which the HMD is worn by the user,
wherein the sensor includes:
a proximity sensor configured to sense whether the user's head is adjacent to the HMD, and
an eye tracking sensor configured to detect whether the user's eyes can be tracked, and
wherein the controller is further configured to:
determine that the HMD has been completely taken off when the proximity sensor senses that the user's head is not adjacent to the HMD,
determine that the HMD has been temporarily taken off when the proximity sensor senses that the user's head is adjacent to the HMD and the eye tracking sensor detects that the user's eyes cannot be tracked,
when the HMD has been temporarily taken off while the notification information is not being displayed, direct the display to pause the presenting of the content, and
when the HMD has been completely taken off, direct the display to stop presenting the content and generate the bookmark information.

2. The HMD of claim 1 , wherein the controller is further configured to:
activate the proximity sensor when the HMD is positioned within a threshold distance of the user's head,
activate the eye tracking sensor when the HMD is positioned on the user's head for the display to present the content to the user's eyes,
determine, when the proximity sensor and the eye tracking sensor are activated, that the user is wearing the HMD,
determine, when the proximity sensor and the eye tracking sensor are deactivated, that the user has completely taken off the HMD, and
determine, when the eye tracking sensor is deactivated while the proximity sensor is activated, that the user has temporarily taken off the HMD.

3. The HMD of claim 1 , wherein the controller is further configured to:
when the user wears the HMD again after the HMD was completely taken off, present, on the display, a selection menu, wherein the selection menu enables to the user to direct the HMD to resume presenting the content according to the bookmark information or to select new content to be presented by the HMD.

4. The HMD of claim 3 , wherein the controller is further configured to:
when the user wears the HMD and the bookmark information is not generated, present, on the display, an alternative selection menu, wherein the alternative selection menu enables the user to select the new content to be presented by the HMD, and wherein the alternative selection menu does not include an option for the HMD to resume presenting the content.

5. The HMD of claim 1 , wherein the controller is further configured to:
resume presenting the content on the display based on the bookmark information, wherein the presentation of the content is resumed at a portion of the content being presented during a particular period of time before the point in time when the sensor sensed the change in the state in which the HMD is worn by the user.

6. The HMD of claim 5 , wherein the controller is further configured to:
receive a user input, and
adjust the particular period of time based on the user input.

7. The HMD of claim 1 , wherein the controller is further configured to:
cause, when the sensor senses the change in the state in which the HMD is worn by the user while the notification information is being presented by the display, the mobile terminal to enter an operational state related to the event.

8. The HMD of claim 1 , wherein the controller is further configured to:
generate the bookmark information when a predetermined time elapses after the content is presented, and
update the bookmark information to include data indicating that the content was presented at predetermined time intervals until the presentation of the content is completed.

9. The HMD of claim 8 , wherein the controller is further configured to:
delete the bookmark information when the presentation of the content is completed.

10. The HMD of claim 1 , wherein the controller is further configured to:
determine, when the sensor senses the change in the state in which the HMD is worn by the user while the notification information is being presented by the display, that the user has checked the event corresponding to the notification information.

11. The HMD of claim 10 , wherein the controller, when the sensor does not sense the change in the state in which the HMD is worn by the user while the notification information is being presented on the display during a particular duration of time, is further configured to:
stop presenting, on the display, the notification information after the particular duration of time, and
designate the event as an unchecked event.

12. The HMD of claim 11 , wherein the controller is further configured to:
when a particular user input is detected, present, on the display, information related to a group of unchecked events that includes the unchecked event and one or more other unchecked events.

13. The HMD of claim 12 , wherein the controller is further configured to:
receive a user selection identifying one of the group of unchecked events,
visually distinguish, on the display, a portion of the presented information associated with the identified one of the group of unchecked events, and
cause, when the sensor senses the change in the state in which the HMD is worn by the user while the display is visually distinguishing the portion of the presented information, the mobile terminal to enter an operational state related to the identified one of the group of unchecked events.

14. The HMD of claim 13 , wherein the controller, when visually distinguishing the portion of the presented information associated with the identified one of the group of unchecked events, is further configured to:
modify at least one of:
a graphic object associated with the portion of the presented information,
a background color associated with the portion of the presented information,
a character shape associated with the portion of the presented information, or
a character size associated with the portion of the presented information.

15. The HMD of claim 12 , wherein the particular user input is applied through the mobile terminal.

16. The HMD of claim 11 , wherein the controller is further configured to:
cause, based on detecting a particular user input after the display stops presenting the notification information, the mobile terminal to display information related to a group of unchecked events that includes the unchecked event and one or more other unchecked events.

17. The HMD of claim 1 , wherein, when the sensor senses the change in the state in which the HMD is worn by the user while the notification information is not being displayed, the controller is further configured to:
cause the mobile terminal to display information identifying a state of the HMD and a time duration in which the HMD was used.

18

Assignees

• Lg Electronics Inc

Inventors

• Park Cheongha
• Joo Goeun

Classifications

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06T11/001

  Physics · mapped topic

• G09G2370/00

  Aspects of data communication · CPC title

• G06F3/04847

  Interaction techniques to control parameter settings, e.g. interaction with sliders or dials · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title