User interface for a head mounted display

Patent metadata

Field	Value
Publication number	US-9041741-B2
Application number	US-201313827339-A
Country	US
Kind code	B2
Filing date	Mar 14, 2013
Priority date	Mar 14, 2013
Publication date	May 26, 2015
Grant date	May 26, 2015

Abstract

A user interface (UI) of a head mounted display (HMD) is provided that allows a user to access one or more persistent data elements that are otherwise outside the user's initial field of view by using a head movement, such as a head tilt (i.e., movement about a horizontal axis) and/or rotation (i.e., movement about a vertical axis). Embodiments also can provide for further movement and/or other manipulation of data of persistent data elements with further detected movement of the user's head.

First claim

What is claimed is:

1. A method for displaying data by a see-through head mounted display (HMD):
determining a first field of view of a user of the HMD;
receiving sensor input from at least one sensor;
detecting, using the sensor input, a first movement comprising a downward tilt of the user's head, causing the user to have a second field of view; and
causing the HMD to display one or more persistent data elements in the second field of view, based on the detected first movement;
wherein:
the one or more persistent data elements comprise a map that appears, from a perspective of the user, in a plane of a physical surface on which the user is located;
causing the HMD to display the one or more persistent data elements is independent of physical objects viewable in the second field of view, and
the one or more persistent data elements were not displayed in the first field of view.

2. The method of claim 1 , further comprising determining the first field of view is an expected field of view.

3. The method of claim 1 , wherein the map includes at least one of:
a destination,
a location of the user, or
a point of interest.

4. The method of claim 3 , wherein the map includes the point of interest, the method further comprising displaying, within the first field of view of the user, a data element indicative that the map includes the point of interest.

5. The method of claim 1 , further comprising:
receiving an input from the user, and
zooming the map in or out, based on the received input.

6. The method of claim 1 , further comprising:
detecting a second movement; and
moving the one or more persistent data elements in a manner corresponding to the second movement.

7. The method of claim 1 , wherein the one or more persistent data elements comprise one or more icons representative of executable applications.

8. The method of claim 1 , wherein the at least one sensor comprises at least one of:
an accelerometer,
a gyroscope,
a magnetometer,
a camera,
a Satellite Positioning System (SPS) receiver, or
an altimeter.

9. An apparatus comprising:
a memory; and
a processing unit communicatively coupled with:
the memory;
one or more motion sensors configured to sense movement of a user of a see-through head mounted display (HMD); and
a display of the HMD, the display configured to show data elements in a user's field of view while allowing the user to view physical objects in the user's environment;

wherein the processing unit is configured to:
determine a first field of view of the user of the HMD;
receive sensor input from the one or more motion sensors;
detect, using the sensor input, a first movement comprising a downward tilt of the user's head, causing the user to have a second field of view; and
cause the display to show one or more persistent data elements in the second field of view, based on the detected first movement;

wherein:
the one or more persistent data elements comprise a map that appears, from a perspective of the user, in a plane of a physical surface on which the user is located;
causing the HMD to display the one or more persistent data elements is independent of physical objects viewable in the second field of view, and
the one or more persistent data elements were not displayed in the first field of view.

10. The apparatus of claim 9 , wherein the processing unit is further configured to determine the first field of view is an expected field of view.

11. The apparatus of claim 9 , wherein the map includes at least one of:
a destination,
a location of the user, or
a point of interest.

12. The apparatus of claim 11 , wherein the map includes the point of interest, the processing unit further configured to cause the display to show, within the first field of view of the user, a data element indicative that the map includes the point of interest.

13. The apparatus of claim 9 , wherein the processing unit is further configured to perform functions comprising:
receiving an input from the user, and
causing the map to zoom in or out, based on the received input.

14. The apparatus of claim 9 , wherein the processing unit is further configured to perform functions comprising:
detecting a second movement; and
causing the display to move the one or more persistent data elements in a manner corresponding to the second movement.

15. The apparatus of claim 9 , wherein the apparatus comprises the HMD.

16. The apparatus of claim 9 , wherein the apparatus comprises a device communicatively coupled with the HMD.

17. The apparatus of claim 9 , wherein the processing unit is configured to cause the display to show the one or more persistent data elements by causing the display to show one or more icons representative of executable applications.

18. The apparatus of claim 9 , wherein the one or more motion sensors comprise at least one of:
an accelerometer,
a gyroscope,
a magnetometer,
a camera,
a Satellite Positioning System (SPS) receiver, or
an altimeter.

19. A non-transitory computer-readable storage medium having instructions embedded thereon for displaying data elements on a see-through head mounted display (HMD), the instructions including computer-executable code for:
determining a first field of view of a user of the HMD;
receiving sensor input from at least one sensor;
detecting, using the sensor input, a first movement comprising a downward tilt of the user's head, causing the user to have a second field of view; and
causing the HMD to display one or more persistent data elements in the second field of view, based on the detected first movement;
wherein:
the one or more persistent data elements comprise a map that appears, from a perspective of the user, in a plane of a physical surface on which the user is located;
causing the HMD to display the one or more persistent data elements is independent of physical objects viewable in the second field of view, and
the one or more persistent data elements were not displayed in the first field of view.

20. An apparatus comprising:
means for determining a first field of view of a user of the HMD;
means for receiving sensor input from at least one sensor;
means for detecting, using the sensor input, a first movement comprising a downward tilt of the user's head, causing the user to have a second field of view; and
means for displaying, via the HMD, one or more persistent data elements in the second field of view, based on the detected first movement;
wherein:
the one or more persistent data elements comprise a map that appears, from a perspective of the user, in a plane of a physical surface on which the user is located;
causing the HMD to display the one or more persistent data elements is independent of physical objects viewable in the second field of view, and
the one or more persistent data elements were not displayed in the first field of view.

21. The apparatus of claim 20 , further comprising means for determining the first field of view is an expected field of view.

22. The apparatus of claim 20 , wherein the map includes at least one of:
a destination,
a location of the user, or
a point of interest.

23. The apparatus of claim 22 , wherein the map includes the point of interest, the apparatus further comprising means for displaying, within the first field of view of the user, a data element indicative that the map includes the point of interest.

24. The apparatus of cla

Assignees

• Qualcomm Inc

Inventors

• Mabbutt Paul
• Maciocci Giuliano
• Auger Louise M

Classifications

• G02B27/017

  Head mounted · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G06F3/012 Primary

  Head tracking input arrangements · CPC title

• G02B2027/0123

  comprising devices increasing the field of view · CPC title

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title