Hybrid display system

Patent metadata

Field	Value
Publication number	US-9977493-B2
Application number	US-201514742592-A
Country	US
Kind code	B2
Filing date	Jun 17, 2015
Priority date	Jun 17, 2015
Publication date	May 22, 2018
Grant date	May 22, 2018

Abstract

Embodiments are disclosed for a display system having multiple fields of view. An example display system comprises a first display configured to produce images across a first field of view, a second display configured to produce images across a second field of view, the second field of view being larger than the first field of view, and a controller configured to selectively present a virtual object via one or more of the first display and the second display based on a feature of the virtual object as displayed within a user's viewspace.

First claim

The invention claimed is:

1. A head-mounted display system comprising:
a first transparent display configured to produce images across a first field of view;
a second transparent display configured to produce images across a second field of view, the second field of view being larger than the first field of view; and
a controller configured to selectively present a virtual object in an overlapped region of the first field of view and the second field of view, such selective presentation including determining whether to use one or both of the first transparent display and the second transparent display based on occlusion to be provided by the virtual object.

2. The head-mounted display system of claim 1 , wherein the first transparent display comprises a waveguide-type or birdbath display, and wherein the second transparent display comprises a compressed lightfield or Maxwellian-view display.

3. The head-mounted display system of claim 2 , wherein the first transparent display comprises a microprojector that projects into a waveguide and a plurality of gratings for replicating a pupil in a plurality of directions, and wherein the second transparent display comprises a pinlight display.

4. The head-mounted display system of claim 1 , wherein the first transparent display has a field of view that is less than or equal to 60 degrees, and wherein the second transparent display has a field of view that is greater than 60 degrees.

5. The head-mounted display system of claim 4 , wherein the field of view of the first transparent display is between 30 and 60 degrees, inclusive, wherein the field of view of the second transparent display is above 60 degrees, and wherein the second transparent display provides selective occlusion of a real-world environment as viewed through the second transparent display.

6. The head-mounted display system of claim 1 , wherein the first transparent display has a higher resolution than the second display.

7. The head-mounted display system of claim 1 , wherein selectively presenting the virtual object via the first and second transparent display comprises displaying at least a portion of the virtual object via the second transparent display responsive to determining that a transparency of the virtual object is below a threshold.

8. The head-mounted display system of claim 1 , wherein the head-mounted display system comprises, in order along an optical axis extending from a user's eye, the first transparent display, an air gap, and the second transparent display.

9. A method of producing an image in a head-mounted display device, the method comprising:
directing light from a first light source to a waveguide to selectively present virtual objects via a first transparent display, the first transparent display having a first field of view;
directing light from one or more second light sources to a user's eye to selectively present virtual objects via a second transparent display, the second display having a second field of view that is larger than the first field of view;
generating a virtual object for display in a user's viewspace;
determining a location for the virtual object within the user's viewspace;
if the location for the virtual object is outside of the first field of view, displaying the virtual object with the second transparent display; and
if the location for the virtual object is within an overlapped region of the first field of view and the second field of view, selectively displaying the virtual object with one or both of the first transparent display and the second transparent display based on occlusion to be provided by the virtual object.

10. The method of claim 9 , wherein selectively displaying the virtual object with one or both of the first transparent display and the second transparent display comprises displaying the virtual object with one or both of the first transparent display and the second transparent display if the occlusion to be provided by the virtual object is below a threshold and displaying the virtual object with at least the second transparent display if the occlusion to be provided by the virtual object is above the threshold.

11. The method of claim 9 , wherein selectively displaying the virtual object with one or both of the first transparent display and the second transparent display is further based on a designation of the virtual object as an interactive object for a user interface such that the virtual object corresponds to a virtual or real-world element that is used to provide a gesture input to the user interface.

12. The method of claim 9 , wherein selectively displaying the virtual object with one or both of the first transparent display and the second transparent display further comprises determining a resolution of the virtual object, then displaying the virtual object with the first transparent display if the resolution of the virtual object is above a threshold and displaying the virtual object with the second transparent display if the resolution of the virtual object is below the threshold.

13. The method of claim 9 , further comprising displaying at least a first portion of the virtual object with the first transparent display and at least a second portion of the virtual object with the second transparent display responsive to determining that the virtual object is located within the first field of view and that a transparency of the virtual object is above a threshold.

14. The method of claim 9 , wherein the second transparent display comprises a pinlight display or a Maxwellian-view display.

15. A head-mounted display device comprising:
a first transparent display configured to produce images across a first field of view, the first transparent display comprising a waveguide;
a second transparent display configured to produce images across a second field of view, the second field of view being larger than the first field of view, the second transparent display comprising an aperture mask display and being separated from the first transparent display by an air gap; and
a circuit configured to:
present a virtual object in an overlapped region of the first field of view and the second field of view to a wearer of the head-mounted display device via a selected one of a plurality of display modes based on occlusion to be provided by the virtual object as displayed within a user's viewspace, the display modes including a first display mode in which the virtual object is displayed via only the first transparent display, a second display mode in which the virtual object is displayed via only the second transparent display, and a third display mode in which the virtual object is displayed via the first transparent display and the second transparent display.

16. The head-mounted display device of claim 15 , wherein the first transparent display and the second transparent display form a stacked display in which the first transparent display is positioned nearer to an eye of a wearer of the head-mounted display device than the second transparent display.

17. The head-mounted display device of claim 15 , wherein the first transparent display has a field of view that is less than or equal to 60 degrees, wherein the second transparent display has a field of view that is greater than 60 degrees, and wherein the second transparent display provides selective occlusion of a real-world environment as viewed through the second transparent display.

18. The head-mounted display device of claim 15 , wherein presenting the virtual object to a wearer of the head-mounted display device via a selected one

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Lanier Jaron
• Kollin Joel S

Classifications

• H04N23/58

  Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors · CPC title

• H04N25/00

  Circuitry of solid-state image sensors [SSIS]; Control thereof · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T2207/10024

  Color image · CPC title

• H04N5/335

  Electricity · mapped topic