Mixed-reality headset

Patent metadata

Field	Value
Publication number	US-2016349509-A1
Application number	US-201514721351-A
Country	US
Kind code	A1
Filing date	May 26, 2015
Priority date	May 26, 2015
Publication date	Dec 1, 2016
Grant date	—

Abstract

A “Mixed-Reality Headset” include an attachment mechanism for a smartphone or other portable computing device. A combination of the smartphone display with various internal headset optics present both augmented reality (AR) and virtual reality (VR). The Mixed-Reality Headset provides low cost, high performance, easy to use AR and VR experiences with unmodified smartphone hardware, thereby improving user experience and interaction with smartphones. In various implementations, applications associated with the Mixed-Reality Headset consider user movement and tracking (e.g., head, eye, hands, body) and real-world environmental mapping when rendering AR and VR content. The Mixed-Reality Headset easily and quickly transitions between AR and VR scenarios by causing transparent optical members to either pass light or block light, thereby either showing or hiding views of the real world. Additional reflective members are applied to enable smartphone cameras to capture real-world environmental views around the user and/or to track user gaze or eye movements.

First claim

What is claimed is:

1 . A device comprising:
a headset; an attachment mechanism configured to secure a display to the headset in a position outside a central field of view of a user; a transparent optical member of the headset configured to transmit light through a partial reflector of the headset; a first reflective member of the headset positioned to reflect the display after passing through the partial reflector; and a per-eye optical controller configured to align one or more virtual objects rendered on the display with one or more real-world objects visible through the partial reflector and the transparent optical member.

2 . The device of claim 1 further comprising an occlusion controller for selectively occluding one or more regions of the transparent optical member to selectively occlude corresponding views of one or more regions of the real-world that are otherwise visible through the partial reflector and the transparent optical member.

3 . The device of claim 1 further comprising an opacity controller of the headset configured to adjust an opacity level of the transparent optical member.

4 . The device of claim 1 further comprising:
a side transparent member positioned on each of a left and right side of the headset configured to expand a total field of view beyond the central field of view; and
wherein the opacity controller is further configured to adjust an opacity level of each side transparent member.

5 . The device of claim 3 further comprising a reality type controller configured to transition between an augmented reality display and a virtual reality display by causing the opacity controller to adjust the opacity level of the transparent optical member.

6 . The device of claim 3 further comprising:
a bottom transparent member positioned on a bottom surface of the headset configured to expand a total field of view beyond the central field of view; and
wherein the opacity controller is further configured to adjust an opacity level of the bottom transparent member.

7 . The device of claim 1 wherein the display device is coupled to a portable computing device.

8 . The device of claim 7 further comprising an eye tracker configured to apply at least one camera of the portable computing device to track at least one of the user's eyes.

9 . The device of claim 7 further comprising a second reflective member of the headset configured to enable a front-facing camera of the portable computing device to capture a scene having a field of view corresponding to at least a portion of the central field of view.

10 . The device of claim 9 further comprising a third reflective member of the headset configured to enable a rear-facing camera of the portable computing device to capture a scene having a field of view corresponding to at least a portion of the central field of view.

11 . The device of claim 10 further comprising a stereo vision controller configured to combine the fields of view of the front-facing camera and the rear-facing camera to construct a stereo view of a real-world environment in front of the headset.

12 . The device of claim 10 further comprising a head tracker configured to combine the fields of view of the front-facing camera and the rear-facing camera to track relative motions of the user's head.

13 . The device of claim 10 further comprising an environmental mapper configured to combine the fields of view of the front-facing camera and the rear-facing camera to perform environmental mapping of a real-world environment in front of the headset.

14 . A system, comprising:
a display screen coupled to a general purpose computing device; an attachment mechanism for securing the general purpose computing device to a headset such that the display screen is exposed to internal optics of the headset and such that a central field of view remains open; a partial reflector of the headset configured to pass light from content being rendered on the display screen to a first reflector of the headset; the first reflector of the headset configured to reflect the light passed from the display to the central field of view; a front transparent optical member of the headset with an adjustable transparency level, configured via a transparency controller, to pass light from a real-world environment through the partial reflector to the central field of view; and an optical controller configured to adapt the content being rendered on the display device to align one or more elements of the content with one or more real-world objects visible in the central field of view.

15 . The system of claim 14 further comprising:
a second reflective member of the headset configured to enable a front-facing camera of the portable computing device to capture a scene having a field of view corresponding to at least a portion of the central field of view; and
a third reflective member of the headset configured to enable a rear-facing camera of the portable computing device to capture a scene having a field of view corresponding to at least a portion of the central field of view.

16 . The system of claim 15 further comprising a camera reflector controller configured to adjust the second reflective member to enable the front-facing camera to track at least one of a user's eyes.

17 . The system of claim 14 further comprising transitioning the headset between presentations of augmented reality and virtual reality by applying the transparency controller to adjust the transparency level of the front transparent optical member from a transparent state to an opaque state.

18 . A method, comprising:
coupling a smartphone to a headset in a position outside a central field of view of a user; rendering virtual content on a display of the smartphone; passing light corresponding to the virtual content from the display through a partial reflector of the headset; reflecting the light passing through the partial reflector from a first reflector into the central field of view; passing light through an adjustably transparent front transparent optical member directly from a real-world environment through the partial reflector into the central field of view; and adjusting one or more elements of the virtual content to align those elements with one or more real-world objects visible in the real-world environment within the central field of view.

19 . The method of claim 18 further comprising:
configuring a second reflective member of the headset to enable a front-facing camera of the smartphone to capture a scene having a field of view corresponding to at least a portion of the central field of view; and
configuring a third reflective member of the headset to enable a rear-facing camera of the portable computing device to capture a scene having a field of view corresponding to at least a portion of the central field of view.

20 . The method of claim 18 further comprising:
combining the fields of view of the front-facing camera and the rear-facing camera to perform 3D environmental mapping of a real-world environment in front of the headset; and
adapting the virtual content to the environmental mapping of the real-world environment.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Lanier Jaron
• Asdourian Ryan
• Hudman Josh
• Yee Dawson
• Therien Patrick

Classifications

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06T2215/16

  Using real world measurements to influence rendering · CPC title

• G02B2027/0169

  Supporting or connecting means other than the external walls · CPC title

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G06T11/001

  Physics · mapped topic