Head-worn adaptive display

Patent metadata

Field	Value
Publication number	US-10539787-B2
Application number	US-201615071904-A
Country	US
Kind code	B2
Filing date	Mar 16, 2016
Priority date	Feb 28, 2010
Publication date	Jan 21, 2020
Grant date	Jan 21, 2020

Abstract

This disclosure concerns an interactive head-mounted eyepiece with an integrated processor for handling content for display and an integrated image source for introducing the content to an optical assembly through which the user views a surrounding environment and the displayed content. The optical assembly includes absorptive polarizers or anti-reflective coatings to reduce stray light.

First claim

The invention claimed is:

1. A head-mounted display device, comprising:
an optical assembly through which at least a part of a surrounding environment and also displayed content are viewable;
an integrated sensor configured to acquire sensor data relating to the surrounding environment, the integrated sensor comprising an image sensor configured to acquire image data of the surrounding environment;
an integrated processor for handling the sensor data and content for presentation to a user, the integrated processor configured to recognize an environmental feature in the surrounding environment based on the image data acquired by the image sensor;
an image source configured to introduce content to the optical assembly; and
a communications facility configured to connect the head-mounted display device to a hand held remote control comprising a haptic interface and to send a request to the hand held remote control to output a haptic notification upon recognition of the environmental feature in the surrounding environment based on the image data acquired by the image sensor of the head-mounted display device, the hand held remote control further being configured to communicate with and control the head-mounted display device, and
the integrated processor being further configured to display virtual content providing information regarding the environmental feature via the image source and optical assembly upon recognition of the environmental feature.

2. The head-mounted display device of claim 1 , wherein the hand held remote control comprises one or more of a wrap, a ring, a pad, a glove, a bracelet, and a watch.

3. The head-mounted display device of claim 1 , wherein the request comprises a request to output one or more of a vibration, a force, a pressure, an electrical impulse, and a temperature output.

4. The head-mounted display device of claim 1 , wherein the head-mounted display device is configured to send the request to the haptic interface to output the haptic notification upon receipt of a message from a remote computing system.

5. The head-mounted display device of claim 1 , wherein the head-mounted display device comprises an object recognition application executable to recognize an object in the surrounding environment via the image data, and wherein the head-mounted display device is further configured to send the request to the haptic interface for the haptic notification upon recognition of the object.

6. The head-mounted display device of claim 5 , wherein the object recognition application comprises facial recognition software and is configured to recognize a face via the image data of the surrounding environment, and wherein the head-mounted display device is further configured to send the request to the haptic interface for the haptic notification upon recognition of the face.

7. The head-mounted display device of claim 5 , wherein the head-mounted display device is configured to send the request to the haptic interface for the haptic notification upon detecting that the user is approaching an object.

8. The head-mounted display device of claim 1 , wherein the haptic interface is further configured to accept control inputs from the user and send the control inputs to the head-mounted display device.

9. A head-mounted display device, comprising:
an optical assembly through which at least a part of a surrounding environment and also displayed content are viewable;
an integrated sensor configured to acquire sensor data relating to the surrounding environment, the integrated sensor comprising an image sensor configured to acquire image data of the surrounding environment;
an integrated processor for handling the sensor data and content for presentation to a user, the integrated processor being configured to recognize an environmental feature based on the image data of the surrounding environment;
an image source configured to introduce content to the optical assembly; and
a communications facility configured to connect the head-mounted display device to a hand held remote control comprising a haptic interface and to, upon recognition of the environmental feature based on the image data acquired by the image sensor of the head-mounted display device, send a request to the hand held remote control to output a haptic notification regarding the environmental feature, the hand held remote control further being configured to communicate with and control the head-mounted display device, and
the integrated processor being further configured to display virtual content providing information regarding the environmental feature via the image source and optical assembly upon recognition of the environmental feature.

10. The head-mounted display device of claim 9 , wherein the head-mounted display device is configured to send the request to the haptic interface by sending the request to a haptic output device located on one or more of a wrap, a ring, a pad, a glove, a bracelet, and a watch.

11. The head-mounted display device of claim 9 wherein the head-mounted display device is configured to send the request to the haptic interface by sending the request to a haptic output device located on a handheld device.

12. The head-mounted display device of claim 9 , wherein the request to the haptic interface comprises a request to output one or more of a vibration, a force, a pressure, an electrical impulse, and a temperature output.

13. The head-mounted display device of claim 9 , wherein the head-mounted display device is further configured to receive a message from a remote computing system, and send the message from the remote computing system to a haptic output device for display on the haptic output device.

14. The head-mounted display device of claim 9 , wherein the head-mounted display device comprises an object recognition application executable to recognize an object in the surrounding environment via the image data, and wherein the head-mounted display device is further configured to send the request to the hand held remote control for the haptic notification upon recognition of the object.

15. The head-mounted display device of claim 9 , wherein the object recognition application comprises facial recognition software and is configured to recognize a face via the image data of the surrounding environment, and wherein the head-mounted display device is further configured to send the request to the hand held remote control for the haptic notification upon recognition of the face.

16. The head-mounted display device of claim 9 , wherein the communications facility is configured to connect the head-mounted display device to a watch device.

17. A system, comprising:
a head-mounted display device comprising an optical assembly through which at least a part of a surrounding environment and also displayed content are viewable, one or more image sensors configured to acquire image data of the surrounding environment, an integrated processor for handling content for presentation to a user, and an image source configured to introduce content to the optical assembly; and
a hand held remote game controller comprising a haptic interface and configured to output a haptic notification upon recognition of an environmental feature in the surrounding environment based on the image data acquired by the image sensor of the head-mounted display device, the hand held remote game controller further being configured to communicate with and control the head-mounted display device, and
the integrated processor being configured to recognize the environmental feature in the surrounding environment base

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Haddick John D
• Osterhout Ralph F

Classifications

• G04G21/08

  Touch switches specially adapted for time-pieces · CPC title

• G04G21/04

  using radio waves (radio-controlled time-pieces G04R) · CPC title

• G04G21/025

  for measuring physiological data · CPC title

• G06F3/03547

  Touch pads, in which fingers can move on a surface · CPC title

• G01C21/3629

  Guidance using speech or audio output, e.g. text-to-speech (text to speech systems per se G10L13/00) · CPC title