AR glasses with event and sensor triggered AR eyepiece interface to external devices

Patent metadata

Field	Value
Publication number	US-9759917-B2
Application number	US-201213342968-A
Country	US
Kind code	B2
Filing date	Jan 3, 2012
Priority date	Feb 28, 2010
Publication date	Sep 12, 2017
Grant date	Sep 12, 2017

Abstract

This disclosure concerns an interactive head-mounted eyepiece with an integrated processor for handling content for display and an integrated image source for introducing the content to an optical assembly through which the user views a surrounding environment and the displayed content, wherein the eyepiece includes event and sensor triggered interface to external devices.

First claim

What is claimed is:

1. A system comprising:
an interactive head-mounted device including an optical assembly configured to display virtual content and to enable viewing of at least a portion of a surrounding environment, an integrated processor for processing the virtual content for display, and an integrated image source for introducing the virtual content to the optical assembly; and
a sensor configured to detect a physical quantity of items as input, the physical quantity of items comprising a number of items to be transferred in an inventory system, wherein the interactive head-mounted device is configured to present, via the optical assembly, an augmented reality image comprising inventory tracking information regarding an identification of one or more items of the physical quantity of items when the physical quantity of items is detected via the sensor, and
wherein the augmented reality image comprises information regarding a location where the items of the physical quantity of items are to be transferred.

2. The system of claim 1 wherein the augmented reality image comprises an instruction for the physical quantity of items.

3. The system of claim 1 wherein the sensor comprises a facial actuation sensor.

4. The system of claim 1 wherein the sensor comprises a hand-mounted sensor.

5. The system of claim 1 wherein the sensor comprises an acoustic sensor, and wherein the physical quantity of items is detected via the acoustic sensor.

6. The system of claim 1 wherein the sensor comprises an image sensor, and wherein the physical quantity of items is detected via the image sensor.

7. The system of claim 1 , wherein the interactive head-mounted device is further configured to present the augmented reality image comprising inventory tracking information regarding the physical quantity of items when the sensor detects one or more items of the physical quantity of items within a threshold distance of the sensor.

8. The system of claim 1 , wherein the interactive head-mounted display device further comprises an audio output device configured to provide audio information regarding the physical quantity of items.

9. In a system having an interactive head-mounted device comprising an optical assembly, an integrated image source, an integrated processor, and a sensor, a method comprising:
introducing virtual content to the optical assembly via the integrated image source;
processing the virtual content for display via an integrated processor;
displaying via the optical assembly the virtual content while enabling viewing of at least a portion of a surrounding environment;
detecting via the sensor a physical quantity of items as input, the physical quantity of items comprising a number of items to be transferred in an inventory system; and
in response to detection of the physical quantity of items as input, presenting other virtual content via the integrated image source in the form of an augmented reality image comprising inventory tracking information regarding an identification of one or more items of the physical quantity of items,
wherein the augmented reality image comprises information regarding a location where the items of the physical quantity of items are to be transferred.

10. The method of claim 9 , wherein the physical quantity of items is detected via one or more of an input of audio and an input of video.

11. The method of claim 9 , wherein presenting other virtual content comprises presenting an instruction regarding disposing one or more items of the physical quantity of items in an inventory system.

12. The method of claim 9 , wherein presenting other virtual content comprises presenting information regarding an identification of one or more items of the physical quantity of items.

13. The method of claim 9 , wherein presenting other virtual content comprises presenting an instruction regarding transferring one or more items of the physical quantity of items in an inventory system.

14. The method of claim 13 , wherein presenting an instruction regarding transferring the one or more items comprises presenting an instruction regarding a location where the one or more items are to be transferred.

Assignees

• Osterhout Ralph F
• Haddick John D
• Lohse Robert Michael
• Cella Charles
• Nortrup Robert J
• Nortrup Edward H
• Microsoft Technology Licensing Llc

Inventors

• Osterhout Ralph F
• Haddick John D
• Lohse Robert Michael
• Cella Charles
• Nortrup Robert J
• Nortrup Edward H

Classifications

• G02B2027/014

  comprising information/image processing systems · CPC title

• G02B27/017 Primary

  Head mounted · CPC title

• G06F1/163

  Wearable computers, e.g. on a belt · CPC title

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title