Head mounted display system having an interactive reticle for controlling connected devices

Patent metadata

Field	Value
Publication number	US-12596444-B2
Application number	US-202218293701-A
Country	US
Kind code	B2
Filing date	Jul 29, 2022
Priority date	Jul 30, 2021
Publication date	Apr 7, 2026
Grant date	Apr 7, 2026

Abstract

A head-mounted near-eye display system for controlling a network-connected device, including an image light guide operable to convey image-bearing light beams from an image source to an eyebox within which a virtual image can be viewed, the image source operable to form a reticle within the virtual image. A user input mechanism operable to control the reticle such that the reticle may be visually superimposed over the network-connected device, wherein the network-connected device is operable to receive commands to change state over the network, and wherein the user input mechanism is operable to select the network-connected device when the reticle is visually superimposed over the network-connected device, whereby the state of the network-connected device is operable to be changed.

First claim

What is claimed is:

1 . A head-mounted near-eye display system for controlling a network-connected device, comprising:
an image source operable to form a reticle within a virtual image; an image light guide operable to convey said virtual image to an eyebox; a processing unit operable to remotely connect with said network-connected device, wherein said network-connected device is operable to receive commands to change state over said network; and a user input mechanism operable to control said reticle such that said reticle may be visually superimposed over said network-connected device; wherein said user input mechanism is operable to navigate said reticle within said virtual image such that said reticle is visually superimposed over said network-connected device, whereby said state of said network-connected device is operable to be changed.

2 . The system of claim 1 , wherein said network-connected device changes state when said reticle is visually superimposed over said network-connected device for a predetermined period of time.

3 . The system of claim 1 , further comprising a menu formed within said virtual image, said menu having a plurality of selectable options associated with said network-connected device, wherein said reticle is operable to be visually superimposed over one or more of said options, and wherein said reticle is operable to select or deselect one or more of said options to change said state of said network-connected device.

4 . The system of claim 1 , further comprising:
a camera arranged to capture images of said network-connected device, wherein said processing unit is in communication with said camera and said image source; and a waveguide is arranged to convey said images of said network-connected device to an eyebox, wherein said waveguide is arranged to convey an animated virtual image of said network-connected device to said eyebox to visually indicate a change of state of said network-connected device.

5 . The system of claim 1 , further comprising a camera or other visual input device, wherein said reticle is a bounding box representing said camera or other visual input device field of view, wherein said bounding box is operable to be aligned with a bar code or QR code to scan an associated item or device.

6 . The system of claim 1 , wherein said reticle is assigned to a real-world object, wherein movement of said reticle corresponds to movement of said real-world object.

7 . The system of claim 1 , wherein said reticle is operable to select, deselect, control or otherwise affect a virtual menu or other selectable virtual object.

8 . The system of claim 1 , wherein said reticle is a first reticle, further comprising a second reticle arranged to operate together with or independently of said first reticle.

9 . The system of claim 1 , wherein said reticle is operable to activate, deactivate, control or otherwise change said state of a plurality of network-connected devices.

10 . The system of claim 1 , wherein said user input mechanism comprises a user input button or a touch sensor.

11 . The system of claim 1 , wherein said processing unit operable to map coordinates of network-connected devices, whereby said network-connected devices are identifiable when said reticle is visually superimposed over said network-connected devices.

12 . The system of claim 1 , further comprising an RFID reader operable to identify network-connected devices, whereby said network-connected devices are identifiable when said reticle is visually superimposed over said network-connected devices.

13 . The system of claim 1 , wherein said processing unit operable to identify network-connected devices via a computer vision technique, whereby said network-connected devices are identifiable when said reticle is visually superimposed over said network-connected devices.

14 . The system of claim 1 , further comprising a camera, wherein said processing unit in signal communication with said camera and said user input mechanism, wherein said processing unit is operable to connect with a remote device, whereby a remote party can view data received by said camera.

15 . The system of claim 1 , wherein said image light guide comprises a waveguide operable to convey said virtual image, and wherein said virtual image comprises said network-connected device.

16 . The system of claim 15 , wherein said virtual image is a static image or a real-time video of a room within which one or more network-connected devices are located.

17 . The system of claim 1 , wherein said user input mechanism comprises a voice command or an operator-facing camera operable to capture a facial gesture or movement.

18 . A head-mounted near-eye display system for controlling a network-connected device, comprising:
an image source operable to form a reticle within a virtual image; and a user input mechanism operable to control said reticle such that said reticle may be visually superimposed over said network-connected device; wherein said network-connected device is operable to receive commands to change state over said network; wherein said user input mechanism is operable to select said network-connected device when said reticle is visually superimposed over said network-connected device, whereby said state of said network-connected device is operable to be changed; wherein said reticle is assigned to a real-world object, wherein movement of said reticle corresponds to movement of said real-world object.

19 . The system of claim 18 , wherein said real-world object is a user's hand or a stylus.

20 . A head-mounted near-eye display system for controlling a network-connected device, comprising:
an image source operable to form a reticle within a virtual image; a camera arranged to capture an image of said network-connected device; a processing unit in communication with said camera and said image source; an image light guide operable to convey said virtual image and said image of said network- connected device to an eyebox; and a user input mechanism operable to control said reticle such that said reticle may be visually superimposed over said network-connected device, whereby said network- connected device is operable to receive commands to change state over said network; wherein said user input mechanism is operable to select said network-connected device when said reticle is visually superimposed over said network-connected device, and wherein said image light guide is arranged to convey an animated virtual image of said network-connected device to said eyebox to visually indicate a change of state of said network-connected device.

Assignees

• Vuzix Corp

Inventors

• Keller Brent
• Gogolski Adam C
• Travers Paul J

Classifications

• G06F2203/0384

  Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title