User interface rendering in augmented or virtual reality systems

Patent metadata

Field	Value
Publication number	US-9911234-B2
Application number	US-201514706863-A
Country	US
Kind code	B2
Filing date	May 7, 2015
Priority date	Apr 18, 2014
Publication date	Mar 6, 2018
Grant date	Mar 6, 2018

Abstract

An augmented reality display system comprises a passable world model data comprises a set of map points corresponding to one or more objects of the real world. The augmented reality system also comprises a processor to communicate with one or more individual augmented reality display systems to pass a portion of the passable world model data to the one or more individual augmented reality display systems, wherein the piece of the passable world model data is passed based at least in part on respective locations corresponding to the one or more individual augmented reality display systems.

First claim

What is claimed is:

1. A method of displaying augmented reality, comprising:
projecting light associated with a virtual object to a user's eyes, wherein the virtual object comprises a virtual user interface;
determining a user input from the user based on an interaction of the user with at least one component of the virtual user interface;
determining an action to be performed based on the received user input;
tracking at least one characteristic of the user, wherein the user input is determined based on the tracked characteristic and a predetermined pattern associated with the tracked characteristic; and
performing the action responsive to the received user input,
wherein the action comprises projecting light associated with one or more additional virtual objects to the user's eyes, wherein the projection of the virtual user interface is based on Wi-Fi signal strength data or cell phone differential signal strength and the virtual user interface comprises a floating virtual screen rendered using hand-centered rendering, and the projection of the virtual user interface is based at least in part on an environmental data.

2. A method of displaying augmented reality, comprising:
projecting light associated with a virtual object to a user's eyes, wherein the virtual object comprises a virtual user interface;
determining a user input from the user based on an interaction of the user with at least one component of the virtual user interface;
determining an action to be performed based on the received user input; and
performing the action in response to the received user input, the action comprising projecting light associated with one or more additional virtual objects to the user's eyes,
wherein the projection of the virtual user interface is based on Wi-Fi signal strength data or cellphone differential signal strength and the virtual user interface is a floating virtual interface rendered using body-centered rendering.

3. The method of claim 2 , further comprising storing a map of a real world, wherein the map comprises coordinates of real objects of the real world and the projection of the virtual user interface is based at least in part on the stored map, and further comprising a first object recognizer recognizing a first object of said real objects and a second object recognizer recognizing a subset of the first object.

4. The method of claim 2 , wherein the projecting light comprises emitting light, the at least one characteristic pertains to light reflected back from the user's eyes and the tracking at least one characteristic of the user includes varying at least one parameter of the emitted light to impose a recognizable pattern on the emitted light and detecting said light reflected back from the user's eyes.

5. The method of claim 2 , wherein the one or more additional virtual objects comprises a halo.

6. The method of claim 2 , further comprising tracking at least one characteristic of the user, wherein the user input is determined based on the tracked characteristic and a predetermined pattern associated with the tracked characteristic, or a correlation between the tracked characteristics and a set of known characteristics, and wherein the one or more additional virtual objects comprises a halo and the tracking at least one characteristic of the user includes tracking a frequency of said interaction of said user.

7. The method of claim 6 , wherein the at least one characteristic pertains to the user's eyes.

8. The method of claim 6 , wherein the at least one characteristic pertains to the user's hands.

9. The method of claim 6 , wherein the at least one characteristic pertains to the user's interaction with an inanimate totem.

10. The method of claim 6 , wherein the at least one characteristic pertains to a head pose of the user.

11. The method of claim 6 , wherein the at least one characteristic pertains to a natural feature pose of the user.

12. The method of claim 6 , wherein the tracking at least one characteristic of the user includes tracking a force of said interaction of said user.

13. The method of claim 6 , wherein the tracking at least one characteristic of the user includes tracking a frequency of said interaction of said user.

Assignees

• Magic Leap Inc

Inventors

• Miller Samuel A

Classifications

• H04S2400/15

  Aspects of sound capture and related signal processing for recording or reproduction · CPC title

• H04S2400/11

  Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) · CPC title

• H04S7/304

  For headphones · CPC title

• G06Q30/02

  Marketing; Price estimation or determination; Fundraising · CPC title

• A63F13/577

  using determination of contact between game characters or objects, e.g. to avoid collision between virtual racing cars · CPC title