Virtual, augmented, and mixed reality systems and methods

Patent metadata

Field	Value
Publication number	US-11823360-B2
Application number	US-202117476392-A
Country	US
Kind code	B2
Filing date	Sep 15, 2021
Priority date	Aug 22, 2016
Publication date	Nov 21, 2023
Grant date	Nov 21, 2023

Abstract

A virtual, augmented, or mixed reality display system includes a display configured to display virtual, augmented, or mixed reality image data, the display including one or more optical components which introduce optical distortions or aberrations to the image data. The system also includes a display controller configured to provide the image data to the display. The display controller includes memory for storing optical distortion correction information, and one or more processing elements to at least partially correct the image data for the optical distortions or aberrations using the optical distortion correction information.

First claim

The invention claimed is:

1. A method in a virtual, augmented, or mixed reality system, comprising:
the system operating in a first power mode corresponding to a first processor mode;
the system receiving a request for a second processor mode;
the system switching to a second power mode corresponding to the second processor mode from the first power mode in response to receiving the request for the second processor mode;
the system receiving an indicator of acceptability of the first processor mode; and
the system switching to the first power mode from the second power mode in response to receiving the indicator of acceptability of the first processor mode,
wherein the first power mode is a low power mode,
wherein the first processor mode is a low processor mode, such that the system operates in the low power mode corresponding to the low processor mode,
wherein the second power mode is a normal power mode, and
wherein the second processor mode is a normal processor mode, such that:
the system receives a request for the normal processor mode;
the system switches to the normal power mode corresponding to the normal processor mode from the low power mode in response to receiving the request for the normal processor mode;
the system receives an indicator of acceptability of the low processor mode; and
the system switches to the low power mode from the normal power mode in response to receiving the indicator of acceptability of the low processor mode,

wherein the system receiving the request for the normal processor mode comprises receiving the request for the normal processor mode through a low latency communication channel.

2. The method of claim 1 , wherein the low power mode comprises a system component is switched off or in a standby mode with a fast wake-up function.

3. The method of claim 2 , wherein the system switching to the normal power mode from the low power mode comprises the system activating the system component that was previously switched off or in a standby mode.

4. The method of claim 1 , wherein the request for the normal processor mode is generated in response to a user's pose changing more than a predetermined threshold amount.

5. The method of claim 1 , wherein the indicator of acceptability the low processor mode is a user's pose changing less than a predetermined threshold amount in a predetermined time.

6. A method in a virtual, augmented, or mixed reality system, comprising:
the system operating in a first power mode corresponding to a first processor mode;
the system receiving a request for a second processor mode;
the system switching to a second power mode corresponding to the second processor mode from the first power mode in response to receiving the request for the second processor mode;
the system receiving an indicator of acceptability of the first processor mode; and
the system switching to the first power mode from the second power mode in response to receiving the indicator of acceptability of the first processor mode,
wherein the first power mode is a normal power mode,
wherein the first processor mode is a normal processor mode, such that the system operates in the normal power mode corresponding to the normal processor mode,
wherein the second power mode is a high power mode, and
wherein the second processor mode is a high processor mode, such that:
the system receives a request for the high processor mode;
the system switches to the high power mode corresponding to the high processor mode from the normal power mode in response to receiving the request for the high processor mode;
the system receives an indicator of acceptability of the normal processor mode; and
the system switches to the normal power mode from the high power mode in response to receiving the indicator of acceptability of the normal processor mode, and

wherein the request for the high processor mode is generated in response to a request to render more than a predetermined threshold amount of virtual objects.

7. The method of claim 6 , wherein the high power mode comprises an increased amount of current available to the system.

8. The method of claim 7 , wherein the system switching to the normal power mode from the high power mode comprises the system reducing the amount of current available to the system.

9. The method of claim 6 , wherein the indicator of acceptability the normal processor mode is a request to render less than a predetermined threshold amount of virtual objects for a predetermined time.

10. A method in a virtual, augmented, or mixed reality system, comprising:
the system operating in a first power mode corresponding to a first processor mode;
the system receiving a request for a second processor mode;
the system switching to a second power mode corresponding to the second processor mode from the first power mode in response to receiving the request for the second processor mode;
the system receiving an indicator of acceptability of the first processor mode; and
the system switching to the first power mode from the second power mode in response to receiving the indicator of acceptability of the first processor mode,
wherein the first power mode is a multiplane power mode,
wherein the first processor mode is a multiplane processor mode, in which the system renders and projects images on a plurality of depth planes, such that the system operates in the multiplane power mode corresponding to the multiplane processor mode,
wherein the second power mode is a single plane power mode, and
wherein the second processor mode is a single plane processor mode, in which the system renders and projects images on a single depth plane, such that:
the system receives a request for the single plane processor mode when the system receives an indicator of single plane activity;
the system switches to the single plane power mode corresponding to the single plane processor mode from the multiplane power mode in response to receiving the indicator of single plane activity;
the system receives an indicator of acceptability of the multiplane processor mode when the system receives an indicator of multiplane activity; and
the system switches to the multiplane power mode from the single plane power mode in response to receiving the indicator of multiplane activity.

11. The method of claim 10 , wherein the indicator of single plane activity comprises a user requesting a movie to be displayed on a virtual screen, the user opening a 2D application, or sensor data indicating that the user's gaze is converging to a particular plane for a predetermined threshold amount of time.

12. The method of claim 10 , further comprising switching between the discrete imaging mode and the multiplane imaging mode during a blink or an eye movement.

13. The method of claim 10 , wherein the indicator of multiplane activity comprises a user requesting that a movie currently displayed on a virtual screen be halted, or sensor data indicating that the user's gaze is converging away from a particular plane for a predetermined threshold amount of time.

14. A method in a virtual, augmented, or mixed reality system, comprising:
the system operating in a first power mode corresponding to a first processor mode;
the system receiving a request for a second processor mode;
the system switching to a second power mode corresponding to the second processor mode from the first power mode in response to receiving the request for the second processor mode;
the system receiving an indicator of acceptability of the first processor mode; and
the system switching to the first power mode from the second power mode in respon

Assignees

• Magic Leap Inc

Inventors

• Rodriguez Jose Felix
• Perez Ricardo Martinez

Classifications

• G06T5/90

  Dynamic range modification of images or parts thereof · CPC title

• G06F1/3203

  Power management, i.e. event-based initiation of a power-saving mode · CPC title

• G06T2210/44

  Morphing · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T19/00 Primary

  Manipulating three-dimensional [3D] models or images for computer graphics · CPC title