Virtual, augmented, and mixed reality systems and methods

Patent metadata

Field	Value
Publication number	US-12190486-B2
Application number	US-202318487794-A
Country	US
Kind code	B2
Filing date	Oct 16, 2023
Priority date	Aug 22, 2016
Publication date	Jan 7, 2025
Grant date	Jan 7, 2025

Abstract

A virtual, augmented, or mixed reality display system includes a display configured to display virtual, augmented, or mixed reality image data, the display including one or more optical components which introduce optical distortions or aberrations to the image data. The system also includes a display controller configured to provide the image data to the display. The display controller includes memory for storing optical distortion correction information, and one or more processing elements to at least partially correct the image data for the optical distortions or aberrations using the optical distortion correction information.

First claim

The invention claimed is:

1. A virtual, augmented, or mixed reality display system comprising:
a display configured to display digital image data for a plurality of depth planes, the display comprising a first optical path to display image data corresponding to a first depth plane and an at least partially distinct second optical path to display image data corresponding to a second depth plane; and
a display controller configured to blend the image data corresponding to the first depth plane with the image data corresponding to the second depth plane such that when the blended image data is displayed by the display it appears to correspond to a virtual depth plane located between the first depth plane and the second depth plane.

2. The system of claim 1 , wherein the display controller is configured to blend the image data corresponding to the first depth plane with the image data corresponding to the second depth plane by calculating a weighted combination of the image data corresponding to the first depth plane and the image data corresponding to the second depth plane.

3. The system of claim 2 , wherein the display controller is configured to determine the weighted combination based on virtual depth plane indicator information embedded in the digital image data, the virtual depth plane indicator data specifying one of a plurality of possible virtual depth planes.

4. The system of claim 3 , wherein the virtual depth plane indicator data is embedded in pixel values of the digital image data.

5. The system of claim 4 , wherein the digital image data comprises a plurality of color values for each pixel, the plurality of least significant bits of the color values being the virtual depth plane indicator data.

6. The system of claim 4 , wherein the virtual depth plane indicator data is used to access a blending weight value associated with the virtual depth plane specified by the virtual depth plane indicator data.

7. The system of claim 6 , wherein blending weight values for each virtual depth plane are stored in a lookup table.

8. The system of claim 7 , wherein one or more lookup tables are provided for each depth plane of the digital image data.

9. The system of claim 1 , wherein the display controller is configured to blend all pixels of image data corresponding to the first depth plane and all pixels of image data corresponding to the second depth plane to a same virtual depth plane.

10. The system of claim 1 , wherein the display controller is configured to blend different pixels of image data corresponding to the first depth plane to different virtual depth planes.

11. A method in a virtual, augmented, or mixed reality display system, the method comprising:
providing digital image data for a plurality of depth planes to be shown on a display, the display comprising a first optical path to display image data corresponding to a first depth plane and an at least partially distinct second optical path to display image data corresponding to a second depth plane; and
blending the image data corresponding to the first depth plane with the image data corresponding to the second depth plane such that when the blended image data is displayed by the display it appears to correspond to a virtual depth plane located between the first depth plane and the second depth plane.

12. The method of claim 11 , further comprising blending the image data corresponding to the first depth plane with the image data corresponding to the second depth plane by calculating a weighted combination of the image data corresponding to the first depth plane and the image data corresponding to the second depth plane.

13. The method of claim 12 , further comprising determining the weighted combination based on virtual depth plane indicator information embedded in the digital image data, the virtual depth plane indicator data specifying one of a plurality of possible virtual depth planes.

14. The method of claim 13 , wherein the virtual depth plane indicator data is embedded in pixel values of the digital image data.

15. The method of claim 14 , wherein the digital image data comprises a plurality of color values for each pixel, the plurality of least significant bits of the color values being the virtual depth plane indicator data.

16. The method of claim 14 , further comprising using the virtual depth plane indicator data to access a blending weight value associated with the virtual depth plane specified by the virtual depth plane indicator data.

17. The method of claim 16 , further comprising storing blending weight values for each virtual depth plane in a lookup table.

18. The method of claim 17 , further comprising providing one or more lookup tables for each depth plane of the digital image data.

19. The method of claim 11 , further comprising blending all pixels of image data corresponding to the first depth plane and all pixels of image data corresponding to the second depth plane to a same virtual depth plane.

20. The method of claim 11 , further comprising blending different pixels of image data corresponding to the first depth plane to different virtual depth planes.

Assignees

• Magic Leap Inc

Inventors

• Rodriguez Jose Felix
• Perez Ricardo Martinez

Classifications

• G06T5/90

  Dynamic range modification of images or parts thereof · CPC title

• G06F1/3265

  Power saving in display device · CPC title

• G06F1/3243

  Power saving in microcontroller unit · CPC title

• G06F1/3231

  Monitoring the presence, absence or movement of users · CPC title

• G06F3/14 Primary

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title