Compensating for ambient light in augmented or virtual reality systems

Patent metadata

Field	Value
Publication number	US-9996977-B2
Application number	US-201514705997-A
Country	US
Kind code	B2
Filing date	May 7, 2015
Priority date	Apr 18, 2014
Publication date	Jun 12, 2018
Grant date	Jun 12, 2018

Abstract

An augmented reality device comprises one or more sensors to detect a property pertaining to an ambient light, a processor communicatively coupled to the one or more sensors to modify a characteristic associated with a virtual image to be projected to the user of a head-mounted augmented reality system based at least in part on the detected property, and an optical sub-system to project light associated with the virtual image having the modified characteristic.

First claim

What is claimed is:

1. An augmented reality device, comprising;
one or more sensors to detect at least one property pertaining to an ambient light;
a processor communicatively coupled to the one or more sensors to modify a location of a virtual image to be projected to the user of a head-mounted augmented reality system based at least in part on the at least one detected property; and
an optical sub-system to project light associated with the virtual image at the modified location to the user of the augmented reality device.

2. The augmented reality device of claim 1 , wherein the one or more sensors comprises a photodiode.

3. The augmented reality device of claim 1 , wherein the processor is configured for identifying a dark area in the user's field of vision based at least in part on the at least one detected property, and wherein the location of the projected virtual image corresponds to the dark area of the user's field of vision.

4. The augmented reality device of claim 1 , wherein the processor is further configured for modifying a color intensity of the virtual image based at least in part on the at least one detected property.

5. The augmented reality device of claim 1 , wherein the processor is further configured for selecting one or more additional virtual objects to project to the user based at least in part on the at least one detected property.

6. The augmented reality device of claim 5 , wherein the one or more additional virtual objects comprises a halo.

7. The augmented reality device of claim 1 , wherein the processor is further configured for selecting a filter to change an intensity of the light associated with the virtual image based at least in part on the at least one detected property.

8. The augmented reality device of claim 1 , wherein the processor is further configured for selectively illuminating the virtual image based at least in part on the at least one detected property.

9. The augmented reality device of claim 1 , wherein the processor is further configured for modifying a speed of delivery of multiple frames corresponding to the virtual image.

10. The augmented reality device of claim 1 , further comprising a spatial backlight configured for selectively illuminating a portion of the projected light, wherein the processor is configured for modifying the spatial backlight based on the at least one detected property.

11. The augmented reality device of claim 10 , further comprising a variable focus element (VFE) configured for altering a perceived depth of the light, wherein the processor is configured for modifying the VFE based on the at least one detected property.

12. The augmented reality device of claim 11 , wherein the VFE shapes a wavefront associated with the virtual image synchronously with the spatial backlight.

13. The augmented reality device of claim 1 , further comprising a low pass filter to identify a movement of the user's head relative to the world.

14. The augmented reality device of claim 13 , wherein the processor is configured for modifying the location of the virtual image based at least in part on the identified head movement.

15. The augmented reality device of claim 1 , wherein the ambient light is perceivable by the user.

16. The augmented reality device of claim 15 , wherein the ambient light is capable of affecting a quality of the visibility of the virtual image to the user.

17. The augmented reality device of claim 16 , wherein the processor is configured for modifying the location of the virtual image to improve the visibility of the virtual image to the user in view of the ambient light.

18. The augmented reality device of claim 1 , wherein the detected property is a brightness of the ambient light.

19. The augmented reality device of claim 1 , wherein the augmented reality device has no control over the ambient light.

Assignees

• Magic Leap Inc

Inventors

• O'Connor Philip
• Miller Samuel A

Classifications

• H04S2400/15

  Aspects of sound capture and related signal processing for recording or reproduction · CPC title

• H04S2400/11

  Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) · CPC title

• H04S7/304

  For headphones · CPC title

• G06Q30/02

  Marketing; Price estimation or determination; Fundraising · CPC title

• A63F13/577

  using determination of contact between game characters or objects, e.g. to avoid collision between virtual racing cars · CPC title