Adaptive brightness for augmented reality display

Patent metadata

Field	Value
Publication number	US-11823634-B2
Application number	US-202217582633-A
Country	US
Kind code	B2
Filing date	Jan 24, 2022
Priority date	Jun 9, 2021
Publication date	Nov 21, 2023
Grant date	Nov 21, 2023

Abstract

Disclosed are systems and methods for adaptively adjusting brightness of a wearable device projection system. The systems and methods perform operations comprising: causing projection elements of the AR wearable device to project an image; receiving a measure of ambient light from an ambient light sensor; adjusting one or more hardware parameters of the projection elements of the AR wearable device based on the measure of ambient light; modifying one or more color values of the image displayed by the projection elements of the AR wearable device based on the measure of ambient light; and projecting the image with the modified color values using the projection elements of the AR wearable device with the adjusted one or more hardware parameters.

First claim

What is claimed is:

1. A method comprising:
causing, by one or more processors of an augmented reality (AR) wearable device, projection elements of the AR wearable device to project an image;
receiving, by the one or more processors of the AR wearable device, a measure of ambient light from an ambient light sensor;
adjusting one or more hardware parameters of projection elements of the AR wearable device based on the measure of the ambient light;
selecting an operating mode between operating the projection elements with a first quantity of Dark Time (DT) or a second quantity of DT based on an effective brightness value computed as a function of the measure of ambient light, the first and second quantities of DT controlling how many times colors are repeated by the projection elements, such that a number of times colors are repeated when operating the projection elements with the first quantity of DT differs from the number of times colors are repeated when operating the projection elements with the second quantity of DT;
modifying one or more color values of an image projected by the projection elements of the AR wearable device according to the selected operating mode; and
causing projection of an image with modified one or more color values using the projection elements of the AR wearable device with the adjusted one or more hardware parameters.

2. The method of claim 1 , wherein the AR wearable device comprises electronic eyeglasses.

3. The method of claim 1 , the first quantity of DT comprises 50% DT and the second quantity of DT comprises 0% DT.

4. The method of claim 3 , further comprising:
receiving input from a user to adjust a brightness setting on an application implemented on a mobile device associated with the AR wearable device, the effective brightness being computed independently of the ambient light in response to receiving an input from the user.

5. The method of claim 3 , further comprising:
determining that lenses of the AR wearable device comprise a tinted lens or clear lens;
selecting a first threshold from a plurality of thresholds for setting a screen brightness value based on determining that lenses of the AR wearable device comprise the tinted lens; and
selecting a second threshold from a plurality of thresholds for setting the screen brightness value based on determining that lenses of the AR wearable device comprise the clear lens.

6. The method of claim 5 , further comprising:
in response to determining that the lenses of the AR wearable device comprise the tinted lens, the AR wearable device:
compares the measure of the ambient light to the first threshold of the plurality of thresholds; and
sets the screen brightness value to given value based on comparing the measure of ambient light to the first threshold.

7. The method of claim 5 , wherein computing the effective brightness value comprises:
in response to determining that the lenses of the AR wearable device comprise the clear lens, the AR wearable device:
compares the measure of ambient light to the second threshold of the plurality of thresholds; and
sets the screen brightness value to given value based on comparing the measure of ambient light to the second threshold.

8. The method of claim 3 , further comprising computing the effective brightness value, wherein the one or more hardware parameters are adjusted and the one or more color values are modified based on the effective brightness value.

9. The method of claim 1 , further comprising:
in response to determining that the measure of ambient light is less than a first threshold, the AR wearable devices sets a screen brightness value to zero;
in response to determining that the measure of ambient light greater than the first threshold and is within a range of values, the AR wearable devices sets the screen brightness value to an interpolation between a minimum and maximum value; and
in response to determining that the measure of ambient light is greater than a second threshold, the AR wearable devices sets the screen brightness value to the maximum value.

10. The method of claim 1 , further comprising:
determining that a thermal limit of the AR wearable device has been reached; and
preventing the effective brightness value from exceeding a maximum brightness value associated with the thermal limit.

11. The method of claim 10 , wherein the maximum brightness value comprises 80% or less.

12. The method of claim 10 , wherein the effective brightness value is computed as a minimum of a screen brightness value computed based on the measure of ambient light and the maximum brightness value associated with the thermal limit.

13. The method of claim 1 , further comprising:
determining that the effective brightness value is within a first range of values; and
in response to determining that the effective brightness value is within the first range of values, varying light emitting diode (LED) current values of the projection elements between a maximum current and a minimum current linearly.

14. The method of claim 1 , further comprising:
determining that the effective brightness value is below a first range of values; and
in response to determining that the effective brightness value is below the first range of values, the AR wearable device multiplies red, green, and blue pixel values of the image by a specified value.

15. The method of claim 1 , wherein the projection elements are operated with the second quantity of DT in response to determining that the effective brightness value is a maximum effective brightness value, a current being driven to the projection elements at a maximum value.

16. The method of claim 1 , wherein the projection elements are operated with the first quantity of DT in response to determining that the effective brightness value is less than a maximum effective brightness value and greater than a second value, a current being driven to the projection elements at linear range between minimum and maximum values, wherein red, green, and blue pixel values of the image linearly scaled down.

17. The method of claim 1 , wherein the projection elements are operated with the first quantity of DT in response to determining that the effective brightness value corresponds to a specified value, a current being driven to the projection elements at linear range corresponds to a minimum value, wherein red, green, and blue pixel values of the image are multiplied by 0.

18. A system comprising:
one or more processors of an augmented reality (AR) wearable device configured to perform operations comprising:
causing projection elements of the AR wearable device to project an image;
receiving a measure of ambient light from an ambient light sensor;
adjusting one or more hardware parameters of the projection elements of the AR wearable device based on the measure of ambient light;
selecting an operating mode between operating the projection elements with a first quantity of Dark Time (DT) or a second quantity of DT based on an effective brightness value computed as a function of the measure of ambient light, the first and second quantities of DT controlling how many times colors are repeated by the projection elements, such that a number of times colors are repeated when operating the projection elements with the first quantity of DT differs from the number of times colors are repeated when operating the projection elements with the second quantity of DT;
modifying one or more color values of an image projected by the projection elements of the AR wearable device according to the sele

Assignees

• Snap Inc

Inventors

• Dewall Jeffrey Michael
• Kane Alexander
• Schnitzer Dominik
• Vignau Mathieu Emmanuel

Classifications

• G09G3/3406 Primary

  Control of illumination source (illumination devices structurally associated with liquid crystal cells G02F1/1336) · CPC title

• G02B27/0101

  characterised by optical features (G02B27/0172 takes precedence) · CPC title

• G02B27/0172

  characterised by optical features · CPC title

• G09G3/32

  semiconductive, e.g. using light-emitting diodes [LED] · CPC title

• G02B2027/0118

  comprising devices for improving the contrast of the display / brillance control visibility · CPC title