Ambient light context-aware display

Patent metadata

Field	Value
Publication number	US-9530342-B2
Application number	US-201314023326-A
Country	US
Kind code	B2
Filing date	Sep 10, 2013
Priority date	Sep 10, 2013
Publication date	Dec 27, 2016
Grant date	Dec 27, 2016

Abstract

Embodiments are disclosed that relate to modifying a display of a portable electronic device to account for ambient light. For example, one disclosed embodiment provides a method comprising determining an ambient light history including a plurality of ambient light color conditions sensed over a duration of device operation by an ambient light sensor, reading a display-ready image having a plurality of pixels from an image source, adjusting a manner in which the display-ready image is displayed by color-shifting at least a subset of the plurality of pixels based on the plurality of ambient light color conditions in the ambient light history to thereby generate a color-modified image, and displaying the color-modified image on the display of the portable electronic device.

First claim

The invention claimed is:

1. A portable electronic device comprising:
a display;
a light sensor configured to sense an ambient light color condition;
a processor configured to:
determine an ambient light history including a plurality of ambient light color conditions, including a plurality of correlated color temperatures and luminance data, sensed over a duration of device operation by a light sensor;
read a display-ready image from an image source, the display-ready image having a plurality of pixels;
adjust a manner in which the display-ready image is displayed on the portable electronic device by color-shifting at least a subset of the plurality of pixels based on the plurality of ambient light color conditions in the ambient light history to thereby generate a color-modified image, wherein color-shifting the subset of the plurality of pixels includes adjusting white points of the subset of the plurality of pixels;
display the color-modified image on the display of the portable electronic device;
detect a threshold brightness decrease during a predetermined time period based on the luminance data in the ambient light history; and
apply a dimming pattern with a target brightness that varies with time to effect a graduated dimming of the brightness of the display over a predetermined time in response to the detection of the threshold brightness decrease.

2. The portable electronic device of claim 1 , wherein the light sensor is an ambient light sensor configured to detect a luminance.

3. The portable electronic device of claim 1 , wherein the light sensor is a camera.

4. The portable electronic device of claim 3 ,
wherein the camera is a front camera, the portable electronic device further comprising a rear camera configured to capture ambient light; and
wherein the processor is configured to determine the ambient light history including the plurality of ambient light color conditions sensed over the duration of device operation by both the front and the rear camera to determine the ambient light history.

5. The portable electronic device of claim 1 ,
wherein the plurality of ambient color conditions includes a white point.

6. The portable electronic device of claim 1 , the processor further configured to:
detect a threshold brightness increase during a predetermined time period based on the luminance data in the ambient light history; and
apply a brightening pattern with a target brightness that varies with time to effect a graduated brightening of the brightness of the display over a predetermined time in response to the detection of the threshold brightness increase;
wherein the brightening pattern increases the brightness at a faster rate than the dimming pattern decreases the brightness.

7. The portable electronic device of claim 1 ,
wherein the image source includes an associated display pipeline from which the display-ready image is read; and
wherein color-shifting at least the subset of the plurality of pixels occurs after the display-ready image is read from the associated display pipeline of the image source.

8. The portable electronic device of claim 1 , wherein the processor is configured to modify a gamma curve and/or background brightness level associated with the display to adjust the manner in which the display-ready image is displayed.

9. The portable electronic device of claim 1 , wherein the processor is configured to modify color reproduction and/or peak luminance associated with the display-ready image to adjust the manner in which the display-ready image is displayed.

10. The portable electronic device of claim 1 , where the processor is further configured to:
transmit user profile data including the ambient light history, mode settings, and/or contextual data to one or more other computing devices each having a display to enable images displayed on the one or more other computing devices to be color-modified based on the transmitted user profile data.

11. A portable electronic device, comprising:
a display;
a light sensor configured to sense an ambient light color condition;
a processor configured to execute an adaptive display module, the adaptive display module configured to:
determine an ambient light history including a plurality of ambient light color conditions, including a plurality of correlated color temperatures and luminance data, sensed over a duration of device operation by the light sensor;
read a display-ready image from an image source, the display-ready image having a plurality of pixels;
adjust a manner in which the display-ready image is displayed on the portable electronic device by color-shifting at least a subset of the plurality of pixels based on the plurality of ambient light color conditions in the ambient light history to thereby generate a color-modified image, wherein color-shifting the subset of the plurality of pixels includes adjusting white points of the subset of the plurality of pixels;
display the color-modified image on the display;
detect a threshold brightness decrease during a predetermined time period based on the luminance data in the ambient light history; and
apply a dimming pattern with a target brightness that varies with time to effect a graduated dimming of the brightness of the display over a predetermined time in response to the detection of the threshold brightness decrease.

12. The portable electronic device of claim 11 , wherein the light sensor is an ambient light sensor configured to detect a luminance.

13. The portable electronic device of claim 11 , wherein the light sensor is a camera.

14. The portable electronic device of claim 13 ,
wherein the camera is a front camera, the portable electronic device further comprising a rear camera configured to configured to capture ambient light; and
wherein the ambient light history includes a plurality of ambient light color conditions sensed over a duration of device operation by both the front camera and the rear camera.

15. The portable electronic device of claim 11 ,
wherein the plurality of ambient light color conditions includes a white point.

16. The portable electronic device of claim 11 ,
wherein the adaptive display module is configured to determine a display brightness change responsive to the luminance data; and
wherein the adaptive display module is configured to detect a threshold brightness increase during a predetermined time period based on the luminance data in the ambient light history, and apply a brightening pattern with a target brightness that varies with time to effect a graduated brightening of the brightness of the display over a predetermined time;
wherein the brightening pattern increases the brightness at a faster rate than the dimming pattern decreases the brightness.

17. The portable electronic device of claim 11 , wherein the ambient light history has a temporal duration of at least ten minutes.

18. A method for adjusting a display to account for ambient light, the method comprising:
at a portable electronic device:
receiving ambient light data from an ambient light sensor, the ambient light data including ambient color data indicating an ambient light condition external to the portable electronic device and luminance data;
receiving contextual data from a contextual data source;
reading a display-ready image from an image source, the display-ready image having a plurality of pixels;
modifying one or more properties of at least a subset of the plurality of pixels based on at least the ambient light data and the contextual data;
displaying the modif

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Bell Cynthia Sue
• Woo Kevin
• Barnes Philip L
• Glenner Steven C

Classifications

• G09G2320/0673

  for control of gamma adjustment, e.g. selecting another gamma curve · CPC title

• G09G2320/0626

  for control of overall brightness · CPC title

• G09G2320/0666

  for control of colour parameters, e.g. colour temperature · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title

• G09G2360/144

  the light being ambient light · CPC title