Viewer synchronized illumination sensing

Patent metadata

Field	Value
Publication number	US-11996023-B2
Application number	US-202017640803-A
Country	US
Kind code	B2
Filing date	Sep 3, 2020
Priority date	Sep 5, 2019
Publication date	May 28, 2024
Grant date	May 28, 2024

Abstract

An embodiment of the disclosure provides a method and a system to sense a light source based on a viewer position in relation to display device. The system receives sensor data from one or more light sensors mounted on a wearable device worn by a viewer of a display device in a room, where a field of view for the light sensors covers at least a field of view of the viewer. The system identifies a light source perceived in a field of view of the viewer based on the sensor data. The system transmits data for one or more operations to be performed by the display device displaying content to the viewer to compensate for a change in brightness or color of the content caused by the light source based at least in part on light source information of the light source.

First claim

The invention claimed is:

1. A method to compensate for a light source perceived in a field of view of a viewer of a display device, the method comprising:
receiving sensor data from one or more light sensors mounted on a wearable device worn by the viewer, wherein a field of view for the light sensors covers at least the field of view of the viewer;
identifying the light source perceived in the field of view of the viewer based on the sensor data;
determining whether the light source is a light source reflected off a surface of the display device;
if the light source is a light source reflected off a surface of the display device, analyzing an average luminance and a variation of luminance for the surface of the display device; and
identifying if the light source is a diffuse ambient light source or a glare light source based on the average luminance and the variation of luminance; and
performing one or more operations, by a display controller of the display device, to compensate for a change in brightness or color of content displayed by the display device caused by the light source, based at least in part on light source information of the light source identified.

2. The method of claim 1 , further comprising:
tracking a change in luminance of the light source over a predetermined period of time to determine whether the change in luminance is gradual or abrupt; and
identifying the light source using a deterministic algorithm based on the tracked changes.

3. The method of claim 1 , wherein a glare light source is identified by identifying a portion of the surface of the display device with a large variation of luminance.

4. The method of claim 1 , wherein a glare light source is identified by identifying one or more artifacts via a positional discrepancy between images captured by a left light sensor and a right light sensor of the one or more light sensors mounted on the wearable device or a temporal discrepancy between two or more images of a light sensor of the wearable device.

5. The method of claim 1 , further comprising:
if the light source is a light source reflected off a surface of the display device, identifying whether the light source is controllable; and
if the light source is controllable, controlling a brightness of the light source; and
if the light source is not controllable, suggesting manual action or a change in viewing position to the viewer.

6. The method of claim 5 , wherein determining if the light source is controllable comprises:
automatically detecting internet of things (IOT) based light sources for the room over a local network; and
registering each of the detected light sources as a controllable light source.

7. The method of claim 1 , wherein the one or more light sensors mounted on the wearable device worn by the viewer include a left light sensor and a right light sensor to a left side and a right side of a left eye and a right eye of the viewer respectively.

8. The method of claim 1 , further comprising:
if the light source is not a light source reflected off a surface of the display device, determining if the light source is perceived in the field of view of the viewer;
if the light source is perceived in the field of view of the viewer, determining a shortest distance from the light source to an edge of the surface of the display device;
determining an intensity of the light source for the one or more operations to be performed based on the determined distance and intensity.

9. The method of claim 8 , if there are two or more viewers, the one or more operations is to be performed based on an average or weighted intensity perceived in a field of view for each of the two or more viewers.

10. The method of claim 8 , further comprising:
determining if the light source is perceived in a field of view of a left, a right, or both eyes of the viewer wearing the wearable device based on images captured by a left and a right light sensor of the one or more light sensors mounted on the wearable device.

11. The method of claim 10 , further comprising:
if the left and right light sensors both sense the light source, determining that the light source is visible to both eyes of the viewer.

12. The method of claim 10 , further comprising:
if only one of the left or the right light sensor, but not both, senses the light source, determining a vantage point of eye for the viewer based on a measured vantage point of sensor, and a distance offset from the sensor to the eye of the viewer being projected a distance from the wearable device to the surface of the display device;
determining if, based on the vantage point of eye, the light source is occluded by the surface of the display device; and
if the light source is determined to be occluded by the surface of the display device, determining that the light source is not visible to both eyes.

13. The method of claim 12 , further comprising:
determining a motion vector of the wearable device based on a motion sensor mounted on the wearable device; and
determining if, based on the vantage point of eye, the light source is occluded by the surface of the display device based on the value of the motion vector.

14. The method of claim 1 , wherein the one or more operations to be performed by the display device comprise:
adjusting a black level displayed by the display device; and
adjusting a tone mapping characteristic of the display device.

15. The method of claim 1 , wherein the one or more operations to be performed by the display device comprise notifying a viewer to take a manual action to compensate for a non-controllable glare light source.

16. The method of claim 1 , wherein the one or more sensors include one or more light transducers, image capturing devices, or video capturing devices.

17. The method of claim 1 , wherein transmitting the data for one or more operations to be performed by the display device causes the display device to look up an entry in a look-up table or parametric adjustment parameters for one or more operations to be performed based on a type of the light source to cause the one or more operations to be performed.

18. The method of claim 1 , wherein the wearable device includes a wearable headset.

19. The method of claim 18 , wherein the wearable headset includes a headphone.

20. The method of claim 1 , further comprising:
receiving the sensor data from the one or more light sensors mounted on the wearable device worn by the viewer, by the display controller of the display device;
retrieving from the received data the light source information identifying the light source perceived in the field of view of the viewer;
looking up in a look-up-table or a parametric table the one or more operations to be performed based on the light source information to compensate for a change in brightness or color of the content caused by the light source.

21. A non-transitory machine readable medium storing instructions which when executed by a processor cause the processor to perform a method claim 1 .

22. A wearable device which includes a memory and a processor configured to perform a method of claim 1 .

23. A method to identify a light source, the method comprising:
receiving sensor data from one or more light sensors mounted on or close to a display device in a room, wherein the one or more light sensors is directed at a viewer viewing the display device;
identifying a reflection for a light source on a passive surface of the viewer ba

Assignees

• Dolby Laboratories Licensing Corp

Inventors

• Kunkel Timo

Classifications

• G09G3/20 Primary

  for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix {no fixed position being assigned to or needed to be assigned to the individual characters or partial characters} · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title

• H04R1/1041

  Mechanical or electronic switches, or control elements (switches in general H01H) · CPC title

• G09G2320/0233

  Improving the luminance or brightness uniformity across the screen · CPC title

• G09G2320/0242

  Compensation of deficiencies in the appearance of colours · CPC title