Luminance comfort prediction and adjustment

Patent metadata

Field	Value
Publication number	US-10380973-B2
Application number	US-201715422210-A
Country	US
Kind code	B2
Filing date	Feb 1, 2017
Priority date	Feb 1, 2017
Publication date	Aug 13, 2019
Grant date	Aug 13, 2019

Abstract

One or more levels of maladaptation are calculated relative to frames of media content having abrupt jumps from periods of low illumination to bright illumination when visual acuity may be lost and/or discomfort may be experienced. These levels of maladaptation may be correlated with subjectively determined levels of perceived luminance discomfort. Based upon the levels of perceived luminance discomfort that can be derived from the levels of maladaptation, the media content may be adjusted.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
analyzing media content and computing one or more adaptation states relative to the media content by estimating a perceived magnitude of maladaptation;
quantifying the perceived magnitude of maladaptation in terms of perceived luminance discomfort by correlating the one or more adaptation states to one or more corresponding levels of perceived luminance discomfort experienced by one or more viewers of test media content, the test media content comprising known variations in luminance; and
adjusting luminance of the media content to comport with one or more desired luminance-based effects relative to the perceived luminance discomfort.

2. The computer-implemented method of claim 1 , wherein the analyzing of the media content comprises determining a luminance level associated with a pixel of a frame of the media content.

3. The computer-implemented method of claim 2 , wherein the analyzing of the media content comprises determining a luminance level associated with a spatial neighborhood approximately about the pixel.

4. The computer-implemented method of claim 3 , wherein the analyzing of the media content comprises determining an ambient luminance level relative to the pixel.

5. The computer-implemented method of claim 2 , wherein the computing of the one or more adaptation states comprises determining a level of local adaptation predicted as being experienced by the viewer relative to the pixel.

6. The computer-implemented method of claim 5 , wherein the level of local adaptation is determined relative to a period between at least two times during which the luminance level associated with the pixel is determined.

7. The computer-implemented method of claim 1 , further comprising applying a pooling function to combine the one or more corresponding levels of perceived luminance discomfort associated with determined luminance levels of one or more pixels of a frame of the media content, the combination of the one or more corresponding levels of perceived luminance discomfort comprising a frame-wide estimate of perceived luminance discomfort.

8. The computer-implemented method of claim 1 , wherein each of the one or more corresponding levels of perceived luminance discomfort determination of discomfort experienced during exposure to test media content having commensurate luminance characteristics as the analyzed media content.

9. The computer-implemented method of claim 1 , further comprising applying a transducer function to translate characterization of the one or more adaptation states to characterizations of perceived luminance discomfort.

10. The computer-implemented method of claim 1 , wherein the adjusting of the luminance of the media content to comport with one or more desired luminance-based effects comprises applying a mathematical optimization function adapted to maintain a mean luminance of the media content below a luminance threshold.

11. The computer-implemented method of claim 1 , wherein the adjusting of the luminance of the media content to comport with one or more desired luminance-based effect comprises applying a mathematical function adapted to increase luminance in one or more frames of the media content to coincide with a visual thematic element of the media content.

12. A system, comprising:
one or more processors; and
a memory having computer code being executed to cause the one or more processors to:
analyze one or more pixels of a frame of media content;
compute one or more adaptation states by estimating a perceived magnitude of maladaptation relative to each of the one or more pixels;
quantify the perceived magnitude of maladaptation in terms of perceived luminance discomfort by translating the one or more adaptation states to one or more estimates of perceived luminance discomfort experienced by one or more viewers of test media content, the test media content comprising known variations in luminance, when the one or more adaptation states is indicative of maladaptation of a visual system viewing the media content; and
adjust luminance of the media content to comport with one or more desired luminance-based effects relative to the perceived luminance discomfort.

13. The system of claim 12 , wherein the computer code being executed further causes the one or more processors to determine a luminance level associated with a spatial neighborhood approximately about each of the one or more pixels.

14. The system of claim 13 , wherein the computer code being executed further causes the one or more processors to determine an ambient luminance level relative to each of the one or more pixels.

15. The system of claim 12 , wherein the one or more computed adaptation states are indicative of maladaptation on spatial and temporal levels.

16. The system of claim 12 , wherein the computer code being executed to cause the one or more processors to translate the one or more adaptation states comprises computer code that when executed, causes the one or more processors to convert characterizations of the one or more adaptation states from physical luminance units to subjective rankings of the perceived luminance discomfort.

17. The system of claim 12 , further comprising a post-processing system having computer code being executed to cause the post-processing system to adjust luminance of the media content based upon the one or more estimates of perceived luminance discomfort.

18. The system of claim 17 , wherein the computer code being executed to cause the post-processing system to adjust the luminance of the media content comprises computer code that when executed, causes the post-processing system to apply a mathematical optimization function adapted to maintain a mean luminance of the media content below a luminance threshold.

19. The system of claim 17 , wherein the computer code being executed to cause the post-processing system to adjust the luminance of the media content comprises computer code that when executed, causes the post-processing system to apply a mathematical function adapted to increase luminance in one or more frames of the media content to coincide with a visual thematic element of the media content.

20. The system of claim 12 , wherein the memory further comprises computer code being executed to cause the one or more processors to combine the one or more estimates of perceived luminance discomfort into a frame-wide estimate of perceived luminance discomfort.

Assignees

• Disney Entpr Inc

Inventors

• Aydin Tunc Ozan
• Mahmalat Samir

Classifications

• G09G5/10 Primary

  Intensity circuits · CPC title

• G09G2320/10

  Special adaptations of display systems for operation with variable images · CPC title

• G09G2360/141

  the light conveying information used for selecting or modulating the light emitting or modulating element · CPC title

• G09G2320/0626

  for control of overall brightness · CPC title

• G09G5/02

  characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)} · CPC title