Physiologically based adaptive image generation

Patent metadata

Field	Value
Publication number	US-9773473-B2
Application number	US-201514722036-A
Country	US
Kind code	B2
Filing date	May 26, 2015
Priority date	Jun 3, 2014
Publication date	Sep 26, 2017
Grant date	Sep 26, 2017

Abstract

A system, computer-readable medium, and method are provided for generating images based on adaptations of the human visual system. An input image is received, an effect provoking change is received, and an afterimage resulting from a cumulative effect of human visual adaptation is computed based on the effect provoking change and a per-photoreceptor type physiological adaptation of the human visual system. The computed afterimage may include a bleaching afterimage effect and/or a local adaptation afterimage effect. The computed afterimage is then accumulated into an output image for display.

First claim

What is claimed is:

1. A method, comprising:
receiving an input image comprising pixels within a region that is brightly illuminated;
computing, by a processor rendering a phenomenological model, an afterimage corresponding to the region, wherein first colors of pixels in the afterimage correspond to an intensity of the brightly illuminated region;
accumulating the afterimage into an output image, wherein the afterimage brightens the pixels within the region of the output image;
displaying the output image;
computing, by the processor rendering the phenomenological model, a second afterimage, wherein at least a portion of second colors of pixels in the second afterimage are different than the first colors;
accumulating the second afterimage into a second output image; and
displaying the second output image.

2. The method of claim 1 , further comprising computing, by the processor rendering the phenomenological model, a local adaptation effect based on the input image.

3. The method of claim 2 , further comprising accumulating the local adaptation effect into the output image before displaying the output image.

4. The method of claim 2 , wherein the local adaptation effect changes over time.

5. The method of claim 2 , wherein the local adaptation effect is a negative afterimage that darkens the pixels.

6. The method of claim 2 , wherein the phenomenological model specifies a gain function corresponding to the local adaptation effect, a gain value is computed using the gain function, and the gain value is applied to the first colors.

7. The method of claim 6 , wherein a separate gain value is computed for each color channel of a first color space associated with photoreceptors and the color channels are converted into a second color space associated with the display.

8. The method of claim 1 , wherein the region of the input image is associated with a camera flash and the afterimage and second afterimage are bleaching afterimages.

9. The method of claim 1 , wherein a viewer's gaze changes from a first position to a second position, and the afterimage is located at the first position and the second afterimage is located at the second position.

10. The method of claim 1 , wherein the input image is accumulated into the output image before the output image is displayed.

11. The method of claim 1 , wherein the phenomenological model specifies a separate bleaching strength parameter for each color channel of a color space associated with the display.

12. The method of claim 1 , wherein the phenomenological model specifies a separate bleaching strength parameter for each color channel of a first color space associated with photoreceptors and the color channels are converted into a second color space associated with the display.

13. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform steps comprising:
receiving an input image comprising pixels within a region that is brightly illuminated;
computing an afterimage corresponding to the region by rendering a phenomenological model, wherein first colors of pixels in the afterimage correspond to an intensity of the brightly illuminated region;
accumulating the afterimage into an output image, wherein the afterimage brightens the pixels within the region of the output image;
displaying the output image;
computing a second afterimage by rendering the phenomenological model, wherein at least a portion of second colors of pixels in the second afterimage are different than the first colors;
accumulating the second afterimage into a second output image; and
displaying the second output image.

14. The non-transitory computer-readable storage medium of claim 13 , further comprising computing a local adaptation effect based on the input image by rendering the phenomenological model.

15. The non-transitory computer-readable storage medium of claim 14 , further comprising accumulating the local adaptation effect into the output image before displaying the output image.

16. The non-transitory computer-readable storage medium of claim 13 , wherein the brightly illuminated region is associated with a camera flash and the afterimage and second afterimage are bleaching afterimages.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the afterimage changes over time.

18. A system, comprising:
a memory configured to store an output image for display and a phenomenological model; and
a processor that is coupled to the memory and configured to:
receive an input image comprising pixels within a region that is brightly illuminated;
compute an afterimage corresponding to the region by rendering the phenomenological model, wherein first colors of pixels in the afterimage correspond to an intensity of the brightly illuminated region;
accumulate the afterimage into the output image, wherein the afterimage brightens the pixels within the region of the output image;
transmit the output image to a display;
compute a second afterimage by rendering the phenomenological model, wherein at least a portion of second colors of pixels in the second afterimage are different than the first colors;
accumulate the second afterimage into a second output image; and
transmit the second output image to the display.

19. The system of claim 18 , wherein the processor is further configured to render the phenomenological model to compute a local adaptation afterimage effect based on the input image.

20. The system of claim 18 , wherein the brightly illuminated region is associated with a camera flash and the afterimage and second afterimage are bleaching afterimages.

Assignees

• Nvidia Corp

Inventors

• Gallo Orazio
• Pulli Kari Antero
• Jacobs David Edward

Classifications

• G09G5/10 Primary

  Intensity circuits · CPC title

• G09G5/02

  characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)} · CPC title

• G09G2320/066

  for control of contrast · CPC title

• G09G2320/0257

  Reduction of after-image effects · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title