Method for Applying a Vignette Effect to Rendered Images

Patent metadata

Field	Value
Publication number	US-2022076382-A1
Application number	US-202017086046-A
Country	US
Kind code	A1
Filing date	Oct 30, 2020
Priority date	Sep 8, 2020
Publication date	Mar 10, 2022
Grant date	—

Abstract

Methods and systems for applying a vignette effect to a rendered computer-generated image are presented. A kernel image including a kernel shape is overlaid on a control image including a vignette shape, creating a region where the kernel shape and control image overlap. A region of the rendered image corresponding to the overlapping region is blurred based on the shape of the overlapping region. A vignetting factor indicating a loss in intensity as a result of the blurring is computed based on the area of the overlapping region and the area of the kernel shape. The intensity of the blurred region is scaled upward based on the vignetting factor. The position of the kernel image on the control shape is shifted, resulting in a new overlapping region. Blurring and intensity compensation are performed for the region of the rendered image corresponding to the new overlapping region.

First claim

What is claimed is:

1 . A computer-implemented method for processing image data that includes depth information, the method comprising:
under the control of one or more computer systems configured with executable instructions:
obtaining a scene description describing elements of a scene to be rendered into a rendered computer-generated image representable by a pixel array;
determining, from the scene description, pixel values for the pixel array corresponding to a rendering of the scene, the pixel array comprising a plurality of pixel data elements, wherein each pixel data element of a pixel of the pixel array includes a pixel color value, a pixel alpha value, and a pixel depth value, and wherein each pixel data element has associated therewith an image position representing a position of its corresponding pixel in the rendered computer-generated image;
obtaining an indication of a kernel image, wherein the kernel image comprises a kernel shape defining a shape of a bokeh effect;
obtaining an indication of a control image, wherein the control image comprises a vignette shape defining a shape of a vignetting effect;
overlaying the kernel image on the control image at a first position based on a shift value and multiplying the kernel image by the control image to obtain a first blur shape based on a first overlapping region between the kernel image and the control image, wherein the first overlapping region corresponds to a first region of the rendered image; and
blurring the rendered image to produce a blurred image, wherein the first region of the rendered image is blurred based on the first blur shape to produce a first blurred region.

2 . The method of claim 1 , further comprising:
multiplying each color value corresponding to a pixel in the first blurred region by a first intensity compensation value equal to 1/(1−V 1 ); and determining a first vignetting factor, V 1 , indicating a first intensity loss at the first overlapping region, wherein in V 1 is equal to an area of the first overlapping region divided by an area of the kernel shape.

3 . The method of claim 1 , further comprising:
overlaying the kernel image on the control image at a second position based on the shift value and multiplying the kernel image by the control image to obtain a second blur shape based on a second overlapping region between the kernel image and the control image, wherein the second overlapping region corresponds to a second region of the rendered image; and blurring the second region of the rendered image according to the second blur shape to produce a second blurred region.

4 . The method of claim 3 , further comprising:
multiplying each color value corresponding to a pixel in the second blurred region by a second intensity compensation value equal to 1/(1−V 2 ); and determining a second vignetting factor, V 2 , indicating a second intensity loss at the second overlapping region, wherein in the second intensity loss is equal to an area of the second overlapping region divided by the area of the kernel shape.

5 . The method of claim 1 , further comprising darkening the first blurred region by multiplying each color value corresponding to a pixel in the first blurred region by V 1 .

6 . The method of claim 5 , further comprising re-brightening the first blurred region by dividing each color value corresponding to a pixel in the first region by V 1 .

7 . The method of claim 1 , wherein the kernel shape comprises a circle.

8 . The method of claim 1 , wherein the kernel shape comprises an oval.

9 . The method of claim 1 , wherein the kernel shape comprises a polygon.

10 . The method of claim 1 , wherein the vignette shape comprises a circle.

11 . The method of claim 1 , wherein the vignette shape comprises an oval.

12 . The method of claim 1 , wherein the vignette shape comprises a polygon.

13 . The method of claim 1 , wherein each pixel color value comprises a plurality of color components.

14 . The method of claim 1 , wherein blurring the rendered image comprises splatting a pixel across a region of nearby pixels within an area defined by the first blur shape, such that the pixel color value and the pixel alpha value of the pixel are distributed across the region of nearby pixels within the area defined by the first blur shape.

15 . The method of claim 1 , further comprising determining the kernel image from a lens function.

16 . The method of claim 1 , further comprising determining the control image from a lens function.

17 . A computer system comprising:
at least one processor; and a storage medium storing instructions, which when executed by the at least one processor, cause the computer system to implement the method of claim 1 .

18 . A non-transitory computer-readable storage medium storing instructions, which when executed by at least one processor of a computer system, causes the computer system to carry out the method of claim 1 .

19 . A computer-readable medium carrying instructions, which when executed by at least one processor of a computer system, causes the computer system to carry out the method of claim 1 .

20 . A carrier medium carrying image data that has been processed according to the method of claim 1 .

21 . A user interface for processing image data that includes depth information, comprising:
a first presentation element for at least a portion of a scene description, wherein the scene description defines elements of a scene to be rendered into a rendered computer-generated image representable by a pixel array, wherein pixel values for the pixel array correspond to a rendering of the scene, the pixel array comprising a plurality of pixel data elements, wherein a pixel data element of a pixel of the pixel array includes a pixel color value, a pixel alpha value, and a pixel depth value, and wherein the pixel data element has associated therewith an image position representing a position of the pixel in the rendered computer-generated image; a second presentation element for obtaining from a user an indication of a lens function, wherein the lens function determines a kernel shape or a vignette shape; a third presentation element for obtaining from the user a convolution range comprising adjacent pixels adjacent to the pixel, wherein the convolution range is based on a blur amount and a blur transparency value, wherein the blur amount is based on the lens function and the pixel depth value, and wherein the blur transparency value represents an amount of transparency to assign to the pixel based on the lens function and the depth value of the pixel; and a display for displaying a modified image including a modified pixel having a modified pixel color value, wherein the modified pixel color value is a first value that is a function of a scaled blend color value formed from a blend color value, wherein the blend color value is a first scaled value that is based on the blur transparency value, and wherein the blend color value is a second value that is based on color values of the adjacent pixels.

Assignees

• Weta Digital Ltd

Inventors

• Hillman Peter

Classifications

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06T11/23 Primary

  using straight lines or curves · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title