Real time ray tracing (RTRT)-based adaptive multi-frequency shading (AMFS)

Patent metadata

Field	Value
Publication number	US-11004252-B2
Application number	US-201816236245-A
Country	US
Kind code	B2
Filing date	Dec 28, 2018
Priority date	Dec 28, 2018
Publication date	May 11, 2021
Grant date	May 11, 2021

Abstract

Real time ray tracing-based adaptive multi frequency shading. For example, one embodiment of an apparatus comprising: rasterization hardware logic to process input data for an image in a deferred rendering pass and to responsively update one or more graphics buffers with first data to be used in a subsequent rendering pass; ray tracing hardware logic to perform ray tracing operations using the first data to generate reflection ray data and to store the reflection ray data in a reflection buffer; and image rendering circuitry to perform texture sampling in a texture buffer based on the reflection ray data in the reflection buffer to render an output image.

First claim

What is claimed is:

1. An apparatus comprising:
rasterization hardware logic to process input data for an image in a deferred rendering pass and to responsively update one or more graphics buffers with first data to be used in a subsequent rendering pass;
ray tracing hardware logic to perform ray tracing operations using the first data to generate reflection ray data and to store the reflection ray data in a reflection buffer, the reflection ray data comprising bidirectional reflectance distribution function (BRDF) weights, procedural texture IDs, material IDs, primitive IDs, level of detail (LOD), and UV coordinates;
adaptive multi-frequency shading (AMFS) hardware logic to perform texture marking operations to identify portions of texture data in a texture buffer; and
image rendering circuitry to perform texture sampling in the texture buffer based on the reflection ray data in the reflection buffer to render an output image, wherein the image rendering circuitry comprises shader execution circuitry to execute shading operations using only those portions of the texture data identified by the AMFS hardware logic.

2. The apparatus of claim 1 wherein the image rendering circuitry comprises post-processing circuitry to sample the texture data at positions indicated by the reflection ray data.

3. The apparatus of claim 1 wherein the graphics buffers comprise a G-buffer and a Z-buffer.

4. The apparatus of claim 3 wherein in the deferred rendering pass the rasterization hardware logic is to render depth values for pixels or groups of pixels to the Z-Buffer and coordinates, normals, and materials for each surface to the G-buffer.

5. The apparatus of claim 1 wherein the texture data comprises a procedural texture and wherein the image rendering circuitry samples the procedural texture at positions indicated by the reflection ray data.

6. The apparatus of claim 5 wherein the image rendering circuitry is to perform post-processing operations to render the output image including color-grading operations.

7. The apparatus of claim 1 , wherein the reflection ray data stored in the reflection buffer is subsequently used in a shading pass and a post-processing pass.

8. The apparatus of claim 1 , wherein a corresponding set of reflection ray data is generated and stored in the reflection buffer for each ray reflection bounce detected during the performance of the ray tracing operations.

9. A method comprising:
performing a deferred rendering pass to process input data for an image and responsively updating one or more graphics buffers with first data to be used in a subsequent rendering pass;
performing ray tracing operations using the first data to generate reflection ray data and to store the reflection ray data in a reflection buffer, the reflection ray data comprising bidirectional reflectance distribution function (BRDF) weights, procedural texture IDs, material IDs, primitive IDs, level of detail (LOD), and UV coordinates;
performing texture sampling in a texture buffer based on the reflection ray data in the reflection buffer to render an output image;
performing texture marking operations to identify portions of texture data in the texture buffer; and
executing shading operations using only those portions of the texture data identified by the texture marking operations.

10. The method of claim 9 further comprising:
sampling the texture data at positions indicated by the reflection ray data.

11. The method of claim 9 wherein the graphics buffers comprise a G-buffer and a Z-buffer.

12. The method of claim 11 wherein in the deferred rendering pass depth values are rendered for pixels or groups of pixels to the Z-Buffer and coordinates, normals, and materials are rendered for each surface to the G-buffer.

13. The method of claim 9 wherein the texture data comprises a procedural texture and wherein the procedural texture is sampled at positions indicated by the reflection ray data.

14. The method of claim 13 further comprising:
performing post-processing operations to render the output image including color-grading operations.

15. A non-transitory machine-readable medium having program code stored thereon which, when executed by a machine, causes the machine to perform the operations of:
performing a deferred rendering pass to process input data for an image and responsively updating one or more graphics buffers with first data to be used in a subsequent rendering pass;
performing ray tracing operations using the first data to generate reflection ray data and to store the reflection ray data in a reflection buffer, the reflection ray data comprising bidirectional reflectance distribution function (BRDF) weights, procedural texture IDs, material IDs, primitive IDs, level of detail (LOD), and UV coordinates;
performing texture sampling in a texture buffer based on the reflection ray data in the reflection buffer to render an output image;
performing texture marking operations to identify portions of texture data in the texture buffer; and
executing shading operations using only those portions of the texture data identified by the texture marking operations.

16. The non-transitory machine-readable medium of claim 15 further comprising program code to cause the machine to perform the operation of:
sampling the texture data at positions indicated by the reflection ray data.

17. The non-transitory machine-readable medium of claim 15 wherein the graphics buffers comprise a G-buffer and a Z-buffer.

18. The non-transitory machine-readable medium of claim 17 wherein in the deferred rendering pass depth values are rendered for pixels or groups of pixels to the Z-Buffer and coordinates, normals, and materials are rendered for each surface to the G-buffer.

19. The non-transitory machine-readable medium of claim 15 wherein the texture data comprises a procedural texture and wherein the procedural texture is sampled at positions indicated by the reflection ray data.

20. The non-transitory machine-readable medium of claim 19 further comprising program code to cause the machine to perform the operation of:
performing post-processing operations to render the output image including color-grading operations.

Assignees

• Intel Corp

Inventors

• Brownlee Carson
• Liktor Gabor
• Barczak Joshua
• Xiao Kai
• Apodaca Michael
• Raoux Thomas

Classifications

• G06T15/005

  General purpose rendering architectures · CPC title

• G06T15/06 Primary

  Ray-tracing · CPC title

• G06T15/80

  Shading · CPC title

• G06T1/20 Primary

  Processor architectures; Processor configuration, e.g. pipelining · CPC title

• G06T15/04

  Texture mapping · CPC title