Ray-tracing for auto exposure

Patent metadata

Field	Value
Publication number	US-11308684-B2
Application number	US-202016994931-A
Country	US
Kind code	B2
Filing date	Aug 17, 2020
Priority date	Aug 18, 2019
Publication date	Apr 19, 2022
Grant date	Apr 19, 2022

Abstract

In various examples, a virtual light meter may be implemented along with ray tracing techniques in order to determine incident light values—e.g., incoming irradiance, incident radiance, etc.—for adjusting auto exposure values of rendered frames. For example, one or more rays may be used to sample incident light over a sampling pattern—such as a hemispherical sampling pattern—for any position in a virtual game environment. As a result, the incident light values may be sampled near a subject of interest in a scene or frame such that exposure values are consistent or stable regardless of the composition of the rendered frames.

First claim

What is claimed is:

1. A method comprising:
casting one or more first rays from a virtual camera into a virtual environment;
determining, based at least in part on one or more intersections of the one or more first rays, one or more subjects in the virtual environment;
instantiating one or more virtual light meters at one or more locations in the virtual environment corresponding to the one or more subjects;
sampling incident light at the one or more locations of the one or more virtual light meters based at least in part on casting one or more second rays from the one or more locations of the one or more virtual light meters using one or more ray tracing algorithms;
determining, based at least in part on the incident light, an exposure value; and
rendering a frame representative of the virtual environment based at least in part on the exposure value.

2. The method of claim 1 , wherein the casting of the one or more second rays is in a sampling pattern.

3. The method of claim 2 , wherein the sampling pattern corresponds to a hemisphere.

4. The method of claim 3 , wherein a base of the hemisphere is positioned along one of: parallel with a ground plane in the virtual environment or normal to a direction of a ray of the one or more first rays cast from the virtual camera that intersects the subject.

5. The method of claim 1 , wherein the one or more locations are one of above the one or more subjects or in front of the one or more subjects.

6. The method of claim 1 , wherein the rendering the frame is from a perspective of the virtual camera in the virtual environment.

7. The method of claim 6 , wherein the method is executed in a cloud computing environment.

8. The method of claim 1 , wherein the determining the one or more subjects in the virtual environment further includes determining, from application data, a subject location of at least one subject of the one or more subjects and that the exposure value is to be calculated based at least in part on the at least one subject.

9. A system comprising:
one or more processors; and
one or more memory devices storing instruction thereon that, when executed using the one or more processors, cause the one or more processors to execute operations comprising:
casting one or more rays from a virtual camera into a virtual environment;
determining, based at least in part on one or more intersections of the one or more rays, one or more subjects in a virtual environment;
instantiating one or more virtual light meters at one or more locations in the virtual environment corresponding to the one or more subjects;
sampling incoming irradiance at the one or more locations of the one or more virtual light meters based at least in part on executing a ray-tracing algorithm at the one or more locations;
determining, based at least in part on the incoming irradiance at the one or more locations, an exposure value; and
rendering, based at least in part on the exposure value, a frame representative of the virtual environment from a perspective of the virtual camera.

10. The system of claim 9 , wherein the ray-tracing algorithm includes, for each virtual light meter, casting a plurality of rays from a corresponding location of the virtual meter.

11. The system of claim 10 , wherein the rays are cast from the corresponding location and around a sampling hemisphere.

12. The system of claim 9 , wherein the one or more locations include at least one of a first location above the one or more subjects, a second location adjacent the one or more subjects, or a third location in front of a face of the one or more subjects.

13. The system of claim 9 , wherein the system is comprised in a cloud computing environment.

14. A processor comprising:
processing circuitry to:
cast one or more rays from a virtual camera into a virtual environment;
determine, based at least in part on one or more intersections of the one or more rays, one or more subjects in a virtual environment;
instantiate one or more virtual light meters at one or more locations in the virtual environment corresponding to the one or more subjects;
sample incoming irradiance at the one or more locations of the one or more virtual light meters based at least in part on executing a ray-tracing algorithm at the one or more locations;
determine, based at least in part on the incoming irradiance at the one or more locations, an exposure value; and
render, based at least in part on the exposure value, a frame representative of the virtual environment from a perspective of the virtual camera.

15. The processor of claim 14 , wherein the ray-tracing algorithm includes, for each virtual light meter, casting a plurality of rays from a corresponding location of the virtual meter.

16. The processor of claim 15 , wherein the rays are cast from the corresponding location and around a sampling hemisphere.

17. The processor of claim 16 , wherein a base of the sampling hemisphere is positioned along one of: parallel with a ground plane in the virtual environment or normal to a direction of a ray of the one or more rays cast from the virtual camera.

18. The processor of claim 14 , wherein the one or more locations include at least one of a first location above the one or more subjects, a second location adjacent the one or more subjects, or a third location in front of a face of the one or more subjects.

19. The processor of claim 14 , wherein the processor is comprised in a cloud computing environment.

20. The processor of claim 14 , wherein the determination of the one or more subjects in the virtual environment further includes determining, from application data, a subject location of at least one subject of the one or more subjects and that the exposure value is to be calculated based at least in part on the at least one subject.

Assignees

• Nvidia Corp

Inventors

• Boksansky Jakub
• Wright Oliver Mark

Classifications

• G06T15/506

  Illumination models · CPC title

• G06T15/20 Primary

  Perspective computation · CPC title

• G06T15/06 Primary

  Ray-tracing · CPC title

• A63F2300/538

  for performing operations on behalf of the game client, e.g. rendering · CPC title

• A63F2300/66

  for rendering three dimensional images · CPC title