Cloud-based realtime raytracing

Patent metadata

Field	Value
Publication number	US-11069123-B2
Application number	US-201816236218-A
Country	US
Kind code	B2
Filing date	Dec 28, 2018
Priority date	Dec 28, 2018
Publication date	Jul 20, 2021
Grant date	Jul 20, 2021

Abstract

Cloud-based real time rendering. For example, one embodiment of a system comprises: a first graphics processing node to perform a first set of graphics processing operations to render a graphics scene, the first set of graphics processing operations comprising ray-tracing independent operations; an interconnect or network interface coupling the first graphics processing node to a second graphics processing node; the second graphics processing node to receive an indication of a current view of a user of the first graphics processing node and to receive or construct a view-independent surface generated by view-independent ray traversal and intersection operations; the second graphics processing node to responsively perform a view-dependent translation of the view-independent surface based on the current view of the user to generate a view-dependent surface and to provide the view-dependent surface to the first graphics processing node; and the first graphics processing node to perform a second set of graphics processing operations to complete rendering of the graphics scene using the view-dependent surface.

First claim

What is claimed is:

1. A system comprising:
a first graphics processing node to perform a first set of graphics processing operations to render a graphics scene, the first set of graphics processing operations comprising operations independent from ray tracing operations and tracking a current view of a user through one or more sensors of the first graphics processing node;
an interconnect or network interface coupling the first graphics processing node to a second graphics processing node;
the second graphics processing node to receive an indication of the current view of the user, and to receive, from a third graphics processing node, a view-independent surface generated by ray traversal and intersection operations that are view-independent; and
the third graphics processing node to perform the ray traversal and intersection operations that are view-independent,
wherein the second graphics processing node to perform a view-dependent translation of the view-independent surface based on the current view of the user to generate a view-dependent surface and to provide the view-dependent surface to the first graphics processing node, wherein the view-dependent translation comprises translating view-independent coordinates to view-dependent coordinates based on the current view of the user, and
wherein the first graphics processing node is to perform a second set of graphics processing operations to complete rendering of the graphics scene using the view-dependent surface.

2. The system of claim 1 wherein the first set of graphics processing operations comprise executing a local virtual reality application using local graphics data.

3. The system of claim 1 wherein the first set of graphics processing operations comprise rendering operations which are lighting-independent.

4. The system of claim 1 wherein the third graphics processing node is to compress the view-independent surface to generate a compressed view-independent surface and to transmit the compressed view-independent surface to the second graphics processing node.

5. The system of claim 4 wherein the third graphics processing node comprises graphics processing resources of a Cloud service, the third graphics processing node coupled to the second graphics processing node over a network interface.

6. The system of claim 5 wherein the third graphics processing node is to perform video encoding to compress the view-independent surface and wherein the second graphics processing node is to perform video decoding to decompress the view-independent surface.

7. The system of claim 1 wherein the first graphics processing node comprises a first graphics processing unit (GPU) including a first set of graphics processing cores to execute the first set of graphics processing operations.

8. The system of claim 7 wherein the second graphics processing node comprises a second GPU comprising a second set of graphics processing cores to perform the view-dependent translation.

9. A method comprising:
performing a first set of graphics processing operations on a first graphics processing node to render a graphics scene, the first set of graphics processing operations comprising operations independent from ray tracing operations;
tracking a current view of a user through one or more sensors of the first graphics processing node;
receiving an indication of the current view of the user at a second graphics processing node;
receiving, at the second graphics processing node from a third graphics processing node, a view-independent surface generated at the third graphics processing node by ray traversal and intersection operations that are view-independent;
performing a view-dependent translation of the view-independent surface on the second graphics processing node based on the current view of the user to generate a view-dependent surface and to provide the view-dependent surface to the first graphics processing node, wherein the view-dependent translation comprises translating view-independent coordinates to view-dependent coordinates based on the current view of the user; and
performing a second set of graphics processing operations on the first graphics processing node to complete rendering of the graphics scene using the view-dependent surface.

10. The method of claim 9 wherein the first set of graphics processing operations comprise executing a local virtual reality application using local graphics data.

11. The method of claim 9 wherein the first set of graphics processing operations comprise rendering operations which are lighting-independent.

12. The method of claim 9 wherein the third graphics processing node is to compress the view-independent surface to generate a compressed view-independent surface and to transmit the compressed view-independent surface to the second graphics processing node.

13. The method of claim 12 wherein the third graphics processing node comprises graphics processing resources of a Cloud service, the third graphics processing node coupled to the second graphics processing node over a network interface.

14. The method of claim 13 wherein the third graphics processing node is to perform video encoding to compress the view-independent surface and wherein the second graphics processing node is to perform video decoding to decompress the view-independent surface.

15. The method of claim 9 wherein the first graphics processing node comprises a first graphics processing unit (GPU) including a first set of graphics processing cores to execute the first set of graphics processing operations.

16. The method of claim 15 wherein the second graphics processing node comprises a second GPU comprising a second set of graphics processing cores to perform the view-dependent translation.

17. A non-transitory machine-readable medium having program code stored thereon which, when executed by a machine, causes the machine to perform the operations of:
performing a first set of graphics processing operations on a first graphics processing node to render a graphics scene, the first set of graphics processing operations comprising operations independent from ray tracing operations;
tracking a current view of a user through one or more sensors of the first graphics processing node;
receiving an indication of the current view of the user at a second graphics processing node;
receiving, at the second graphics processing node from a third graphics processing node, a view-independent surface generated at the third graphics processing node by ray traversal and intersection operations that are view-independent;
performing a view-dependent translation of the view-independent surface on the second graphics processing node based on the current view of the user to generate a view-dependent surface and to provide the view-dependent surface to the first graphics processing node, wherein the view-dependent translation comprises translating view-independent coordinates to view-dependent coordinates based on the current view of the user; and
performing a second set of graphics processing operations on the first graphics processing node to complete rendering of the graphics scene using the view-dependent surface.

18. The non-transitory machine-readable medium of claim 17 wherein the first set of graphics processing operations comprise executing a local virtual reality application using local graphics data.

19. The non-transitory machine-readable medium of claim 17 wherein the first set of graphics processing operations comprise rendering operations which are lighting-independent.

Assignees

• Intel Corp

Inventors

• Brownlee Carson
• Barczak Joshua
• Xiao Kai
• Apodaca Michael
• Laws Philip
• Raoux Thomas
• Schluessler Travis

Classifications

• G06T15/50

  Lighting effects · CPC title

• G06T15/005 Primary

  General purpose rendering architectures · CPC title

• G06T2200/28

  involving image processing hardware · CPC title

• G06T15/06 Primary

  Ray-tracing · CPC title

• G06T9/00

  Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00) · CPC title