Foveal adaptation of particles and simulation models in a foveated rendering system

Patent metadata

Field	Value
Publication number	US-10339692-B2
Application number	US-201715721580-A
Country	US
Kind code	B2
Filing date	Sep 29, 2017
Priority date	Jun 9, 2017
Publication date	Jul 2, 2019
Grant date	Jul 2, 2019

Abstract

A method for implementing a graphics pipeline. The method includes generating a system of particles creating an effect in a virtual scene, the system of particles comprising a plurality of particle geometries. The method includes determining a subsystem of particles from the system of particles, the subsystem of particles comprising a subset of particle geometries taken from the plurality of particle geometries. The method includes determining a foveal region when rendering an image of the virtual scene, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining that at least one portion of the effect is located in the peripheral region for the image. The method includes rendering the subsystem of particles to generate the effect.

First claim

What is claimed is:

1. A method for implementing a graphics pipeline, comprising:
generating a system of particles creating an effect in a virtual scene, the system of particles including a plurality of particle geometries;
determining a subsystem of particles from the system of particles, the subsystem of particles comprising a subset of particle geometries taken from the plurality of particle geometries;
determining a foveal region when rendering an image of the virtual scene, wherein the foveal region corresponds to where an attention of a user is directed;
determining that at least one portion of the effect is located in a peripheral region for the image;
rendering the subsystem of particles to generate the effect;
wherein the determining the subsystem of particles includes:
determining at least one particle of the system of particles is in the peripheral region;
generating a plurality of clusters of particles from the system of particles, wherein each of the clusters is represented by a corresponding aggregated particle, wherein the subsystem of particles includes the aggregated particles of the plurality of clusters of particles; and
simulating the effect using the subsystem of particles;

determining an aggregated location of the corresponding aggregated particle by averaging locations of particles in a corresponding cluster of particles;
determining an aggregated mass of the corresponding aggregated particle by summing masses of particles in the corresponding cluster of particles;
scaling a size of the corresponding aggregated particle based on a reduction ratio corresponding to the subsystem of particles; and
determining aggregated visual properties of the corresponding aggregated particle.

2. The method of claim 1 , wherein the determining a subsystem of particles comprises:
inputting a plurality of particle vertices into the graphics pipeline;
generating the plurality of particle geometries from the plurality of particle vertices;
simulating the effect using the plurality of particle geometries;
sampling the system of particles to generate the subsystem of particles; and
rendering the subset of particle geometries corresponding to the subsystem of particles.

3. The method of claim 2 , further comprising:
indexing vertices of the plurality of particle geometries;
wherein sampling the plurality of particles includes generating a draw list including the subset of particle geometries to be rendered; and
wherein rendering the subset of particle geometries includes rendering vertices of a first particle geometry when the vertices are associated with an index in the draw list.

4. The method of claim 2 , further comprising:
scaling up a size of each of the subsystem of particles based on a reduction ratio corresponding to the subset of particle geometries; and
modifying the visual properties of the particle to maintain a desired perceptual continuity.

5. The method of claim 1 , further comprising:
defining a bounding box for the system of particles; and
determining that the bounding box is in the peripheral region.

6. The method of claim 1 , further comprising:
generating the plurality of clusters of particles using a nearest neighbor search or a k-means clustering technique.

7. A computer system comprising:
a processor;
memory coupled to the processor and having stored therein instructions that, if executed by the computer system, cause the computer system to execute a method for implementing a graphics pipeline, comprising:
generating a system of particles creating an effect in a virtual scene, the system of particles comprising a plurality of particle geometries;
determining a subsystem of particles from the system of particles, the subsystem of particles including a subset of particle geometries taken from the plurality of particle geometries;
determining a foveal region when rendering an image of the virtual scene, wherein the foveal region corresponds to where an attention of a user is directed;
determining that at least one portion of the effect is located in a peripheral region for the image;
rendering the subsystem of particles to generate the effect;
wherein the determining the subsystem of particles in the method includes:
determining at least one particle of the system of particles is in the peripheral region;
generating a plurality of clusters of particles from the system of particles, wherein each of the clusters is represented by a corresponding aggregated particle, wherein the subsystem of particles includes the aggregated particles of the plurality of clusters of particles; and
simulating the effect using the subsystem of particles;

determining an aggregated location of the corresponding aggregated particle by averaging locations of particles in a corresponding cluster of particles;
determining an aggregated mass of the corresponding aggregated particle by summing masses of particles in the corresponding cluster of particles;
scaling a size of the corresponding aggregated particle based on a reduction ratio corresponding to the subsystem of particles; and
determining aggregated visual properties of the corresponding aggregated particle.

8. The computer system of claim 7 , wherein the determining a subsystem of particles in the method comprises:
inputting a plurality of particle vertices into the graphics pipeline;
generating the plurality of particle geometries from the plurality of particle vertices;
simulating the effect using the plurality of particle geometries;
sampling the system of particles to generate the subsystem of particles; and
rendering the subset of particle geometries corresponding to the subsystem of particles.

9. The computer system of claim 8 , wherein the method further comprises:
indexing vertices of the plurality of particle geometries;
wherein sampling the system of particles includes generating a draw list including the subset of particle geometries to be rendered;
wherein rendering the subset of particle geometries includes rendering vertices of a first particle geometry when the vertices are associated with an index in the draw list.

10. The computer system of claim 8 , wherein the method further comprises:
scaling up a size of each of the subsystem of particles based on a reduction ratio corresponding to the subset of particle geometries; and
modify the visual properties of the particle to maintain a desired perceptual continuity.

11. The computer system of claim 7 , wherein the method further comprises:
defining a bounding box for the system of particles; and
determining that the bounding box is in the peripheral region.

12. The computer system of claim 7 , wherein the method further comprises:
generating the plurality of clusters of particles using a nearest neighbor search or a k-means clustering technique.

13. A non-transitory computer-readable medium storing a computer program for implementing a graphics pipeline, the computer-readable medium comprising:
program instructions for generating a system of particles creating an effect in a virtual scene, the system of particles comprising a plurality of particle geometries;
program instructions for determining a subsystem of particles from the system of particles, the subsystem of particles including a subset of particle geometries taken from the plurality of particle geometries;
program instructions for determining a foveal region when rendering an image of the virtual scene, wherein the foveal region corresponds to where an attention of a user is directed;
program instructions for determining that at least one portion of the effect is located in a peripheral regio

Assignees

• Sony Interactive Entertainment Inc

Inventors

• Young Andrew
• Ho Chris
• Stafford Jeffrey Roger

Classifications

• A63F13/26

  having at least one additional display device, e.g. on the game controller or outside a game booth · CPC title

• A63F2300/6638

  for simulating particle systems, e.g. explosion, fireworks · CPC title

• A63F13/213

  comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence) · CPC title

• G09G2350/00

  Solving problems of bandwidth in display systems · CPC title

• G06T15/005 Primary

  General purpose rendering architectures · CPC title