Display engine surface blending and adaptive texel to pixel ratio sample rate system, apparatus and method

Patent metadata

Field	Value
Publication number	US-10109039-B1
Application number	US-201715494709-A
Country	US
Kind code	B1
Filing date	Apr 24, 2017
Priority date	Apr 24, 2017
Publication date	Oct 23, 2018
Grant date	Oct 23, 2018

Abstract

Systems, apparatuses and methods may provide away to blend two or more of the scene surfaces based on the focus area and an offload threshold. More particularly, systems, apparatuses and methods may provide a way to blend, by a display engine, two or more of the focus area scene surfaces and blended non-focus area scene surfaces. The systems, apparatuses and methods may include a graphics engine to render the focus area surfaces at a higher sample rate than the non-focus area scene surfaces.

First claim

What is claimed is:

1. A system comprising:
a power source to supply power to the system;
a memory comprising a scene, the memory coupled to a processor;
a graphics pipeline apparatus to receive the scene, the scene including scene surfaces, the graphics pipeline apparatus comprising:
a gaze monitor to:
monitor a gaze of a user viewing the scene, and
identify a focus area in the scene based on the gaze of the user;

a display engine to blend two or more of the scene surfaces based on the focus area; and
a graphics engine to offload computations by communicating to the display engine two or more of the scene surfaces when an offload threshold is satisfied, wherein the offload threshold is based at least in part on one or more performance factors.

2. The system of claim 1 ,
wherein the display engine converts the blended scene surfaces to a display resolution.

3. The system of claim 2 , wherein a non-focus area identifies a portion of the scene outside the focus area, wherein the scene surfaces include, focus area scene surfaces and non-focus area scene surfaces, wherein the focus area scene surfaces and non-focus area scene surfaces are displayed at different resolutions, and wherein the display engine blends two or more of the non-focus area scene surfaces.

4. The system of claim 3 , wherein the display engine blends two or more of the focus area scene surfaces and the blended non-focus area scene surfaces, wherein the display engine renders the focus area surfaces at a higher sample rate than the non-focus area scene surfaces.

5. The system of claim of claim 2 , wherein the performance factors include one or more of an available power capacity, an available compute capacity, a blending capability, a number of the output displays, a number of locations of the output displays, a distance between two or more of the output displays, a change in the number of locations of the output displays, or a change in the number of the output displays, wherein the display engine scales the resolution of the scene surfaces to a common pixel resolution.

6. The system of claim 2 , wherein the graphics engine further
selects a first sample rate to render a portion of the scene at a first resolution or a second shading rate, wherein the scene surfaces are of a type of textured surface, including fine grained textured surfaces and coarse grained textured surfaces,
identifies a texel size of texels in a texture map of the scene, and
selects a second sample rate to render the portion of the scene at a second resolution or a second shading rate, when the texel size satisfies a texel to pixel ratio threshold, wherein the texel size is based on one or more of the types of textured surfaces.

7. The system of claim 6 , wherein the texel to pixel ratio threshold indicates a number of texels mapping to a pixel in the scene, and wherein the first sample rate is higher than the second sample rate, wherein the graphics engine further selects the first sample rate or the second sample rate based on one or more performance targets, and wherein the performance targets include one or more of a target memory bandwidth, a target number of cache hits, a target number of working sets, a target number of sampler bandwidth, a target framerate, or execution time.

8. A graphics pipeline apparatus comprising:
a memory comprising a scene, the scene including scene surfaces;
a gaze monitor to:
monitor a gaze of a user viewing the scene, and
identify a focus area in the scene based on the gaze of the user;

a display engine to blend two or more of the scene surfaces based on the focus area; and
a graphics engine to offload computations by communicating to the display engine two or more of the scene surfaces when an offload threshold is satisfied, wherein the offload threshold is based at least in part on one or more performance factors.

9. The apparatus of claim 8 ,
wherein the display engine is to convert the blended scene surfaces to a display resolution.

10. The apparatus of claim 9 , wherein a non-focus area identifies a portion of the scene outside the focus area, wherein the scene surfaces are to include, focus area scene surfaces and non-focus area scene surfaces, wherein the focus area scene surfaces and non-focus area scene surfaces are to be displayed at different resolutions, and wherein the display engine is to blend two or more of the non-focus area scene surfaces, wherein the display engine is to blend two or more of the focus area scene surfaces and the blended non-focus area scene surfaces, and wherein the graphics engine is to render the focus area surfaces at a higher sample rate than the non-focus area scene surfaces.

11. The apparatus of claim 10 , wherein the graphics engine is further to
select a fast sample rate to render a portion of the scene at a first resolution or a first shading rate, wherein the scene surfaces are of a type of textured surface, including fine grained textured surfaces and coarse grained textured surfaces,
identify a texel size of texels in a texture map of the scene, and
select a second sample rate to render the portion of the scene at a second resolution or a second shading rate, when the texel size satisfies a texel to pixel ratio threshold, wherein the texel size is based on one or more of the types of textured surfaces.

12. The apparatus of claim 11 , wherein the texel to pixel ratio threshold indicates a number of texels mapping to a pixel in the scene, wherein the first sample rate is higher than the second sample rate, wherein the graphics engine is further to select the first sample rate or the second sample rate based on one or more performance targets, and wherein the performance targets include one or more of a target memory bandwidth, a target number of cache hits, a target number of working sets, a target number of sampler bandwidth, a target framerate, or execution time.

13. The apparatus of claim 9 , wherein the performance factors include one or more of an available power capacity, an available compute capacity, a blending capability, a number of the output displays, a number of locations of the output displays, a distance between two or more of the output displays, a change in the number of locations of the output displays, or a change in the number of the output displays, wherein the display engine is to scale the resolution of the scene surfaces to a common pixel resolution.

14. At least one non-transitory computer readable storage medium comprising a set of instructions, when executed, cause a computing device to:
monitor a gaze of a user viewing a scene in a memory, the scene including scene surfaces;
identify a focus area in the scene based on the gaze of the user;
blend, by a display engine, two or more of the scene surfaces based on the focus area; and
communicate, by a graphics engine, to the display engine two or more of the scene surfaces to offload computations when an offload threshold is satisfied, wherein the offload threshold is based at least in part on one or more performance factors.

15. The least one non-transitory computer readable storage medium of claim 14 , wherein the set of instructions, when executed, cause the computing device to:
convert, by the display engine, the blended scene surfaces to a display resolution.

16. The least one non-transitory computer readable storage medium of claim 15 , wherein the set of instructions, when executed, cause the computing device to:
identify a portion of the scene outside the focus area, wherein the scene surfaces include focus area scene surfaces and non-focus area scene surfaces, and w

Assignees

• Intel Corp

Inventors

• Ray Joydeep
• Schluessler Travis T
• Feit John H
• Kaburlasos Nikos
• Kwiatkowski Jacek
• Appu Abhishek R
• Vembu Balaji
• Surti Prasoonkumar

Classifications

• G06T17/10

  Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes · CPC title

• G06T15/005

  General purpose rendering architectures · CPC title

• G06T3/4053 Primary

  based on super-resolution, i.e. the output image resolution being higher than the sensor resolution · CPC title

• G06T15/80

  Shading · CPC title

• G06T15/04

  Texture mapping · CPC title