Graphics system with additional context

Patent metadata

Field	Value
Publication number	US-11217004-B2
Application number	US-201816235484-A
Country	US
Kind code	B2
Filing date	Dec 28, 2018
Priority date	Apr 17, 2017
Publication date	Jan 4, 2022
Grant date	Jan 4, 2022

Abstract

An embodiment of an electronic processing system may include an application processor, persistent storage media communicatively coupled to the application processor, and a graphics subsystem communicatively coupled to the application processor. The graphics subsystem may include a first graphics engine to process a graphics workload, and a second graphics engine to offload at least a portion of the graphics workload from the first graphics engine. The second graphics engine may include a low precision compute engine. The system may further include a wearable display housing the second graphics engine. Other embodiments are disclosed and claimed.

First claim

What is claimed is:

1. A first graphics processing unit to process a graphics workload, comprising:
circuitry, implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, that is to process the graphics workload, wherein to process the graphics workload, the circuitry is to:
obtain rendering information from a second graphics processing unit,
receive gaze tracking data,
generate a first frame based on the gaze tracking data and through one or more of a time warp operation based on the rendering information received from the second graphics processing unit or a space warp operation based on the rendering information received from the second graphics processing unit, wherein the time warp operation is a reprojection operation and the space warp operation is a frame rate up conversion operation,
identify a second frame,
generate a third frame through a time warp operation based on the second frame and on a current head position,
determine whether a fourth frame has completed being generated, wherein the fourth frame is to be generated during a time period that at least partially overlaps with generation of the third frame,
select the generated third frame for display in response to the fourth frame not being completed within a predetermined amount of time, and
after the third frame is displayed, select the fourth frame for display in response to the fourth frame being completed.

2. The first graphics processing unit according to claim 1 , wherein to process the graphics workload, the circuitry is to perform a de-noise operation.

3. The first graphics processing unit according to claim 1 , wherein the first graphics processing unit is attached to a head-mounted display.

4. The first graphics processing unit according to claim 1 , wherein the first graphics processing unit has less processing power than the second graphics processing unit.

5. The first graphics processing unit according to claim 1 , wherein the first graphics processing unit is to perform a distortion operation of the graphics workload based on a tracked head movement.

6. The first graphics processing unit according to claim 1 , wherein the rendering information includes lighting information.

7. The first graphics processing unit according to claim 1 , wherein the second frame is to be generated through a time warp operation.

8. The first graphics processing unit according to claim 1 , wherein the circuitry is to bypass a time warp operation with respect to the second frame.

9. A head-mounted display (HMD) including:
a display to present a first frame;
a wireless module to communicate with a second graphics processing unit;
one or more cameras or tracking modules to detect gaze tracking data; and
a first graphics processing unit to process a graphics workload, wherein to process the graphics workload, the first graphics processing unit is to:
obtain rendering information from the second graphics processing unit,
receive the gaze tracking data,
generate the first frame based on the gaze tracking data and through one or more of a time warp operation based on the rendering information received from the second graphics processing unit or a space warp operation based on the rendering information received from the second graphics processing unit, wherein the time warp operation is a reprojection operation and the space warp operation is a frame rate up conversion operation,
identify a second frame,
generate a third frame through a time warp operation based on the second frame and on a current head position,
determine whether a fourth frame has completed being generated, wherein the fourth frame is to be generated during a time period that at least partially overlaps with generation of the third frame,
select the generated third frame for display in response to the fourth frame not being completed within a predetermined amount of time, and
after the third frame is displayed, select the fourth frame for display in response to the fourth frame being completed.

10. The HMD according to claim 9 , wherein to process the graphics workload, the first graphics processing unit is to perform a de-noise operation.

11. The HMD according to claim 9 , wherein the first graphics processing unit has less processing power than the second graphics processing unit.

12. The HMD according to claim 9 , wherein the first graphics processing unit is to perform a distortion operation of the graphics workload based on a tracked head movement.

13. The HMD according to claim 9 , wherein the rendering information includes lighting information.

14. The HMD according to claim 9 , wherein the second frame is to be generated through a time warp operation.

15. The HMD according to claim 9 , wherein the first graphics processing unit is to bypass a time warp operation with respect to the second frame.

16. At least one non-transitory computer readable storage medium, comprising a set of instructions, which when executed by a computing device cause the computing device to:
process a graphics workload, wherein to process the graphics workload, the computing device to is to:
obtain, with a first graphics processing unit, rendering information from a second graphics processing unit,
receive, with the first graphics processing unit, gaze tracking data,
generate, with the first graphics processing unit, a first frame based on the gaze tracking data and through one or more of a time warp operation based on the rendering information received from the second graphics processing unit or a space warp operation based on the rendering information received from the second graphics processing unit, wherein the time warp operation is a reprojection operation and the space warp operation is a frame rate up conversion operation,
identify, with the first graphics processing unit, a second frame,
generate, with the first graphics processing unit, a third frame through a time warp operation based on the second frame and on a current head position,
determine, with the first graphics processing unit, whether a fourth frame has completed being generated, wherein the fourth frame is to be generated during a time period that at least partially overlaps with generation of the third frame,
select, with the first graphics processing unit, the generated third frame for display in response to the fourth frame not being completed within a predetermined amount of time, and
after the third frame is displayed, select, with the first graphics processing unit, the fourth frame for display in response to the fourth frame being completed.

17. The at least one non-transitory computer readable storage medium of claim 16 , comprising a further set of instructions, which when executed by the computing device cause the computing device to:
perform, with the first graphics processing unit, a de-noise operation to process the graphics workload.

18. The at least one non-transitory computer readable storage medium of claim 16 , wherein the first graphics processing unit is attached to a head-mounted display.

19. The at least one non-transitory computer readable storage medium of claim 16 , wherein the first graphics processing unit has less processing power than the second graphics processing unit.

20. The at least one non-transitory computer readable storage medium of claim 16 , comprising a further set of instructions, which when executed by the computing device cause the computing device to:
perform, with the first graphics processing unit, a distortion operati

Assignees

• Intel Corp

Inventors

• Kuwahara Atsuo
• Vembar Deepak S
• Sakthivel Chandrasekaran
• Venkataraman Radhakrishnan
• Insko Brent E
• Kalra Anupreet S
• Labbe Hugues
• Appu Abhishek R
• Shah Ankur N
• Ray Joydeep
• Ould-Ahmed-Vall Elmoustapha
• Surti Prasoonkumar
• Ramadoss Murali

Classifications

• G06T15/04

  Texture mapping · CPC title

• G06T15/80

  Shading · CPC title

• G06T17/10

  Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes · CPC title

• G06T2215/16

  Using real world measurements to influence rendering · CPC title

• G06T15/005 Primary

  General purpose rendering architectures · CPC title