Graphics processing systems and graphics processors

Patent metadata

Field	Value
Publication number	US-10665208-B2
Application number	US-201715693913-A
Country	US
Kind code	B2
Filing date	Sep 1, 2017
Priority date	Sep 5, 2016
Publication date	May 26, 2020
Grant date	May 26, 2020

Abstract

A graphics processing system includes a graphics processing pipeline including at least an initial processing stage and a further processing stage. Data for a scene at a first resolution and data for the scene at a second resolution are processed in the initial processing stage. After processing data for the scene at the first and second resolutions in the initial processing stage, gaze-tracking data relating to a current positioning of at least one eye of a user of a virtual reality user device is received. At least one sub-region of the scene is identified from the gaze-tracking data. Data for the scene at the first resolution and only data corresponding to the identified at least one sub-region of the scene at the second resolution are processed in the further processing stage. The scene is rendered by combining the data for the scene processed in the further processing stage.

First claim

What is claimed is:

1. A method of operating a graphics processing system, the system comprising a graphics processing pipeline comprising at least an initial processing stage and a further processing stage, the method comprising:
processing, in the initial processing stage, data for a scene at a first resolution;
processing, in the initial processing stage, data for the scene at a second resolution, wherein the initial processing stage comprises one or more geometry operations;
after processing data for the scene at the first and second resolutions in the initial processing stage, receiving gaze-tracking data relating to a current positioning of at least one eye of a user of a virtual reality user device;
identifying, from the received gaze-tracking data, at least one sub-region of the scene;
processing, in the further processing stage, data for the scene at the first resolution;
processing, in the further processing stage, only data corresponding to the identified at least one sub-region of the scene at the second resolution, wherein the further processing stage comprises one or more pixel-processing operations; and
rendering the scene by combining the data for the scene processed in the further processing stage at the first resolution, and the data corresponding to the identified at least one sub-region of the scene processed in the further processing stage at the second resolution.

2. A method according to claim 1 , wherein the graphics processing pipeline comprises an intermediate processing stage in-between the initial processing stage and the further processing stage, the method comprising:
processing, in the intermediate processing stage, data for the scene at the first resolution; and
processing, in the intermediate processing stage, only data corresponding to the identified at least one sub-region of the scene at the second resolution,
wherein the gaze-tracking data is received before processing data for the scene at the first and second resolutions in the intermediate processing stage and relates to a current position of at least one eye of a user of the virtual reality user device before processing data for the scene at the first and second resolutions in the intermediate processing stage.

3. A method according to claim 2 , wherein processing for the further processing stage has a higher computational burden than processing for the intermediate processing stage.

4. A method according to claim 2 , wherein processing for the further processing stage has a higher computational burden than processing for the initial processing stage.

5. A method according to claim 1 , wherein the graphics processing pipeline comprises an intermediate processing stage in-between the initial processing stage and the further processing stage, the method comprising:
processing, in the intermediate processing stage, data for the scene at the first resolution; and
processing, in the intermediate processing stage, data for the scene at the second resolution,
wherein the gaze-tracking data is received after processing data for the scene at the first and second resolutions in the intermediate processing stage and relates to a current positioning of at least one eye of a user of the virtual reality user device after processing data for the scene at the first and second resolutions in the intermediate processing stage.

6. A method according to claim 5 , wherein processing for the further processing stage has a higher computational burden than processing for the intermediate processing stage.

7. A method according to claim 5 , wherein processing for the further processing stage has a higher computational burden than processing for the initial processing stage.

8. A method according to claim 1 , wherein the initial processing stage comprises one or more data buffering operations.

9. A method according to claim 1 , wherein processing of data for a scene in each stage of the graphics processing pipeline comprises processing a frame of data for the scene in each stage of the graphics processing pipeline.

10. A method according to claim 1 , wherein the first resolution is relatively high compared to the second resolution.

11. A method according to claim 1 , wherein the first and second resolution have a predetermined relationship.

12. A method according to claim 1 , wherein the received gaze-tracking data relates to a current fixation point of the fovea of at least one eye of a user of the virtual reality user device, and
wherein the identified at least one sub-region of the scene relates to a sub-region centred around the current fixation point of the fovea of the at least one eye of a user of the virtual reality user device.

13. A method according to claim 1 , wherein data for the scene comprises data associated with a left eye view and data associated with a right eye view and processing of the data for each stage of the graphics processing pipeline comprises processing data associated with the left eye view and processing data associated with the right eye view, and
wherein the received gaze-tracking data relates to a current positioning of the fovea of a left eye of a user of the virtual reality user device and a current positioning of the fovea of a right eye of a user of the virtual reality user device.

14. A method according to claim 13 , wherein the identified at least one sub-region of the scene relates to a left eye sub-region centred around the current positioning of the fovea of the left eye of the user of the virtual reality user device and a right eye sub-region centred around the current positioning of the fovea of the right eye of the user of the virtual reality user device, and
wherein rendering the scene comprises:
combining left eye data for the scene processed in the further processing stage at the first resolution, and data corresponding to the identified left eye sub-region of the scene processed in the further processing stage at the second resolution; and
combining right eye data for the scene processed in the further processing stage at the first resolution, and data corresponding to the identified right eye sub-region of the scene processed in the further processing stage at the second resolution.

15. A method according to claim 14 , wherein at least a part of the identified left eye sub-region is different from at least a part of the identified right eye sub-region.

16. A method according to claim 1 , comprising:
processing, in the initial processing stage, data for the scene at a third resolution,
wherein the gaze-tracking data is received after processing data for the scene at the third resolution in the initial processing stage and relates to a current positioning of at least one eye of a user of the virtual reality user device after processing data for the scene at the third resolution in the initial processing stage, the method comprising:
processing, in the further processing stage, data for the scene at the third resolution; and
processing, in the further processing stage, only data corresponding to a further sub-region of the scene at the third resolution,
wherein rendering the scene comprises further combining the data for the scene processed in the further processing stage at the third resolution.

17. A method according to claim 16 , comprising identifying the further sub-region of the scene from the received gaze-tracking data.

18. A method according to claim 16 , comprising calculating the further sub-region of the scene on the basis of the identified at least one sub-region of the scene.

19. A no

Assignees

• Advanced Risc Mach Ltd

Inventors

• Martin Samuel

Classifications

• G06T11/00

  Two-dimensional [2D] image generation · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06T2200/28

  involving image processing hardware · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title

• G09G2360/122

  Tiling · CPC title