Compensating for high head movement in head-mounted displays

Patent metadata

Field	Value
Publication number	US-11237626-B2
Application number	US-201916662403-A
Country	US
Kind code	B2
Filing date	Oct 24, 2019
Priority date	Apr 24, 2017
Publication date	Feb 1, 2022
Grant date	Feb 1, 2022

Abstract

When the speed of head movement exceeds the processing capability of the system, a reduced depiction is displayed. As one example, the resolution may be reduced using coarse pixel shading in order to create a new depiction at the speed of head movement. In accordance with another embodiment, only the region the user is looking at is processed in full resolution and the remainder of the depiction is processed at lower resolution. In still another embodiment, the background depictions may be blurred or grayed out to reduce processing time.

First claim

What is claimed is:

1. A graphics processing unit, comprising:
an interface to couple the graphics processing unit to a processor,
a plurality of texture units,
a shared memory coupled to the plurality of texture units,
a plurality of register files coupled to the shared memory,
a plurality of load/store units coupled to the shared memory, and
a plurality of graphics processing cores coupled to the plurality of register files, and
a non-transitory storage memory comprising instructions that when executed cause at least some of the plurality of graphics processing cores to:
receive information to identify a first portion of a frame based on eye gaze detection,
apply a first non-normalized shading rate within the first portion of the frame, and
apply a second non-normalized shading rate within at least a second portion of the frame,
wherein the first portion of the frame is a foveated region, and
wherein the first non-normalized shading rate is twice the second non-normalized shading rate.

2. The graphics processing unit of claim 1 , further comprising scheduler logic to schedule groups of instructions.

3. The graphics processing unit of claim 2 , further comprising a plurality of arithmetic logic units coupled to the plurality of register files, wherein the plurality of arithmetic logic units are to perform operations on integer data types.

4. The graphics processing unit of claim 3 , further comprising at least one memory unit.

5. The graphics processing unit of claim 4 , wherein the memory unit comprises a load and store unit.

6. The graphics processing unit of claim 1 , further comprising at least one special function unit.

7. The graphics processing unit of claim 1 , wherein the graphics processing unit comprises a single instruction multiple thread processor.

8. The graphics processing unit of claim 1 , further comprising an interface to communicate with a headset.

9. The graphics processing unit of claim 8 , wherein the interface is to receive motion tracking information from the headset.

10. A graphics processing unit, comprising:
an interface to couple the graphics processing unit to a processor,
a plurality of texture units,
a shared memory coupled to the plurality of texture units,
a plurality of register files coupled to the shared memory,
a plurality of load/store units coupled to the shared memory, and
a plurality of graphics processing cores coupled to the plurality of register files, and
a non-transitory storage memory comprising instructions that when executed cause at least some of the plurality of graphics processing cores to:
receive information to identify a portion of a frame as a foveated region, based on eye gaze detection,
shade the foveated region at a first shading rate, and
shade at least a portion of a region other than the foveated region at a second shading rate,
wherein the first shading rate is different from the second shading rate,
wherein the first shading rate is higher than the second shading rate, and
wherein the second shading rate is half of the first shading rate and the first shading rate and the second shading rate are non-normalized rates.

11. The graphics processing unit of claim 10 , further comprising a plurality of arithmetic logic units coupled to the plurality of register files, wherein the plurality of arithmetic logic units are to perform operations on integer data types.

12. The graphics processing unit of claim 11 , further comprising at least one memory unit.

13. The graphics processing unit of claim 12 , wherein the memory unit comprises a load and store unit.

14. The graphics processing unit of claim 10 , further comprising at least one special function unit.

15. The graphics processing unit of claim 10 , wherein the graphics processing unit comprises a single instruction multiple thread processor.

16. The graphics processing unit of claim 10 , further comprising an interface to communicate with a headset.

17. The graphics processing unit of claim 16 , wherein the interface is to receive motion tracking information from the headset.

18. A non-transitory storage medium comprising instructions that when executed cause at least one of a plurality of graphics processing cores of a graphics processor comprising a plurality of texture units, a shared memory coupled to the plurality of texture units, a plurality of register files coupled to the shared memory, a plurality of load/store units coupled to the shared memory, and the plurality of graphics processing cores coupled to the plurality of register files, to:
receive information to identify a first portion of a frame based on eye gaze detection;
apply a first non-normalized shading rate within the first portion of the frame, and
apply a second non-normalized shading rate within at least a second portion of the frame,
wherein the first portion of the frame is a foveated region, and
wherein the first non-normalized shading rate is at least twice the second non-normalized shading rate.

19. The non-transitory storage medium of claim 18 , further comprising instructions that when executed cause the at least one of the plurality of graphics processing cores to communicate with a headset.

20. The non-transitory storage medium of claim 19 , further comprising instructions that when executed cause the at least one of the plurality of graphics processing cores to receive motion tracking information from the headset.

Assignees

• Intel Corp

Inventors

• Babu Ravindra A
• Ms SASHANK
• Musunuri Satyanantha R
• Pawar Sagar C
• Kaipa Kalyan K
• Balakrishnan Vijayakumar
• Kp Sameer

Classifications

• G02B2027/0147

  comprising a device modifying the resolution of the displayed image · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06T1/20

  Processor architectures; Processor configuration, e.g. pipelining · CPC title

• G02B27/017

  Head mounted · CPC title