Light field displays having synergistic data formatting, re-projection, foveation, tile binning and image warping technology

Patent metadata

Field	Value
Publication number	US-11688366-B2
Application number	US-202117461228-A
Country	US
Kind code	B2
Filing date	Aug 30, 2021
Priority date	Dec 29, 2017
Publication date	Jun 27, 2023
Grant date	Jun 27, 2023

Abstract

Systems, methods and apparatuses may provide for technology to reduce rendering overhead associated with light field displays. The technology may conduct data formatting, re-projection, foveation, tile binning and/or image warping operations with respect to a plurality of display planes in a light field display.

First claim

What is claimed is:

1. A computing system comprising:
a graphics processor;
a central processing unit; and
a memory including a set of instructions, which when executed by one or more of the graphics processor or the central processing unit, cause the computing system to:
determine a first plurality of primitives associated with a scene;
reject a first primitive from the first plurality of primitives that is behind a first display plane to generate a second plurality of primitives;
reject a second primitive that is in front of a second display plane to generate the second plurality of primitives;
reject a third primitive of the second plurality of primitives based on a plurality of frustum planes to generate a third plurality of primitives; and
execute fine frustum culling operations to assign the third plurality of primitives to one or more of left tile bins associated with a left eye of a user or right tile bins associated with a right eye of the user.

2. The system of claim 1 , wherein the first display plane is a display plane that is farthest from the user, and the second display plane is a display plane that is closest to the user.

3. The system of claim 1 , wherein the instructions, when executed, cause the computing system to:
execute, on a per eye basis, a coarse frustum culling operation on the second plurality of primitives, wherein the coarse frustum culling operation includes the rejection of the third primitive based on the plurality of frustum planes to generate the third plurality of primitives.

4. The system of claim 1 , wherein the instructions, when executed, cause the computing system to:
determine a left frustum plane for a left viewport associated with the left eye of the user;
determine a right frustum plane for a right viewport associated with the right eye of the user;
determine a top frustum plane of a top viewport; and
determine a bottom frustum plane of a bottom viewport,
wherein the plurality of frustum planes includes the left frustum plane, the right frustum plane, the top frustum plane and the bottom frustum plane.

5. The system of claim 1 , wherein to reject the third primitive of the second plurality of primitives, the instructions, when executed, cause the computing system to:
determine that the third primitive will be rejected based on distances between vertices of the third primitive and each of a top frustum plane of the plurality of frustum planes, a bottom frustum plane of the plurality of frustum planes, a left frustum plane of the plurality of frustum planes and a right frustum plane of the plurality of frustum planes.

6. An apparatus comprising:
one or more substrates; and
logic coupled to the one or more substrates, wherein the logic coupled to the one or more substrates is implemented in one or more of configurable logic or fixed-functionality logic hardware, the logic coupled to the one or more substrates to:
determine a first plurality of primitives associated with a plurality of display planes;
reject a first primitive from the first plurality of primitives that is behind a first display plane to generate a second plurality of primitives;
reject a second primitive that is in front of a second display plane to generate the second plurality of primitives;
reject a third primitive of the second plurality of primitives based on a plurality of frustum planes to generate a third plurality of primitives; and
execute fine frustum culling operations to assign the third plurality of primitives to one or more of left tile bins associated with a left eye of a user or right tile bins associated with a right eye of the user.

7. The apparatus of claim 6 , wherein the first display plane is a display plane that is farthest from the user, and the second display plane is a display plane that is closest to the user.

8. The apparatus of claim 6 , wherein the logic coupled to the one or more substrates is to:
execute, on a per eye basis, a coarse frustum culling operation on the second plurality of primitives, wherein the coarse frustum culling operation includes the rejection of the third primitive based on the plurality of frustum planes to generate the third plurality of primitives.

9. The apparatus of claim 6 , wherein the logic coupled to the one or more substrates is to:
determine a left frustum plane for a left viewport associated with the left eye of the user;
determine a right frustum plane for a right viewport associated with the right eye of the user;
determine a top frustum plane of a top viewport; and
determine a bottom frustum plane of a bottom viewport,
wherein the plurality of frustum planes includes the left frustum plane, the right frustum plane, the top frustum plane and the bottom frustum plane.

10. The apparatus of claim 6 , wherein to reject the third primitive of the second plurality of primitives, the logic coupled to the one or more substrates is to:
determine that the third primitive will be rejected based on distances between vertices of the third primitive and each of a top frustum plane of the plurality of frustum planes, a bottom frustum plane of the plurality of frustum planes, a left frustum plane of the plurality of frustum planes and a right frustum plane of the plurality of frustum planes.

11. At least one non-transitory computer readable storage medium comprising a set of instructions, which when executed by a computing device, cause the computing device to:
determine a first plurality of primitives associated with a scene;
reject a first primitive from the first plurality of primitives that is behind a first display plane to generate a second plurality of primitives;
reject a second primitive that is in front of a second display plane to generate the second plurality of primitives;
reject a third primitive of the second plurality of primitives based on a plurality of frustum planes to generate a third plurality of primitives; and
execute fine frustum culling operations to assign the third plurality of primitives to one or more of left tile bins associated with a left eye of a user or right tile bins associated with a right eye of the user.

12. The at least one non-transitory computer readable storage medium of claim 11 , wherein the first display plane is a display plane that is farthest from the user, and the second display plane is a display plane that is closest to the user.

13. The at least one non-transitory computer readable storage medium of claim 11 , wherein the instructions, when executed, cause the computing device to:
execute, on a per eye basis, a coarse frustum culling operation on the second plurality of primitives, wherein the coarse frustum culling operation includes the rejection of the third primitive based on the plurality of frustum planes to generate the third plurality of primitives.

14. The at least one non-transitory computer readable storage medium of claim 11 , wherein the instructions, when executed, cause the computing device to:
determine a left frustum plane for a left viewport associated with the left eye of the user;
determine a right frustum plane for a right viewport associated with the right eye of the user;
determine a top frustum plane of a top viewport; and
determine a bottom frustum plane of a bottom viewport,
wherein the plurality of frustum planes includes the left frustum plane, the right frustum plane, the top frustum plane and the bottom frustum plane.

15. The at least one non-transitory computer readable storage medium of claim 11 , wherein to reject the third primitive of the second plurality of primitives, the instructions, when executed, cause the

Assignees

• Intel Corp

Inventors

• Schluessler Travis
• Venkatesh Abhishek
• Gierach John
• Bar-On Tomer
• Burke Devan

Classifications

• G09G5/391

  Resolution modifying circuits, e.g. variable screen formats · CPC title

• G06F3/1446

  display composed of modules, e.g. video walls · CPC title

• G09G2300/026

  Video wall, i.e. juxtaposition of a plurality of screens to create a display screen of bigger dimensions · CPC title

• G06T2210/36

  Level of detail · CPC title

• G09G2340/0407

  Resolution change, inclusive of the use of different resolutions for different screen areas · CPC title