Display system

Patent metadata

Field	Value
Publication number	US-11024267-B2
Application number	US-202016871793-A
Country	US
Kind code	B2
Filing date	May 11, 2020
Priority date	Dec 28, 2017
Publication date	Jun 1, 2021
Grant date	Jun 1, 2021

Abstract

A gaze tracking display system includes a processor and display circuitry. The processor is configured to perform foveated rendering of image data, and to output foveated image data. The display circuitry is coupled to the processor. The display circuitry includes a display device and a display controller. The display device is configured to produce a viewable image. The display controller is configured to drive the display device. The display controller includes reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data received from the processor.

First claim

What is claimed is:

1. A system, comprising:
a processor configured to perform foveated rendering of image data, to produce foveated image data; and
display circuitry coupled to the processor, the display circuitry comprising:
a display device; and
a display controller configured to drive the display device, the display controller comprising reconstruction circuitry and a frame buffer coupled to the reconstruction circuitry;

the reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data; and
the frame buffer configured to:
store the foveated image data;
provide the stored foveated image data to the reconstruction circuitry; and
store no more than one-quarter of pixel data of the image data at the resolution of the display device.

2. A system, comprising:
a processor configured to perform foveated rendering of image data, to produce foveated image data; and
display circuitry coupled to the processor, the display circuitry comprising:
a display device; and
a display controller configured to drive the display device, the display controller comprising reconstruction circuitry and a frame buffer coupled to the reconstruction circuitry;

the reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data; and
the frame buffer configured to:
store the foveated image data;
provide the stored foveated image data to the reconstruction circuitry; and
store no more than one-sixth of pixel data of the image at the resolution of the display device.

3. A system, comprising:
a processor configured to perform foveated rendering of image data, to produce foveated image data; and
display circuitry coupled to the processor, the display circuitry comprising:
a display device; and
a display controller configured to drive the display device, the display controller comprising reconstruction circuitry and a frame buffer coupled to the reconstruction circuitry;

the reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data;
the frame buffer configured to:
store the foveated image data;
provide the stored foveated image data to the reconstruction circuitry; and

the display controller configured to convert the stored foveated image data from luminance and chrominance data to red-green-blue encoded data before transferring the foveated image data to the reconstruction circuitry.

4. A system, comprising:
a processor configured to perform foveated rendering of image data, to produce foveated image data; and
display circuitry coupled to the processor, the display circuitry comprising:
a display device; and
a display controller configured to drive the display device, the display controller comprising reconstruction circuitry and a frame buffer coupled to the reconstruction circuitry;

the reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data;
the frame buffer configured to:
store the foveated image data; and
provide the stored foveated image data to the reconstruction circuitry;

the processor configured to:
produce a foveation header for the foveated image data, the foveation header comprising spatial replication information for blocks of the foveated image data; and
provide the foveation header to the display controller with the foveated image data; and

the display controller configured to apply the spatial replication information to reconstruct the image at the resolution of the display device from the foveated image data.

5. The system of claim 4 , wherein the foveation header comprises temporal replication information for the blocks of the foveated image data, and the display controller is configured to apply the temporal replication information to control writing of the foveated image data to the frame buffer.

6. The system of claim 1 , wherein the display device is configured to display red-green-blue encoded image data, and the processor is configured to provide the foveated image data encoded as luminance and chrominance values.

7. The system of claim 1 , wherein the display controller is configured to provide the image at the resolution of the display device to the display device at a rate of up to 1440 frames per second.

8. A system, comprising:
a processor configured to perform foveated rendering of image data, to produce foveated image data; and
display circuitry coupled to the processor, the display circuitry comprising:
a display device; and
a display controller configured to drive the display device, the display controller comprising reconstruction circuitry and a frame buffer coupled to the reconstruction circuitry;

the reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data;
the frame buffer configured to:
store the foveated image data; and
provide the stored foveated image data to the reconstruction circuitry; and

the reconstruction circuitry configured to:
receive the foveated image data from the processor;
perform pixel replication on the foveated image data to produce the image at the resolution of the display device; and
store the image at the resolution of the display device in the frame buffer.

9. A method comprising:
performing, by a processor, foveated rendering of image data to produce foveated image data;
transferring the foveated image data from the processor to a display controller that drives a display device;
providing, by the display controller, an output image at a resolution of the display device based on the foveated image data;
displaying, by the display device, the output image;
storing the foveated image data in a frame buffer;
providing the foveated image data from the frame buffer to the display controller; and
converting the stored foveated image data from luminance and chrominance values to red-green-blue encoded data before providing the output image.

10. A method comprising:
performing, by a processor, foveated rendering of image data to produce foveated image data;
transferring the foveated image data from the processor to a display controller that drives a display device;
producing, by the display controller, an output image at a resolution of the display device based on the foveated image data from the processor;
displaying, by the display device, the output image;
storing the foveated image data in a frame buffer;
providing the foveated image data from the frame buffer to the display controller;
producing, by the processor, a foveation header for the foveated image data, the foveation header comprising spatial replication information for pixels of the foveated image data;
providing, by the processor, the foveation header to the display controller with the foveated image data; and
applying, by the display controller, the spatial replication information to reconstruct the output image at the resolution of the display device based on the foveated image data.

11. The method of claim 10 , wherein the foveation header comprises temporal replication information for the pixels of the foveated image data, and the method further comprises:
applying, by the display controller, the temporal replication information to control writing of the foveated image data to the frame buffer.

12. The method of claim 9 , wherein the displaying comprises driving the display device with red-green-blue encoded image data, and wherein the foveated image data is encoded as luminance and chrominance values.

13. The method

Assignees

• Texas Instruments Inc

Inventors

• Kempf Jeff
• Morgan Dan

Classifications

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G09G2350/00

  Solving problems of bandwidth in display systems · CPC title

• G09G2320/0242

  Compensation of deficiencies in the appearance of colours · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title

• G09G3/2051

  with use of a spatial dither pattern · CPC title