Display interface with foveal compression

Patent metadata

Field	Value
Publication number	US-10665209-B2
Application number	US-201815781077-A
Country	US
Kind code	B2
Filing date	May 18, 2018
Priority date	May 18, 2017
Publication date	May 26, 2020
Grant date	May 26, 2020

Abstract

A method of transporting foveal image data is disclosed. A host device receives image data from an image source and renders a full field-of-view (FFOV) image using the image data. The host device further identifies a foveal region of the FFOV image and renders a foveal image corresponding to the foveal region using the image data. More specifically, the foveal image may have a higher resolution than the foveal region of the FFOV image. The host device may then transmit each of the foveal image and the FFOV image, in its entirety, to a display device. For example, the host device may concatenate the foveal image with the FFOV image to produce a frame buffer image, and then transmit the frame buffer image to the display device.

First claim

What is claimed is:

1. A method comprising:
receiving image data from an image source;
rendering a full field-of-view (FFOV) image using the image data;
identifying a foveal region of the FFOV image;
rendering a foveal image corresponding to the foveal region using the image data, wherein the foveal image has a higher resolution than the foveal region of the FFOV image; and
transmitting each of the foveal image and the FFOV image, in its entirety, to a display device.

2. The method of claim 1 , wherein the FFOV image has the same resolution as the foveal image but encompasses a larger display area.

3. The method of claim 1 , wherein the transmitting comprises:
concatenating the foveal image with the FFOV image to produce a frame buffer image; and
transmitting the frame buffer image to the display device.

4. The method of claim 3 , wherein a resolution of the frame buffer image is different than a display resolution of the display device.

5. The method of claim 1 , further comprising:
determining a coordinate of the foveal region with respect to the FFOV image; and
transmitting the coordinate, with the FFOV image and the foveal image, to the display device.

6. The method of claim 5 , wherein transmitting the coordinate comprises:
encoding the coordinate as pixel data in at least one of the FFOV image or the foveal image.

7. The method of claim 6 , wherein the encoding comprises:
encoding the coordinate as pixel data in a non-display region of the FFOV image.

8. The method of claim 6 , wherein the encoding comprises a 2-bits per pixel sparse encoding such that each pattern of bits is represented by a different pixel color.

9. A device, comprising:
an input to receive image data from an image source; and
a rendering engine configured to:
render a full field-of-view (FFOV) image using the image data;
identify a foveal region of the FFOV image;
render a foveal image corresponding to the foveal region using the image data,

wherein the foveal image has a higher resolution than the foveal region of the FFOV image; and
an image transport interface configured to transmit each of the foveal image and the FFOV image, in its entirety, to a display device.

10. The device of claim 9 , wherein the FFOV image has the same resolution as the foveal image but encompasses a larger display area.

11. The device of claim 9 , wherein the image transport interface is to transmit the FFOV image and the foveal image to the display device by:
concatenating the foveal image with the FFOV image to produce a frame buffer image; and
transmitting the frame buffer image to the display device.

12. The device of claim 11 , wherein a resolution of the frame buffer image is different than a display resolution of the display device.

13. The device of claim 9 , wherein the rendering engine is further configured to determine a coordinate of the foveal region with respect to the FFOV image.

14. The device of claim 13 , wherein the image transport interface is further configured to transmit the coordinate to the display device by encoding the coordinate as pixel data in at least one of the FFOV image or the foveal image.

15. The device of claim 14 , wherein the image transport interface is to encode the coordinate as pixel data in a non-display region of the FFOV image.

16. The device of claim 14 , wherein the encoding comprises a 2-bits per pixel sparse encoding such that each pattern of bits is represented by a different pixel color.

17. A system comprising:
a host device to receive image data from an image source, the host device further configured to:
render a full field-of-view (FFOV) image using the image data;
identify a foveal region of the FFOV image;
render a foveal image corresponding to the foveal region using the image data, wherein the foveal image has a higher resolution than the foveal region of the FFOV image; and
transmit each of the foveal image and the FFOV image, in its entirety, over a communication medium; and

a display device to receive the FFOV image and the foveal image via the communication medium, the display device further configured to:
merge the FFOV image and the foveal image into a combined image; and
display the combined image on a display surface.

18. The system of claim 17 , wherein the display device is to merge the FFOV image and the foveal image by:
upscaling the FFOV image to a higher resolution; and
overlaying the foveal image in the foveal region of the FFOV image.

19. The system of claim 17 , wherein the host device is to transmit the FFOV image and the foveal image by:
concatenating the foveal image with the FFOV image to produce a frame buffer image; and
transmitting the frame buffer image to the display device.

20. The system of claim 19 , wherein the display device is configured to identify each of the FFOV image and the foveal image, within the frame buffer image, based at least in part on a resolution of the frame buffer image.

Assignees

• Synaptics Inc

Inventors

• Morein Stephen L

Classifications

• G09G5/006

  Details of the interface to the display terminal (specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04) · CPC title

• G09G2360/18

  Use of a frame buffer in a display terminal, inclusive of the display panel · CPC title

• G09G5/377

  for mixing or overlaying two or more graphic patterns (G09G5/02, G09G5/397 take precedence) · CPC title

• G02B2027/0187

  slaved to motion of at least a part of the body of the user, e.g. head, eye · CPC title

• G09G2340/0407

  Resolution change, inclusive of the use of different resolutions for different screen areas · CPC title