Superresolution display using cascaded panels

Patent metadata

Field	Value
Publication number	US-9892669-B2
Application number	US-201514660030-A
Country	US
Kind code	B2
Filing date	Mar 17, 2015
Priority date	Mar 18, 2014
Publication date	Feb 13, 2018
Grant date	Feb 13, 2018

Abstract

System and method of displaying images in spatial/temporal superresolution by multiplicative superposition of cascaded display layers integrated in a display device. Using an original image with a target spatial/temporal resolution as a priori, a factorization process is performed to derive respective image data for presentation on each display layer. The cascaded display layers may be progressive and laterally shifted with each other, resulting in an effective spatial resolution exceeding the native display resolutions of the display layers. Factorized images may be refreshed on respective display layers in synchronization or out of synchronization.

First claim

What is claimed is:

1. A method of displaying images, said method comprising:
accessing original image data representing are image;
factorizing said original image data into first image data and second image data, wherein said original image data is substantially proportional to a multiplication product of said first image data and said second image data; and
displaying a representation of said image on a display device at an effective display resolution, wherein said display device comprises a first display layer having a first native resolution and a second display layer having a second native resolution,
wherein said first display layer overlays said second display layer,
wherein said factorizing said original image data is based on a geometric relationship between said first display layer and said second display layer, and
wherein said displaying comprises:
rendering said first image data for display on said first display layer; and
rendering said second image data for display on said second display layer, and

wherein further said effective display resolution is greater than said first native resolution and said second native resolution.

2. The method of claim 1 , wherein said display device comprises L display layers that comprise said first display layer and said second display layer, wherein L is an integer value greater than 1, and wherein further a respective display layer of said L display layers is laterally offset relative to an immediately adjacent display layer by 1/L pixel in two directions.

3. The method of claim 2 , wherein said displaying comprises modulating a pixel in said respective display layer using multiple pixels of an underlying display layer in said L display layers.

4. The method of claim 2 , wherein said first image data corresponds to a single frame of said image, and wherein said second image data corresponds to a single frame of said image.

5. The method of claim 1 , wherein said original image data represent a single frame of pixels of said image, wherein said first image data represents a first plurality of frames of pixels of said image, wherein said second image data represent a second plurality of frames of pixels of said image, wherein said rendering said first image data comprises consecutively rendering said first plurality of frames, and wherein further said rendering said second image data comprises consecutively rendering said second plurality of frames.

6. The method of claim 5 , wherein said first plurality of frames are rendered on said first display layer in synchronization with said second plurality of frames being rendered on said second display layer.

7. The method of claim 5 , wherein a frame refresh time during rendering said first plurality of frames is offset from a frame refresh time during rendering said second plurality of frames by a fraction of a frame refresh cycle of said first display layer.

8. The method of claim 1 , wherein said factorizing comprises deriving said first image data and said second image data in accordance with an iteration process.

9. The method of claim 1 , wherein said factorizing further comprises accessing a weight matrix that is generated based on at least one of: relative lateral position between said first display layer and said second display layer; vertical position between said first display layer and said second display layer; in-plane rotations between said first display layer and said second display layer; and brightness attenuation, and wherein said multiplication product corresponds to a matrix representing said first image data multiplied by a transposed matrix representing said second image data.

10. A method of displaying images comprising:
accessing first frames representing one frame of an image in a first spatial resolution;
accessing second frames representing said one frame of said image in a second spatial resolution;
sequentially rendering said first frames for display on a first display layer of a display device;
sequentially rendering said second frames for display on a second display layer of said display device,
wherein said first display layer overlays said second display layer with a lateral shift in two directions by a fraction of a pixel of said first display layer, wherein data of said first frames and data of said second frames are derived by factorizing original image data based on a geometric relationship between said first display layer and said second display layer, wherein said original image data is substantially proportional to a multiplication product of said data of said first frame and, said data of said second frames, and
wherein further said sequentially renderings result in an effective display resolution of said one frame of said image on said display device, wherein said effective display resolution is greater than said first spatial resolution and said second spatial resolution.

11. The method of claim 10 further comprising:
accessing said original image data representing said one frame of image in an original spatial resolution, wherein said original spatial resolution is greater than said first spatial resolution and said second spatial resolution, wherein said factorizing said original image data is performed in accordance with an iteration method, and wherein said first frames comprise four frames and said second frames comprise four frames.

12. The method of claim 10 , wherein said first frames and said second frames each comprise a same number of frames, and wherein further said first frames and said second frames are rendered on said first display layer and said second display layer in synchronization with respect to frame refresh time.

13. The method of claim 10 , wherein a frame refresh time for rendering said first frames is temporally offset from a frame refresh time for rendering said second frames by a half frame refresh period.

14. The method of claim 10 , wherein said display device comprises L display layers, wherein L is an integer greater than 1, and wherein said fraction of a pixel equals 1/L pixel.

15. A display system comprising:
a plurality of display layers disposed in a cascaded manner and comprising a first display layer and a second display layer, wherein said first display layer offsets by a fraction of a pixel with reference to said second display layer in two orthogonal lateral directions:
a processor coupled to said plurality of display layers;
memory coupled to said processor and comprising instructions that, when executed by said processor, implement a method of displaying a representation of an image, said method comprising:
accessing first image data representing said image and second image data representing said image, wherein said first image data and said second image data are derived by factorizing original image data based on a geometric relationship between said first display layer and said second display layer, wherein said original image data is substantially proportional to a multiplication product of said first image data and said second image data;
rendering said first image data for display on said first display layer at a first spatial resolution; and
rendering said second image data for display on said second display layer at a second spatial resolution,
wherein further an effective display resolution of said representation of said image is greater than said first native spatial resolution and said second native spatial resolution.

16. The display system of claim 15 , wherein said first image data represents a first plurality of frames of said image, wherein said second image data represents a secon

Assignees

• Nvidia Corp

Inventors

• Heide Felix
• Lanman Douglas
• Reddy Dikpal
• Kautz Jan
• Pulli Kari
• Luebke David

Classifications

• G09G2340/0407

  Resolution change, inclusive of the use of different resolutions for different screen areas · CPC title

• G09G3/007 Primary

  Use of pixel shift techniques, e.g. by mechanical shift of the physical pixels or by optical shift of the perceived pixels · CPC title

• G09G3/20 Primary

  for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix {no fixed position being assigned to or needed to be assigned to the individual characters or partial characters} · CPC title

• G09G3/2025

  the sub-frames having all the same time duration · CPC title

• G09G2340/0435

  Change or adaptation of the frame rate of the video stream · CPC title