Methods and apparatus for full parallax light field display systems

Patent metadata

Field	Value
Publication number	US-10310450-B2
Application number	US-201615243629-A
Country	US
Kind code	B2
Filing date	Aug 22, 2016
Priority date	Apr 23, 2015
Publication date	Jun 4, 2019
Grant date	Jun 4, 2019

Abstract

A 3D video processing system with integrated display is described wherein the huge data bandwidth demands on the source-to-display transmission medium is decreased by utilizing innovative 3D light field video data compression at the source along with innovative reconstruction of 3D light field video content from highly compressed 3D video data at the display. The display incorporates parallel processing pipelines integrated with a Quantum Photonics Imager® for efficient data handling and light imaging.

First claim

What is claimed is:

1. A system for reproducing a light field for display from a compressed light field, the system comprising:
at least one processing node having a plurality of hardware modules configured for decompressing the compressed light field and reproducing the light field for a display;
each processing node having:
an interface module,
an entropy decoder,
an image inverse transform module,
a hogel content repetition module,
a forward depth-image-based rendering (DIBR) module,
a backward DIBR module,
an error correction module,
an interleaver module, and
a pixel modulator module;

each processing node having a bus interconnect for interconnecting the modules and a plurality of memories;
a sequence controller, the sequence controller controlling a sequence of operation of the modules to decompress compressed light field data to reproduce the light field for display.

2. The system of claim 1 wherein at least one of the modules is an application specific integrated circuit.

3. The system of claim 2 wherein at least one of the modules is programmable.

4. The system of claim 1 wherein the interface module is configured to receive data packets and deliver the data packets to the entropy decoder.

5. The system of claim 1 wherein the entropy decoder is configured to receive data packets from the interface module and for each data packet, if a packet header of the data packet indicates that the data packet needs to be decoded, decoding the data packet in accordance with a packet type.

6. The system of claim 1 wherein the image inverse transform module is configured to receive from the entropy decoder for blockwise seed and residual texture decoding and dequantization.

7. The system of claim 6 wherein the image inverse transform module uses a predefined image transform matrix, thereby allowing an inverse transform instruction to serve as a pipelined single instruction, multiple data instruction.

8. The system of claim 1 wherein the hogel content repetition module is configured for copying data between internal buffers having different lengths and different data widths without multiplicative scaling.

9. The system of claim 1 wherein the forward DIBR module is configured to receive seed hogel disparity and produce warped disparity.

10. The system of claim 9 wherein the backward DIBR module is configured to read a generated temporary disparity from the forward DIBR module and calculate a current hogel address reference position in a seed hogel texture and generate hogels.

11. The system of claim 10 wherein the backward DIBR module is configured to also use residual disparity to combine with the seed hogel disparity to fix disparity errors.

12. The system of claim 1 wherein the backward DIBR module is also configured to fill pixel positions not referenced by a warping operation.

13. The system of claim 1 wherein the error correction module is configured to correct artifacts.

14. The system of claim 13 wherein the error correction module is also configured to perform color correction and color space transform on an output of the error correction module.

15. The system of claim 1 wherein the interleaver module is configured to transpose error corrected hogels to separate out individual bits per each hogel.

16. The system of claim 1 wherein the pixel modulator is configured to provide a pixel modulator output compatible with whatever the pixel input requirements are of a light field display being used to display the reproduced light field.

Assignees

• Ostendo Technologies Inc

Inventors

• Falkenberg Andreas
• Graziosi Danillo Bracco
• El-Ghoroury Hussein S

Classifications

• H04N13/15

  for colour aspects of image signals · CPC title

• H04N13/122

  Improving the three-dimensional [3D] impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues (H04N13/128 takes precedence) · CPC title

• H04N19/60

  using transform coding · CPC title

• H04N19/436

  using parallelised computational arrangements · CPC title

• G03H1/268 Primary

  Holographic stereogram · CPC title