High-performance light field display simulator

Patent metadata

Field	Value
Publication number	US-10924727-B2
Application number	US-201816156421-A
Country	US
Kind code	B2
Filing date	Oct 10, 2018
Priority date	Oct 10, 2018
Publication date	Feb 16, 2021
Grant date	Feb 16, 2021

Abstract

A simulator for light field displays. A high-performance simulator that can operate in real-time, allowing for VR-based evaluation of display designs. These capabilities allow for rapid exploration of display parameters (e.g. angular and hogel resolution, field of view, etc.), the visualization of how the angular spread of the rays that can affect quality and the evaluation of artifacts from light field processing. Additionally, the high-throughput nature of the simulation makes it amenable for use in the evaluation of light processing procedures such as those involved in light field rendering and compression contexts. The speed and ease with which one can explore light field display parameters makes this simulator the ideal tool for light field content design and evaluation.

First claim

The embodiments of the invention in which an exclusive property or privilege is claimed are defined as follows:

1. A computer-implemented method for simulating a three dimensional light field display, the method comprising:
receiving, by a computer processor, a plurality of data inputs comprising:
light field display data for a virtual light field display comprising a set of hogels, each hogel comprising a plurality of hogel pixels; and
simulated observer parameters comprising an observer position relative to the virtual light field display;

applying a ray intersection procedure to the set of hogels in the virtual light field display to provide an array of individual canonical rays traced between the observer position and a hogel intersection point, wherein each hogel in the set of hogels provides an individual canonical ray based on the observer position, and each of the individual canonical rays has a first end point at a hogel in the set of hogels in the virtual light field display and a second end point at the observer position;
calculating a canonical ray direction for each of the individual canonical rays using the observer position and the hogel intersection point;
reconstructing a canonical image of a simulated observer view at the observer position by applying a reconstruction calculation for each hogel in the virtual light field display based on the canonical ray direction for each hogel to the observer position;
texture mapping the canonical image as a texture for a plane which represents the simulated light field display; and
rendering the plane from the observer position with the canonical image as the texture to produce the simulated observer view.

2. The computer-implemented method of claim 1 , wherein the observer position is based on a pinhole camera model.

3. The computer-implemented method of claim 1 , wherein the observer position is based on a multi-camera model.

4. The computer-implemented method of claim 1 , wherein the canonical image is generated using a point-spread function.

5. The computer-implemented method of claim 4 , wherein the point-spread function uses a Gaussian function.

6. The computer-implemented method of claim 1 , wherein the canonical image is generated by applying a nearest neighbour reconstruction function.

7. The computer-implemented method of claim 1 , further comprising repeating the method for a light field display.

8. A computing system comprising at least one processor configured to carry out a method for simulating a three dimensional light field display, comprising the steps of:
receiving, by a computer processor, a plurality of data inputs comprising:
light field display data for a virtual light field display comprising a set of hogels, each hogel comprising a plurality of hogel pixels; and
simulated observer parameters comprising an observer position relative to the virtual light field display;

applying a ray intersection procedure to the set of hogels in the virtual light field display to provide an array of individual canonical rays traced between the observer position and a hogel intersection point, wherein each hogel in the set of hogels provides an individual canonical ray based on the observer position, and each of the individual canonical rays has a first end point at a hogel in the set of hogels in the virtual light field display and a second end point at the observer position;
calculating a canonical ray direction for each of the individual canonical rays using the observer position and the hogel intersection point;
reconstructing a canonical image of a simulated observer view at the observer position by applying a reconstruction calculation for each hogel in the virtual light field display based on the canonical ray direction for each hogel to the observer position;
texture mapping the canonical image as a texture for a plane which represents the simulated light field display; and
rendering the plane from the observer position with the canonical image as the texture to produce the simulated observer view.

9. The computer system according to claim 8 , wherein the observer position is based on a pinhole camera model.

10. The computer system according to claim 8 , wherein the observer position is based on a multi-camera model.

11. The computer system according to claim 8 , wherein the canonical image is generated using a point-spread function.

12. The computer system according to claim 11 , wherein the point-spread function uses a Gaussian function.

13. The computer system according to claim 8 , wherein the canonical image is generated by applying a nearest neighbour reconstruction function.

14. The computer system according to claim 8 , further comprising repeating the method for simulating a light field display.

15. The computer-implemented method of claim 1 , wherein each canonical ray is traced to the center of each individual hogel.

16. The computer-implemented method of claim 1 , wherein the method generates a plurality of canonical images.

17. The computer-implemented method of claim 16 , wherein the plurality of canonical images is based on the simulated observer parameters.

18. The computer-implemented method of claim 1 , wherein the plurality of data inputs define the spatial and angular features of the light field display.

19. The computer-implemented method of claim 1 , wherein the plurality of data inputs comprise one or more of spatial resolution, directional resolution, focal length, field of view, and lens pitch.

20. The computer-implemented method of claim 1 , wherein the rendering displays the canonical image in command line mode, in virtual reality, on a 2D interactive interface, offline for artifact metric evaluation, or any combination thereof.

21. The computer system according to claim 8 , wherein each canonical ray is traced to the center of each individual hogel.

22. The computer system according to claim 8 , wherein the method generates a plurality of canonical images.

23. The computer system according to claim 22 , wherein the plurality of canonical images is based on the simulated observer parameters.

24. The computer system according to claim 8 , wherein the plurality of data inputs define the spatial and angular features of the light field display.

25. The computer system according to claim 8 , wherein the plurality of data inputs comprise one or more of spatial resolution, directional resolution, focal length, field of view, and lens pitch.

26. The computer system according to claim 8 , wherein the rendering displays the canonical image in command line mode, in virtual reality, on a 2D interactive interface, offline for artifact metric evaluation, or any combination thereof.

27. The method according to claim 1 , further comprising changing the observer position to test the effective viewing range of the simulated light field display.

28. The method according to claim 1 , wherein generating the canonical image further comprises reconstructing a radiance value for each canonical ray at the hogel intersection point.

29. The computer system according to claim 8 , further comprising changing the observer position to test the effective viewing range of the simulated light field display.

30. The computer system according to claim 8 , wherein generating the canonical image further comprises reconstructing a radiance value

Assignees

• Avalon Holographics Inc

Inventors

• Hamilton Matthew
• Troke Matthew
• Rumbolt Chuck
• Lockyer Robert
• Benoit Donovan
• Butyn Thomas

Classifications

• H04N13/327 Primary

  Calibration thereof · CPC title

• H04N13/344

  with head-mounted left-right displays · CPC title

• H04N13/368

  for two or more viewers · CPC title

• H04N13/117 Primary

  the virtual viewpoint locations being selected by the viewers or determined by viewer tracking · CPC title