Content-adaptive multi-focal display

Patent metadata

Field	Value
Publication number	US-9866826-B2
Application number	US-201514642095-A
Country	US
Kind code	B2
Filing date	Mar 9, 2015
Priority date	Nov 25, 2014
Publication date	Jan 9, 2018
Grant date	Jan 9, 2018

Abstract

A multi-focal display represents a 3-dimensional scene by a series of 2-dimensional images located at different focal planes. The locations of the focal planes are selected based on an analysis of the three-dimensional scene to be rendered by the multi-focal display.

First claim

What is claimed is:

1. A computer-implemented method for selecting locations of focal planes for a multi-focal display in order for the multi-focal display to render actual content from a three-dimensional scene, the method comprising:
analyzing the actual content from the three-dimensional scene to be rendered by the multi-focal display;
selecting the locations of the focal planes based on the analysis of the actual content, wherein selecting the locations of the focal planes comprises selecting the locations based on K-means clustering of the locations of points in the three-dimensional scene;
configuring the multi-focal display according to the selected locations of the focal planes; and
rendering the actual content on the multi-focal display in said configuration.

2. The method of claim 1
wherein the selected locations are non-uniformly spaced over an operating range of the multi-focal display.

3. The method of claim 1 wherein analyzing the actual content and selecting the locations of the focal planes occurs in real-time.

4. The method of claim 1 wherein the multi-focal display renders scenes using not more than six focal planes.

5. The method of claim 1 wherein analyzing the actual content comprises analyzing the actual content from the three-dimensional scene in a spatial domain, and selecting the locations of the focal planes comprises selecting the locations of the focal planes based on the analysis in the spatial domain.

6. The method of claim 1 wherein analyzing the actual content comprises analyzing the actual content from the three-dimensional scene in a spatial frequency domain, and selecting the locations of the focal planes comprises selecting the locations of the focal planes based on the analysis in the spatial frequency domain.

7. The method of claim 1 wherein selecting the locations of the focal planes is further based on rendering requirements of the multi-focal display.

8. The method of claim 1 further comprising selecting a number M of focal planes based on the analysis of the actual content.

9. The method of claim 1 wherein the multi-focal display is a near-eye multi-focal display.

10. A multi-focal display for rendering actual content from a three-dimensional scene by using a plurality of focal planes at different locations, the locations of the focal planes determined based on analysis of the actual content of the three-dimensional scene to be rendered, wherein selecting the locations of the focal planes comprises selecting the locations based on K-means clustering of the locations of points in the three-dimensional scene, the multi-focal display configurable according to the selected locations of the focal planes and rendering the actual content in said configuration.

11. The multi-focal display of claim 10 wherein the selected locations are non-uniformly spaced over an operating range of the multi-focal display.

12. The multi-focal display of claim 10 wherein analyzing the actual content and selecting the locations of the focal planes occurs in real-time.

13. The multi-focal display of claim 10 wherein the multi-focal display renders scenes using not more than six focal planes.

14. The multi-focal display of claim 10 wherein analyzing the actual content comprises analyzing the actual content from the three-dimensional scene in a spatial domain, and selecting the locations of the focal planes comprises selecting the locations of the focal planes based on the analysis in the spatial domain.

15. The multi-focal display of claim 10 wherein analyzing the actual content comprises analyzing the actual content from the three-dimensional scene in a spatial frequency domain, and selecting the locations of the focal planes comprises selecting the locations of the focal planes based on the analysis in the spatial frequency domain.

16. The multi-focal display of claim 10 wherein selecting the locations of the focal planes is further based on rendering requirements of the multi-focal display.

17. The multi-focal display of claim 10 wherein the multi-focal display is a near-eye multi-focal display.

18. A computer program product for use with a computer, the computer program product comprising a non-transitory computer readable medium having a computer program code embodied therein for selecting locations of focal planes for a multi-focal display in order for the multi-focal display to render actual content from a three-dimensional scene, the computer program code performing the steps of:
analyzing the actual content from the three-dimensional scene to be rendered by the multi-focal display;
selecting the locations of the focal planes based on the analysis of the actual content, wherein selecting the locations of the focal planes comprises selecting the locations based on K-means clustering of the locations of points in the three-dimensional scene;
configuring the multi-focal display according to the selected locations of the focal planes; and
rendering the actual content on the multi-focal display in said configuration.

19. The computer program product of claim 18 wherein the selected locations are non-uniformly spaced over an operating range of the multi-focal display.

20. The computer program product of claim 18 wherein analyzing the actual content and selecting the locations of the focal planes occurs in real-time.

Assignees

• Wu Wanmin
• Llull Patrick
• Tosic Ivana
• Berkner Kathrin
• Bedard Noah
• Ricoh Co Ltd

Inventors

• Wu Wanmin
• Llull Patrick
• Tosic Ivana
• Berkner Kathrin
• Bedard Noah

Classifications

• H04N13/322

  using varifocal lenses or mirrors · CPC title

• H04N13/0495 Primary

  Electricity · mapped topic

• H04N13/042

  Electricity · mapped topic

• H04N13/395 Primary

  with depth sampling, i.e. the volume being constructed from a stack or sequence of two-dimensional [2D] image planes · CPC title