Accommodation-invariant computational near-eye displays

Patent metadata

Field	Value
Publication number	US-10192292-B2
Application number	US-201615382432-A
Country	US
Kind code	B2
Filing date	Dec 16, 2016
Priority date	Feb 16, 2016
Publication date	Jan 29, 2019
Grant date	Jan 29, 2019

Abstract

Near-eye display systems in accordance with embodiments of the invention enable accommodation-invariant display control. One embodiment includes a near-eye display; a processor; a memory containing a target image and an accommodation-invariant display application; where the processor is configured by the accommodation-invariant display application to calculate an impulse response of the near-eye display; calculate a compensation image by generating a deconvolved color channel of the target image using a ratio of the target image and the impulse response, where the compensation image is a representation of the target image that remains in focus at a plurality of distances from the near-eye display; and display the compensation image on the near-eye display.

First claim

What is claimed is:

1. A display system comprising:
a near-eye display;
a processor;
a memory containing a target image and an accommodation-invariant display application;
where the processor is configured by the accommodation-invariant display application to:
calculate an impulse response of the near-eye display;
calculate a compensation image by generating a deconvolved color channel of the target image using a ratio of the target image and the impulse response and inverse filtering, wherein:
the compensation image is a representation of the target image that remains in focus at a plurality of distances from the near-eye display; and
the inverse filtering is evaluated by the processor by using the following expression:

i
c

⁡

(

x
,
y

)

=

ℱ

-
1

⁢

{

ℱ
⁢

{

i
⁡

(

x
,
y

)

}

ℱ
⁢

{

ρ
~

⁡

(

x
,
y

)

}

}

where i c is the compensation image, i is the target image, {tilde over (ρ)}(x, y) is the integrated point spread function, and ℑ{⋅} is the discrete Fourier transform; and
display the compensation image on the near-eye display.

2. The display system of claim 1 , wherein the impulse response is an integrated point spread function.

3. The display system of claim 2 , wherein the integrated point spread function is evaluated by the processor by using the following expression:
{tilde over (ρ)}( r )=∫ o T ρ( r,f ( t )) dt

where {tilde over (ρ)}(r) is the integrated point spread function, ρ(r,f(t)) is a Gaussian point spread function, T is a finite exposure time, and f(t) maps time to temporally-varying focal lengths.

4. The display system of claim 3 , wherein the integrated point spread function further comprises a variance which is evaluated by the processor using the following expression:

σ
~

2

=

c
2

4

⁢

∫
0
T

⁢

b
⁡

(

f
⁡

(
t
)

)

2

⁢
d
⁢

⁢
t

where {tilde over (σ)}is the variance, T is a finite exposure time, f(t) maps time to temporally-varying focal lengths, c is a constant, and b is a constant.

5. The display system of claim 1 , wherein generating the deconvolved color channel of the target image further comprises generating each color channel of the target image individually.

6. The display system of claim 1 , wherein the near-eye display is a head mounted display.

7. The display system of claim 1 , wherein the near-eye display is a virtual reality display.

8. The display system of claim 1 , wherein the near-eye display is an augmented reality display.

9. A method for displaying an image comprising:
calculating an impulse response of a near-eye display using a processor configured by an accommodation-invariant display application stored in a memory;
calculating a compensation image by generating a deconvolved color channel of a target image based on a ratio of the target image and the impulse response using inverse filtering using the processor, wherein:
the compensation image is a representation of the target image that remains in focus at a plurality of distances from the near-eye display; and
the inverse filtering is evaluated by the processor by using the following expression:

i
c

⁡

(

x
,
y

)

=

ℱ

-
1

⁢

{

ℱ
⁢

{

i
⁡

(

x
,
y

)

}

ℱ
⁢

{

Assignees

• Univ Leland Stanford Junior

Inventors

• Wetzstein Gordon
• Konrad Robert

Classifications

• G06T2207/20201

  Motion blur correction · CPC title

• G02B27/0075

  with means for altering, e.g. increasing, the depth of field or depth of focus · CPC title

• G06T2207/20056

  Discrete and fast Fourier transform, [DFT, FFT] · CPC title

• G06T5/10

  using non-spatial domain filtering · CPC title

• G02B27/017

  Head mounted · CPC title