Method and system for rendering an image with a pupil enhanced accommodation of the eye

Patent metadata

Field	Value
Publication number	US-2020393679-A1
Application number	US-202016833814-A
Country	US
Kind code	A1
Filing date	Mar 30, 2020
Priority date	Mar 29, 2019
Publication date	Dec 17, 2020
Grant date	—

Abstract

The present disclosure relates to a method for displaying an image with a specific depth of field. The method comprises the steps of obtaining information data related to a focal distance adapted to a user gazing at a display, determining a pupil size of said user, estimating a depth of field of said user's eyes based on said focal distance and said pupil size, and rendering an image based on said depth of field to be displayed on said display. Further, the present disclosure relates to a system, a head-mounted display and a non-transitory computer readable medium.

First claim

1 . A method for displaying an image with a specific depth of field, the method comprising the steps of:
obtaining information data related to a focal distance adapted to a user gazing at a display, determining a pupil size of said user, estimating a depth of field of said user's eyes based on said focal distance and said pupil size, and rendering an image based on said depth of field to be displayed on said display.

2 . The method according to claim 1 , wherein the step of determining said pupil size is performed by first determining a luminosity of said display and then by estimating said pupil size based on said luminosity.

3 . The method according to claim 1 , wherein the step of determining a pupil size of the user is performed by obtaining and selecting measurements of said pupil size of said user by using image data from an imaging device.

4 . The method according to claim 1 , wherein the information data related to said focal distance comprises measurements of the distance at which gaze vectors from the left and right eyes of said user converge.

5 . The method according to claim 1 , wherein the information data related to said focal distance is based on a gaze point of said user directed to an object rendered on said display.

6 . The method according to claim 1 , wherein the method further comprises the step of estimating an accommodation amplitude of the eyes of said user and wherein the step of estimating a depth of field is further based on said accommodation amplitude.

7 . The method according to claim 1 , wherein the step of estimating said depth of field includes applying a user calibrated eye model such as PCCR, Pupil Centre Cornea Reflection-model.

8 . A system for displaying an image with a specific depth of field, the system comprising:
a display, and at least one processor configured to:
obtain information data related to a focal distance adapted to a user gazing at the display,
determine a pupil size of said user,
estimate a depth of field of said user's eyes based on said focal distance and said pupil size, and
render an image based on said depth of field to be displayed on said display,
wherein the display is configured to display said rendered image to said user.

9 . The system according to claim 8 , further comprising an eye tracking device configured to determine the information data related to a focal distance and send the information to the processor.

10 . The system according to claim 8 , wherein the processor is further configured to first determine a luminosity of said display and then estimate said pupil size based on said luminosity.

11 . The system according to claim 8 , wherein the processor is further configured to obtain and select measurements of said pupil size of said user by using image data from an imaging device.

12 . The system according to claim 8 , wherein the information data related to said focal distance comprises measurements of the distance at which gaze vectors from the left and right eyes of said user converge.

13 . The system according to claim 8 , wherein the information data related to said focal distance is based on a gaze point of said user directed to an object rendered on said display.

14 . The system according to claim 8 , wherein the processor is further configured to estimate an accommodation amplitude of the eyes of said user and wherein the estimate of the depth of field is further based on said accommodation amplitude.

15 . The system according to claim 8 , wherein the estimate of the depth of field includes to apply a user calibrated eye model such as PCCR, Pupil Centre Cornea Reflection-model.

16 . A head-mounted display, said head-mounted display comprising:
a frame adapted to be worn by a user, a display, and at least one processor configured to:
obtain information data related to a focal distance adapted to a user gazing at the display,
determine a pupil size of said user,
estimate a depth of field of said user's eyes based on said focal distance and said pupil size, and
render an image based on said depth of field to be displayed on said display,
wherein the display is configured to display said rendered image to said user.

17 . The head-mounted display according to claim 16 , further comprising an eye tracking device configured to determine the information data related to a focal distance and send the information to the processor.

18 . The head-mounted display according to claim 16 , wherein the head-mounted display is adapted for virtual reality, augmented reality, mixed reality or other extended reality experiences.

19 . (canceled)

Assignees

• Tobii Ab

Inventors

• Rönngren Denny

Classifications

• G02B2027/0127

  comprising devices increasing the depth of field · CPC title

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• H04N13/383

  for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes · CPC title

• H04N13/344 Primary

  with head-mounted left-right displays · CPC title