Methods of vestibulo-ocular reflex correction in display systems

Patent metadata

Field	Value
Publication number	US-10018847-B2
Application number	US-201514925012-A
Country	US
Kind code	B2
Filing date	Oct 28, 2015
Priority date	Oct 28, 2015
Publication date	Jul 10, 2018
Grant date	Jul 10, 2018

Abstract

A method for displaying images on a head-mounted display (HMD) device that compensates for a user's vestibulo-ocular reflex (VOR) response. The displayed HMD image is compensated for predicted eye position such that the displayed image stays centered on the fovea of the eye, during transient eye movement caused by head motion, resulting in better display readability, discernment and cognitive processing.

First claim

What is claimed is:

1. A method for displaying images on a head-mounted display (HMD) device that is worn by an operator and that compensates for the operator's vestibulo-ocular reflex (VOR) response, the method comprising the steps of:
generating a first image and displaying the first image on the HMD display device, wherein the first image is conformal to an environment external to the operator and is based on a first head direction in x, y, z coordinates of the operator's head;
sensing a rotational rate of the operator's head in x, y, z coordinates as the operator's head rotates to a second head direction in x, y, z coordinates that is different than the first head direction;
based on the sensed rotational rate of the operator's head, estimating an angular motion of an eye of the operator, wherein the step of estimating comprises, using an eye angular VOR motion prediction mathematical model, generating a predicted eye angular position due to VOR effects, wherein the eye angular VOR motion prediction mathematical model uses as its inputs (1) the first head direction in x, y, z coordinates of the operator's head, (2) the sensed rotational rate of the operator's head, and (3) a tunable, numerical parameter that compensates for the VOR response that is specific to the operator, wherein the eye angular VOR motion prediction mathematical model operates on inputs (1)-(3) by applying a pseudo-inverse transfer function having a tunable time delay, a tunable forward gain, and a feedback controller, and wherein the eye angular VOR motion prediction mathematical model produces as its output the predicted eye angular position in x, y, z coordinates due to VOR effects;
and
generating a second, subsequent image, as part of a continuous stream of images, based on the predicted eye angular position, wherein the second, subsequent image is conformal to an environment external to the operator corresponding to the predicted eye angular position, and displaying the second, subsequent image on the HMD display device.

2. The method of claim 1 , further comprising:
based on the predicted eye angular position due to VOR effects, calculating an eye position deviation from the second head direction in x, y, z coordinates; and
after generating the second, subsequent image, using an eye angular position tracking mathematical model, reducing the eye position deviation from the second head direction in x, y, z coordinates over time, and thereafter, generating a third, subsequent image, as part of the continuous stream of images, wherein the third, subsequent image is conformal to an environment external to the operator corresponding to the second head direction in x, y, z coordinates with no correction for eye position deviation.

Assignees

• Honeywell Int Inc

Inventors

• Li Xiaohong Linda
• Leiphon Ken
• Fye James C
• Ball Jerry
• Hancock William Ray

Classifications

• H04N23/81 Primary

  for suppressing or minimising disturbance in the image signal generation · CPC title

• H04N13/344

  with head-mounted left-right displays · CPC title

• H04N13/383

  for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes · CPC title

• G06F30/20

  Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30) · CPC title

• B64D43/00

  Arrangements or adaptations of instruments · CPC title