Techniques for compensating variable display device latency in image display

Patent metadata

Field	Value
Publication number	US-10762691-B2
Application number	US-201815896712-A
Country	US
Kind code	B2
Filing date	Feb 14, 2018
Priority date	Sep 8, 2017
Publication date	Sep 1, 2020
Grant date	Sep 1, 2020

Abstract

Examples described herein generally relate to displaying an image on a display device where a motion during a latency between a first time associated with activating a first portion of the display device and a second time associated with activating a second portion of the display device is predicted. At least a second portion of an image, to be displayed at the second time, is distorted based at least in part on a function of the motion and the latency to compensate for the latency. A first portion of the image is displayed at the first time by activating the first portion of the display device. The second portion of the image, as distorted, is displayed at the second time by activating the second portion of the display device.

First claim

What is claimed is:

1. A method for displaying an image on a display device, comprising:
predicting at least a direction of a motion during a latency between a first time associated with activating a first portion of the display device to emit light for displaying a first portion of the image and a second time associated with activating a second portion of the display device to emit light for displaying a second portion of the image;
distorting at least the second portion of the image, from the first portion of the image, to be displayed at the second time, based at least in part on a function of the motion and the latency to compensate for the latency by skewing at least the second portion of the image from the first portion of the image in a second direction that opposes the direction of the motion, wherein skewing at least the second portion of the image is based on transforming the motion from a real world coordinate space to a virtual coordinate space of the image and moving pixels of at least the second portion of the image in a direction opposing the motion;
displaying the first portion of the image at the first time by activating the first portion of the display device; and
displaying the second portion of the image, as distorted, at the second time by activating the second portion of the display device.

2. The method of claim 1 , wherein the distorting is further based at least in part on one or more properties of a scan-out order of the display device, and wherein activating the first portion of the display device to emit light for displaying the first portion of the image and activating the second portion of the display device to emit light for displaying the second portion of the image is based on the scan-out order of the display device.

3. The method of claim 2 , wherein the one or more properties of the scan-out order comprise at least one of an indication of scan-out portions on the display device and associated order of display of the scan-out portions, latencies associated with the scan-out portions, or a number of pixels displayed in the scan-out portions.

4. The method of claim 1 , wherein the motion corresponds to movement in a determined head position of a virtual reality (VR) device comprising the display device.

5. The method of claim 4 , wherein predicting the motion is based at least in part on a velocity or acceleration of the determined head position.

6. The method of claim 1 , further comprising distorting the first portion of the image based at least in part on another motion predicted during another latency between the first time and a previous time associated with activating a previous portion of the display device.

7. A computing device for displaying an image on a display device, comprising:
a memory storing one or more parameters or instructions for executing an operating system and one or more applications;
a display interface coupled with the display device for communicating signals to display images on the display device; and
at least one processor coupled to the memory and the display interface, wherein the at least one processor is configured to:
predict at least a direction of a motion during a latency between a first time associated with activating a first portion of the display device to emit light for displaying a first portion of the image and a second time associated with activating a second portion of the display device to emit light for displaying a second portion of the image;
distort at least the second portion of the image, from the first portion of the image, to be displayed at the second time, based at least in part on a function of the motion and the latency to compensate for the latency by skewing at least the second portion of the image from the first portion of the image in a second direction that opposes the direction of the motion, wherein skewing at least the second portion of the image is based on transforming the motion from a real world coordinate space to a virtual coordinate space of the image and moving pixels of at least the second portion of the image in a direction opposing the motion;
display the first portion of the image at the first time by activating the first portion of the display device; and
display the second portion of the image, as distorted, at the second time by activating the second portion of the display device.

8. The computing device of claim 7 , wherein the at least one processor is configured to distort at least the second portion of the image further based at least in part on one or more properties of a scan-out order of the display device, and wherein activating the first portion of the display device to emit light for displaying the first portion of the image and activating the second portion of the display device to emit light for displaying the second portion of the image is based on the scan-out order of the display device.

9. The computing device of claim 8 , wherein the one or more properties of the scan-out order comprise at least one of an indication of scan-out portions on the display device and associated order of display of the scan-out portions, latencies associated with the scan-out portions, or a number of pixels displayed in the scan-out portions.

10. The computing device of claim 7 , wherein the motion corresponds to movement in a determined head position of a virtual reality (VR) device comprising the display device.

11. The computing device of claim 10 , further comprising one or more sensors configured to determine a velocity or acceleration of the determined head position, wherein the at least one processor is configured to predict the motion based at least in part on the velocity or acceleration of the determined head position.

12. The computing device of claim 7 , wherein the at least one processor is further configured to distort the first portion of the image based at least in part on another motion predicted during another latency between the first time and a previous time associated with activating a previous portion of the display device.

13. A non-transitory computer-readable medium, comprising code executable by one or more processors for displaying an image on a display device, the code comprising code for:
predicting at least a direction of a motion during a latency between a first time associated with activating a first portion of the display device to emit light for displaying a first portion of the image and a second time associated with activating a second portion of the display device to emit light for displaying a second portion of the image;
distorting at least the second portion of the image, from the first portion of the image, to be displayed at the second time, based at least in part on a function of the motion and the latency to compensate for the latency by skewing at least the second portion of the image from the first portion of the image in a second direction that opposes the direction of the motion, wherein skewing at least the second portion of the image is based on transforming the motion from a real world coordinate space to a virtual coordinate space of the image and moving pixels of at least the second portion of the image in a direction opposing the motion;
displaying the first portion of the image at the first time by activating the first portion of the display device; and
displaying the second portion of the image, as distorted, at the second time by activating the second portion of the display device.

14. The non-transitory computer-readable medium of claim 13 , wherein the code for distorting is further based at least in part on one or more properties of a scan-out order of the display devi

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Yeung Andrew Zicheng
• Wilson Brent Michael
• Elliott Jack Andrew
• Sandy Matthew David
• Boulton Michael George
• You Yang

Classifications

• G06F3/147 Primary

  using display panels · CPC title

• G09G5/346

  for systems having a bit-mapped display memory · CPC title

• G06T2215/16

  Using real world measurements to influence rendering · CPC title

• G09G2320/106

  Determination of movement vectors or equivalent parameters within the image · CPC title

• G09G2320/0261

  in the context of movement of objects on the screen or movement of the observer relative to the screen · CPC title