Head mounted display update buffer

Patent metadata

Field	Value
Publication number	US-9542718-B2
Application number	US-201414575612-A
Country	US
Kind code	B2
Filing date	Dec 18, 2014
Priority date	Dec 18, 2014
Publication date	Jan 10, 2017
Grant date	Jan 10, 2017

Abstract

Techniques related to providing updates in a head mounted display (HMD) device are described herein. A HMD may be configured to display a view of an environment. An update buffer of the HMD device may be included to store image data. The image data may include image data for a current view of the environment and image data of the environment that is outside of the current view.

First claim

What is claimed is:

1. An apparatus for updating image data, comprising:
a head mounted display (HMD) device to display a view of an environment;
an update buffer of the HMD device, wherein the update buffer is to store image data comprising:
image data for a current view of the environment; and
image data of the environment that is outside of the current view;

an update module, at least partially comprising hardware logic, wherein the logic of the update module is to provide image data from the update buffer to be displayed at the HMD device based on an update policy, wherein the update module is to provide image data from the update buffer to be displayed at the HMD device rather than image data directly from a source computing device to be displayed at the HMD device, wherein the source computing device is external to the HMD device and is to provide updates to the update buffer;
wherein the update module is further configured to direct the source to provide a selective update to the buffer, wherein the selective update comprises an update to image data in the current view that is changing above a predetermined threshold.

2. The apparatus of claim 1 , wherein the update policy comprises:
providing updates for a new view of the environment resulting from movement of the HMD device at a first priority;
providing updates for a current view of the environment at a second priority lower than the first priority; and
providing updates for the image data of the environment that is outside the current view at a third priority lower than the second priority.

3. The apparatus of claim 1 , wherein the update module is to:
determine when movement of the HMD device has occurred;
calculate a new position of a new view resulting from the movement;
update content to be displayed at the HMD device by providing image data from the update buffer; and
notify the source computing device of the movement.

4. The apparatus of claim 1 , wherein the update module is further configured to direct the source to provide a selective update to the buffer, wherein the selective update comprises an update to the image data of the environment outside of the current view that is changing above a predetermined threshold.

5. The apparatus of claim 1 , wherein the update module is further configured to retrieve a partial update from the update buffer, wherein the partial update comprises a portion of the current view and a portion of the image data of the environment that was previously outside of the current view after movement of the HMD device.

6. The apparatus of claim 1 , wherein the update module is further configured to retrieve a partial update, wherein the partial update comprises a portion of a new view provided from the source when the portion is not available from the update buffer.

7. The apparatus of claim 1 , wherein the image data of the current view is of a lower size resolution than the image data of the environment that is outside of the current view.

8. A method for updating image data, comprising:
displaying a view of an environment at a head mounted display (HMD) device;
storing image data at an update buffer of the HMD device, the image data comprising:
image data for a current view of the environment; and
image data of the environment that is outside of the current view;

providing image data from the update buffer to be displayed at the HMD device based on an update policy;
providing updates to the update buffer from a source computing device external to the HMD device; and
directing the source to provide a selective update to the buffer, wherein the selective update comprises an update to the image data of the environment that is outside of the current view that is changing above a predetermined threshold.

9. The method of claim 8 , wherein the update policy comprises:
providing updates for a new view of the environment resulting from movement of the HMD at a first priority;
providing updates for a current view of the environment at a second priority lower than the first priority; and
providing updates for the image data of the environment that is outside the current view at a third priority lower than the second priority.

10. The method of claim 8 , further comprising:
determining when movement of the HMD has occurred;
calculating a new position of a new view resulting from the movement;
update content to be displayed at the HMD device by providing image data from the update buffer; and
notify the source computing device of the movement.

11. The method of claim 8 , further comprising directing the source to provide a selective update to the buffer, wherein the selective update comprises an update to image data in the current view that is changing above a predetermined threshold.

12. The method of claim 8 , further comprising providing a partial update from the update buffer, wherein the partial update comprises a portion of the current view and a portion of the image data of the environment previously outside of the current view after movement of the HMD.

13. The method of claim 8 , further comprising retrieving a partial update from the source, wherein the partial update comprises a portion of a new view provided from the source when the portion is not available from the update buffer.

14. The method of claim 8 , wherein the image data of the current view is of a lower size resolution than the image data of the environment that is outside of the current view.

15. A system for updating image data, comprising:
a head mounted display (HMD) device to display a view of an environment;
an update buffer of the HMD device, wherein the update buffer is to store image data comprising:
image data for a current view of the environment; and
image data of the environment that is outside of the current view; and

an update module, at least partially comprising hardware logic, wherein the logic of the update module is to provide image data from the update buffer to be displayed at the HMD device based on an update policy, wherein the update module is to:
determine when movement of the HMD device has occurred;
calculate a new position of a new view resulting from the movement;
update content to be displayed at the HMD device by providing image data from the update buffer;
notify the source computing device of the movement; and
direct the source to provide selective updates to the buffer, wherein selective updates comprise partial updates, wherein partial updates comprise a portion of the current view and a portion of the image data of the environment that was previously outside of the current view after movement of the HMD device, a portion of a new view provided from the source when the portion is not available from the update buffer, or any combination thereof.

16. The system of claim 15 , wherein the update policy comprises:
providing updates for a new view of the environment resulting from movement of the HMD device at a first priority;
providing updates for a current view of the environment at a second priority lower than the first priority; and
providing updates for the image data of the environment that is outside the current view at a third priority lower than the second priority.

17. The system of claim 15 , further comprising a source computing device that is external to the HMD device to provide updates to the update buffer, wherein the update module is to provide image data from the update buffer to be displayed at the HMD device rather than image data directly from the source computing device to be displayed at the HMD device.

Assignees

• Intel Corp

Inventors

• Thulasimani Sivakumar
• S T Ganesh
• K P Sameer

Classifications

• G02B27/017 Primary

  Head mounted · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F12/0802

  Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches · CPC title

• G06T1/60 Primary

  Memory management · CPC title

• G02B2027/0141

  characterised by the informative content of the display · CPC title