Method and apparatus for image producing with predictions of future positions

Patent metadata

Field	Value
Publication number	US-9595083-B1
Application number	US-201414254172-A
Country	US
Kind code	B1
Filing date	Apr 16, 2014
Priority date	Apr 16, 2013
Publication date	Mar 14, 2017
Grant date	Mar 14, 2017

Abstract

Aspects of the disclosure provide an apparatus for image displaying. The apparatus includes a prediction system and an imaging system. The prediction system is configured to predict, for a first time, a first position of a display device at a specific future time for displaying an image associated with a position of the display, and predict, for a second time that is later than the first time, a second position of the display at the future time with an offset to the first position. The imaging system is configured to render a first image associated with the first position, buffer the first image in a memory, and adjust the buffered first image according to the offset to generate a second image associated with the second position of the display device.

First claim

What is claimed is:

1. An apparatus for image displaying, comprising:
a prediction system configured to predict, by a fuzzy logic system, according to different motion modes, for a first time, a first position of a display device at a specific future time for displaying an image associated with a position of the display device, and predict, for a second time that is later than the first time, a second position of the display device at the specific future time with an offset to the first position, the different motion modes including at least a first motion mode and a second motion mode, the first motion mode used to predict the position of the display device in non-periodic motions or low frequency motions, the second motion mode used to predict the position of the display device in high frequency motions, wherein the fuzzy logic system predicts that a head of the apparatus' user in a protective suit, which constraints a motion of the head, will turn to a first direction at a first speed when the head is moving at a second speed that is faster than the first speed and the head is already partially turned to the first direction, the first speed being used to predict the second position; and
an imaging system configured to render a first image associated with the first position, buffer the first image in a memory, during the first motion mode of operation, adjust the buffered first image in a same direction of motions of the display device according to the offset to generate a second image associated with the second position, and during the second motion mode of operation, adjust the buffered first image in a counter direction of motions of the display device according to the offset to generate the second image.

2. The apparatus of claim 1 , wherein the apparatus is a head wearable device (HWD) worn on a person's head, the display device has a first motion component following the person's head and has a second motion component relative to the person's head.

3. The apparatus of claim 2 , wherein:
the prediction system is configured to predict the offset due to the first motion component of the display device; and
the imaging system is configured to adjust the first image in a same direction of the first motion component according to the offset to generate the second image.

4. The apparatus of claim 2 , wherein
the prediction system is configured to predict the offset due to the second motion component of the display device; and
the image system is configured to adjust the first image in a counter direction of the second motion component according to the offset to generate the second image.

5. The apparatus of claim 2 , further comprising:
a sensor system configured to generate sensing data in response to the first motion component and the second motion component and provide the sensing data to the prediction system.

6. The apparatus of claim 5 , wherein the prediction system comprises:
a first filter configured to filter the sensing data to pass first components that are lower than a threshold; and
a second filter configured to filter the sensing data to pass second components that are above the threshold.

7. The apparatus of claim 6 , wherein the prediction system comprises:
a first predictor configured to determine the first motion component of the display device based on the first components; and
a second predictor configured to determine the second motion component of the display device based on the second components.

8. The apparatus of claim 1 , wherein the imaging system is configured to render the first image associated with the first position based on object models, and shift the first image according to the offset to generate the second image associated with the second position.

9. The apparatus of claim 1 , wherein the imaging system is configured to render, from three-dimensional object models, the first image with corresponding z values associated with the first position, and at least an additional image with corresponding z values associated with a different position other than the first position, and computer the second image associated with second position, based on the first image with corresponding z values and the additional image with corresponding z values.

10. The apparatus of claim 1 , wherein the imaging system includes a graphics processing unit (GPU) configured to adjust the first image buffered in the memory based on the offset to generate the second image.

11. The apparatus of claim 1 , wherein a first memory space in the memory is allocated to a first buffer configured for use during the rendering of the first image, a second memory space in the memory is allocated to a second buffer configured to buffer the first image after the rendering is complete, and a third memory space in the memory is allocated to a third buffer configured to buffer the second image.

12. A method for image displaying, comprising:
predicting according to different motion modes, for a first time, a first position of a display device at a specific future time for displaying an image associated with a position of the display device;
rendering a first image associated with the first position;
buffering the first image in a memory;
predicting, by a fuzzy logic system, according to the different motion modes, for a second time that is later than the first time, a second position of the display device at the specific future time with an offset to the first position, wherein the different motion modes including at least a first motion mode and a second motion mode, the first motion mode used to predict the position of the display device in non-periodic motions or low frequency motions, the second motion mode used to predict the position of the display device in high frequency motions, wherein the fuzzy logic system predicts that a head of the apparatus user in a protective suit, which constraints a motion of the head, will turn to a first direction at a first speed when the head is moving at a second speed that is faster than the first speed and the head is already partially turned to the first direction, the first speed being used to predict the second position;
during the first motion mode of operation, adjusting the buffered first image in a same direction of motions of the display device according to the offset to generate a second image associated with the second position; and
during the second motion mode of operation, adjusting the buffered first image in a counter direction of motions of the display device according to the offset to generate the second image.

13. The method of claim 12 , further comprising:
mounting a head wearable device (HWD) with the display device a person's head, the display device having a first motion component following the person's head and having a second motion component relative to the person's head.

14. The method of claim 13 , wherein predicting, the second time that is later than the first time, the second position of the display device at the future time with the offset to the first position and adjusting the first image according to the offset to generate the second image associated with the second position of the display device further comprises:
predicting the offset due to the first motion component of the display device; and
adjusting the first image in a same direction of the first motion component according to the offset to generate the second image.

15. The method of claim 13 , wherein predicting, the second time that is later than the first time, the second position of the display device at the future time with the offset to the first position and adjusting

Assignees

• Lockheed Corp

Inventors

• Smith David Alan
• Harrison Gregory Anthony

Classifications

• G06F3/012 Primary

  Head tracking input arrangements · CPC title

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T5/006 Primary

  Physics · mapped topic

• G02B27/0172

  characterised by optical features · CPC title