Low latency augmented reality display

Patent metadata

Field	Value
Publication number	US-9659410-B2
Application number	US-201414519457-A
Country	US
Kind code	B2
Filing date	Oct 21, 2014
Priority date	Oct 21, 2014
Publication date	May 23, 2017
Grant date	May 23, 2017

Abstract

An augmented reality system is provided and a method for controlling an augmented reality system are provided. The augmented reality system, for example, may include, but is not limited to a display, a memory, and at least one processor communicatively coupled to the display and memory, the at least one processor configured to generate image data having a first resolution at a first rate, store the generated image data in the memory, and transfer a portion of the generated image data having a second resolution to the display from the memory at a second rate, wherein the second rate is faster than the first rate and the second resolution is smaller than the first resolution. This dual rate system then enables a head-tracked augmented reality system to be updated at the high rate, reducing latency based artifacts.

First claim

What is claimed is:

1. An augmented reality system, comprising:
a display;
a memory; and
a first processor communicatively coupled to the display and memory, the first processor configured to generate image data having a first field of view and having a first resolution at a first rate, wherein the generated image data includes control pixels, the control pixels including location data corresponding to the image data;
a second processor communicatively coupled to the first processor, the display and the memory, the second processor configured to:
store the generated image data in the memory; and
transfer a portion of the generated image data having a second field of view smaller than the first field of view and having a second resolution to the display from the memory at a second rate, wherein the second rate is faster than the first rate and the second resolution is smaller than the first resolution,
wherein the first processor and the second processor are communicatively connected via a twenty-four bit data channel, and the first processor is configured to generate the image data where each pixel of the image data includes 8-bits of green data, 6-bits of red data, 6-bits of blue data and 4-bits of weighting data, the weighting data defining a transparency of each pixel.

2. The augmented reality system of claim 1 , further comprising:
a sensor communicatively coupled to the first processor, the sensor configured to output head position and orientation data,
wherein the second processor is further configured to select the portion of the generated image data to transfer to the display based upon the head position data.

3. The augmented reality system of claim 2 , wherein the first processor is further configured to generate the image data based upon the head position and orientation data.

4. The augmented reality system of claim 1 , further comprising:
a sensor communicatively coupled to the first processor, the sensor configured to output head rotational rate data, wherein one of the at least one processors is further configured to generate the image data based upon the head rotational rate data.

5. The augmented reality system of claim 1 , wherein the generated image data includes a signature pattern.

6. The augmented reality system of claim 5 , wherein the second processor is configured to verify an integrity of the transferred portion of the generated image data based upon the signature pattern.

7. The augmented reality system of claim 1 , wherein first processor is configured to generate at least two images and the second processor is configured to transmit a portion of each of the at least two images to the display such that each of the two images are displayed simultaneously based upon the weighting data.

8. A method of controlling an augmented reality system, comprising:
generating, by a first processor, image data having a first field of view and having a first resolution at a first rate, the generated image data includes control pixels, the control pixels including location data corresponding to the image data;
storing, by a second processor, the generated image data in a memory;
transferring, by the second processor, a portion of the generated image data having a second field of view smaller than the first field of view and having a second resolution to a display of the augmented reality system from the memory at a second rate, wherein the second rate is faster than the first rate and the second resolution is smaller than the first resolution,
wherein the first processor and the second processor are communicatively connected via a twenty-four bit data channel, and the first processor is configured to generate the image data where each pixel of the image data includes 8-bits of green data, 6-bits of red data, 6-bits of blue data and 4-bits of weighting data, the weighting data defining a transparency of each pixel.

9. The method of claim 8 , wherein the generating further comprises embedding signature pattern into the image data, and the method further comprises determining, by second processor, data integrity of the image data based upon the signature pattern.

10. The method of claim 8 , further comprising:
determining, by the first processor, content of the image data based upon head position data output by a sensor.

11. The method of claim 8 , further comprising:
determining, by the first processor, content of the image data based upon head rotational rate data output by a sensor.

12. A non-transitory computer readable medium storing instructions, which when executed by a first processor, cause the first processor to:
generate image data having a first field of view and having a first resolution at a first rate, the generated image data includes control pixels, the control pixels including location data corresponding to the image data;
the non-transitory computer readable medium storing instructions, which when executed by a second processor, cause the second processor to:
store the generated image data in a memory;
transfer a portion of the generated image data having a second field of view smaller than the first field of view and having a second resolution to a display from the memory at a second rate, wherein the second rate is faster than the first rate and the second resolution is smaller than the first resolution,

wherein the first processor and the second processor are communicatively connected via a twenty-four bit data channel, and the first processor is configured to generate the image data where each pixel of the image data includes 8-bits of green data, 6-bits of red data, 6-bits of blue data and 4-bits of weighting data, the weighting data defining a transparency of each pixel.

13. The non-transitory computer readable medium of claim 12 , wherein the first rate is forty hertz and the second rate is four hundred and eighty hertz.

14. The non-transitory computer readable medium of claim 12 which when executed by the first processor, further cause the first processor to:
determine content of the image data based upon head position data output by a sensor.

15. The non-transitory computer readable medium of claim 12 which when executed by the first processor, further cause the first processor to:
determine content of the image data based upon head rotational rate data output by a sensor.

Assignees

• Honeywell Int Inc

Inventors

• Hancock William Ray
• Fye James C
• Leiphon Ken

Classifications

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T2207/10024

  Color image · CPC title

• G02B27/017 Primary

  Head mounted · CPC title

• G06T3/4092

  Image resolution transcoding, e.g. by using client-server architectures · CPC title

• G06T2200/16

  involving adaptation to the client's capabilities · CPC title