Predictive viewport renderer and foveated color compressor

Patent metadata

Field	Value
Publication number	US-10943379-B2
Application number	US-201916533920-A
Country	US
Kind code	B2
Filing date	Aug 7, 2019
Priority date	Apr 1, 2017
Publication date	Mar 9, 2021
Grant date	Mar 9, 2021

Abstract

An embodiment of a graphics apparatus may include a focus identifier to identify a focus area, and a color compressor to selectively compress color data based on the identified focus area. Another embodiment of a graphics apparatus may include a motion detector to detect motion of a real object, a motion predictor to predict a motion of the real object, and an object placer to place a virtual object relative to the real object based on the predicted motion of the real object. Another embodiment of a graphics apparatus may include a frame divider to divide a frame into viewports, a viewport prioritizer to prioritize the viewports, a renderer to render a viewport of the frame in order in accordance with the viewport priorities, and a viewport transmitter to transmit a completed rendered viewport. Other embodiments are disclosed and claimed.

First claim

What is claimed is:

1. A computing system comprising:
a graphics processor;
a central processing unit; and
a memory including a set of instructions, which when executed by one or more of the graphics processor or the central processing unit, cause the computing system to:
detect motion of a real object,
predict a motion of the real object based on the detected motion,
determine a latency, and
place a virtual object relative to the real object based on the predicted motion of the real object and the latency.

2. The system of claim 1 , wherein the instructions, when executed, cause the computing system to:
predict a location of the real object; and
place the virtual object relative to the real object based on the location of the real object.

3. The system of claim 1 , wherein the instructions, when executed, cause the computing system to:
predict an orientation of the real object; and
place the virtual object relative to the real object based on the orientation of the real object.

4. The system of claim 1 , wherein the instructions, when executed, cause the computing system to:
determine an amount of the latency based on one or more of time to render an augmented reality scene, a number of augmented reality objects in the augmented reality scene, or a complexity of the augmented reality scene; and
place the virtual object relative to the real object based on the amount of the latency.

5. The system of claim 4 , wherein the amount of the latency is to be a time difference between a time of capture of a real scene and a time that the augmented reality scene is to be rendered, wherein the real scene is to include the real object.

6. The system of claim 4 , wherein the instructions, when executed, cause the computing system to:
predict the motion of the real object based on the latency.

7. An apparatus comprising:
a memory; and
logic communicatively coupled to the memory, wherein the logic is implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, the logic communicatively coupled to the memory to:
detect motion of a real object,
predict a motion of the real object based on the detected motion,
determine a latency, and
place a virtual object relative to the real object based on the predicted motion of the real object and the latency.

8. The apparatus of claim 7 , wherein the logic coupled to the memory is to:
predict a location of the real object; and
place the virtual object relative to the real object based on the location of the real object.

9. The apparatus of claim 7 , wherein the logic coupled to the memory is to:
predict an orientation of the real object; and
place the virtual object relative to the real object based on the orientation of the real object.

10. The apparatus of claim 7 , wherein the logic coupled to the memory is to:
determine an amount of the latency based on one or more of time to render an augmented reality scene, a number of augmented reality objects in the augmented reality scene, or a complexity of the augmented reality scene; and
place the virtual object relative to the real object based on the amount of the latency.

11. The apparatus of claim 10 , wherein the amount of the latency is to be a time difference between a time of capture of a real scene and a time that the augmented reality scene is to be rendered, wherein the real scene is to include the real object.

12. The apparatus of claim 10 , wherein the logic coupled to the memory is to:
predict the motion of the real object based on the latency.

13. At least one non-transitory computer readable storage medium comprising a set of instructions, which when executed by a computing device, cause the computing device to:
detect motion of a real object;
predict a motion of the real object based on the detected motion;
determine a latency; and
place a virtual object relative to the real object based on the predicted motion of the real object and the latency.

14. The at least one non-transitory computer readable storage medium of claim 13 , wherein the instructions, when executed, cause the computing device to:
predict a location of the real object; and
place the virtual object relative to the real object based on the location of the real object.

15. The at least one non-transitory computer readable storage medium of claim 13 , wherein the instructions, when executed, cause the computing device to:
predict an orientation of the real object; and
place the virtual object relative to the real object based on the orientation of the real object.

16. The at least one non-transitory computer readable storage medium of claim 13 , wherein the instructions, when executed, cause the computing device to:
determine an amount of the latency based on one or more of time to render an augmented reality scene, a number of augmented reality objects in the augmented reality scene, or a complexity of the augmented reality scene; and
place the virtual object relative to the real object based on the amount of the latency.

17. The at least one non-transitory computer readable storage medium of claim 16 , wherein the amount of the latency is to be a time difference between a time of capture of a real scene and a time that the augmented reality scene is to be rendered, wherein the real scene is to include the real object.

18. The at least one non-transitory computer readable storage medium of claim 16 , wherein the instructions, when executed, cause the computing device to:
predict the motion of the real object based on the latency.

19. A method comprising:
detecting motion of a real object;
predicting a motion of the real object based on the detected motion;
determining a latency; and
placing a virtual object relative to the real object based on the predicted motion of the real object and the latency.

20. The method of claim 19 , further comprising:
predicting a location of the real object; and
placing the virtual object relative to the real object based on the location of the real object.

21. The method of claim 19 , further comprising:
predicting an orientation of the real object; and
placing the virtual object relative to the real object based on the orientation of the real object.

22. The method of claim 19 , further comprising:
determining an amount of the latency based on one or more of time to render an augmented reality scene, a number of augmented reality objects in the augmented reality scene, or a complexity of the augmented reality scene; and
placing the virtual object relative to the real object based on the amount of the latency.

23. The method of claim 22 , wherein the amount of the latency is to be a time difference between a time of capture of a real scene and a time that the augmented reality scene is to be rendered, wherein the real scene is to include the real object.

24. The method of claim 22 , further comprising:
predicting the motion of the real object based on the latency.

Assignees

• Intel Corp

Inventors

• Vembar Deepak S
• Kuwahara Atsuo
• Sakthivel Chandrasekaran
• Venkataraman Radhakrishnan
• Insko Brent E
• Kalra Anupreet S
• Labbe Hugues
• Appu Abhishek R
• Shah Ankur N
• Ray Joydeep
• Ould-Ahmed-Vall Elmoustapha
• Holland James M

Classifications

• G06T9/00 Primary

  Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00) · CPC title

• H04N19/17

  the unit being an image region, e.g. an object · CPC title

• H04N19/167

  Position within a video image, e.g. region of interest [ROI] · CPC title

• H04N19/124

  Quantisation · CPC title

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title