5G optimized game rendering

Patent metadata

Field	Value
Publication number	US-12558618-B2
Application number	US-202018017342-A
Country	US
Kind code	B2
Filing date	Jul 20, 2020
Priority date	Jul 20, 2020
Publication date	Feb 24, 2026
Grant date	Feb 24, 2026

Abstract

According to some embodiments, a method performed by a virtual environment rendering engine for remote rendering of a virtual environment for a client device comprises: receiving an indication of network latency between the virtual environment rendering engine and the client device; receiving an indication of a client viewport field of view for the client device; based on the network latency, determining an adjusted viewport field of view; and generating a projection mapped 360 degree video frame. The pixel density within the adjusted viewport field of view is greater than the pixel density outside the adjusted viewport field of view. The method further comprises encoding the projection mapped 360 degree video frame and transmitting the encoded projection mapped 360 degree video frame to the client device.

First claim

The invention claimed is:

1 . A method performed by a virtual environment rendering engine for remote rendering of a virtual environment for a client device, the method comprising:
receiving an indication of network latency between the virtual environment rendering engine and the client device; receiving an indication of a client viewport field of view for the client device; based on the network latency, determining an adjusted viewport field of view; generating a projection mapped 360 degree video frame, wherein the projection mapped 360 degree video frame is rendered in the virtual environment, wherein a pixel density within the adjusted viewport field of view is greater than a pixel density outside the adjusted viewport field of view, and wherein the adjusted viewport field of view increases in dimension as the network latency increases; encoding the projection mapped 360 degree video frame; and transmitting the encoded projection mapped 360 degree video frame to the client device.

2 . The method of claim 1 , further comprising:
generating dynamic mesh data for the projection mapped 360 degree video frame; and transmitting the dynamic mesh data to the client device.

3 . The method of claim 1 , wherein the projection mapped 360 degree video frame comprises an equiangular box comprising a front, back, top, bottom, and two sides, and the method further comprises orienting the front of the equiangular box with the client viewport field of view for the client device.

4 . The method of claim 3 , wherein a pixel density of the front of the equiangular box is greater than a pixel density of each of the top, bottom, two sides, and back of the equiangular box.

5 . The method of claim 1 , wherein the virtual environment rendering engine comprises a game rendering engine and the client device comprises one or more of a virtual reality headset and a video display screen.

6 . The method of claim 1 , wherein the network between the virtual environment rendering engine and the client device comprises a fifth generation (5G) wireless network, and the indication of network latency is received from a 5G network node.

7 . A virtual environment rendering engine comprising processing circuitry operable to:
receive an indication of network latency between the virtual environment rendering engine and a client device; receive an indication of a client viewport field of view for the client device; based on the network latency, determine an adjusted viewport field of view; generate a projection mapped 360 degree video frame, wherein the projection mapped 360 degree video frame is rendered in the virtual environment, wherein a pixel density within the adjusted viewport field of view is greater than a pixel density outside the adjusted viewport field of view, wherein the adjusted viewport field of view increases in dimension as the network latency increases; encode the projection mapped 360 degree video frame; and transmit the encoded projection mapped 360 degree video frame to the client device.

8 . The virtual environment rendering engine of claim 7 , the processing circuitry further operable to:
generate dynamic mesh data for the projection mapped 360 degree video frame; and transmit the dynamic mesh data to the client device.

9 . The virtual environment rendering engine of claim 7 , wherein the projection mapped 360 degree video frame comprises an equiangular box comprising a front, back, top, bottom, and two sides, and the processing circuitry is further operable to orient the front of the equiangular box with the client viewport field of view for the client device.

10 . The virtual environment rendering engine of claim 9 , wherein a pixel density of the front of the equiangular box is greater than a pixel density of each of the top, bottom, two sides, and back of the equiangular box.

11 . The virtual environment rendering engine of claim 7 , wherein the virtual environment rendering engine comprises a game rendering engine and the client device comprises one or more of a virtual reality headset and a video display screen.

12 . The virtual environment rendering engine of claim 7 , wherein the network between the virtual environment rendering engine and the client device comprises a fifth generation (5G) wireless network, and the indication of network latency is received from a 5G network node.

Assignees

• Ericsson Telefon Ab L M

Inventors

• Phillips Chris
• Brodin Per-Erik
• Forsman Jr Robert Hammond

Classifications

• A63F2300/8082

  Virtual reality · CPC title

• A63F2300/538

  for performing operations on behalf of the game client, e.g. rendering · CPC title

• A63F13/358

  Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients · CPC title

• A63F13/332 Primary

  using wireless networks, e.g. cellular phone networks · CPC title

• H04L65/70

  Media network packetisation · CPC title