Multi-plane transmission

Patent metadata

Field	Value
Publication number	US-11418797-B2
Application number	US-201916368269-A
Country	US
Kind code	B2
Filing date	Mar 28, 2019
Priority date	Mar 28, 2019
Publication date	Aug 16, 2022
Grant date	Aug 16, 2022

Abstract

Systems, apparatuses, and methods for performing efficient video transmission are disclosed. In a video processing system, a transmitter identifies multiple planes in a scene. The transmitter renders and compresses each of the multiple planes with a combination of a corresponding compression level and a resolution, which is different from a combination of compression level and resolution of any other plane. For each plane, the transmitter inserts, in multi-plane information, data such as identification of the plane, a location in the video frame for the plane, and one or more of a resolution and compression level for the plane. The transmitter conveys the rendered and compressed planes along with the multi-plane information to a receiver. The receiver decodes each of the planes and insets each of the planes on any lower resolution planes of the multiple planes.

First claim

What is claimed is:

1. An apparatus comprising:
a transmitter comprising circuitry configured to communicate with a receiver; and
logic comprising circuitry configured to:
receive source data corresponding to a scene in a frame to be rendered for display on a display device;
receive an indication to render the frame as a plurality of planes;
render, using the source data, the plurality of planes, each plane comprising one or more blocks of a plurality of blocks of the frame corresponding to the scene, and wherein for a given plane of the plurality of planes, a resolution is different than a resolution of one or more other planes of the plurality of planes;
insert metadata in of each of the plurality of planes, the metadata comprising multi-plane information including a rank for each of the plurality of planes indicative of an order in which the plurality of planes are to be decoded; and
transmit each of the plurality of planes to a receiver.

2. The apparatus as recited in claim 1 , wherein the rank of each of the plurality of planes indicates a relative resolution of a given plane with respect to other planes of the plurality of planes.

3. The apparatus as recited in claim 1 , wherein the indication comprises one or more commands to render the frame as a plurality of planes that are generated responsive to identification of at least one of a foveated region, a predicted point of focus, a region with high contrast edges, and a hint from software and/or hardware.

4. The apparatus as recited in claim 1 , wherein for a given frame, the transmitter is configured to transmit each plane of the given frame in an order based on resolution beginning with the lowest resolution.

5. The apparatus as recited in claim 1 , wherein the logic is further configured to insert, in the multi-plane information, identification and a location in a video frame for each of the plurality of planes.

6. The apparatus as recited in claim 1 , wherein the logic is further configured to determine which regions of the frame qualify to be planes based on one or more of a level of contrast of a region, moving objects in a particular region, and objects in a region predicted to be points of focus.

7. The apparatus as recited in claim 1 , wherein one or more of the plurality of planes comprises one or more of:
a foveated region;
a predicted point of focus; and
a region comprising high contrast edges.

8. A method, comprising:
receiving, by logic in a transmitter, source data corresponding to a scene in a frame to be rendered for display on a display device;
receiving an indication to render the frame as a plurality of planes;
rendering, by the logic using the source data, each of the plurality of planes, each plane comprising one or more blocks of a plurality of blocks of the frame corresponding to the scene, and wherein for a given plane of the plurality of planes, a resolution is different than a resolution of one or more other planes of the plurality of planes;
inserting metadata in each of the plurality of planes, the metadata comprising multi-plane information including a rank for each of the plurality of planes indicative of an order in which the plurality of planes are to be decoded; and
transmitting each of the plurality of planes to a receiver.

9. The method as recited in claim 8 , wherein the rank of each of the plurality of planes indicates a relative resolution of a given plane with respect to other planes of the plurality of planes.

10. The method as recited in claim 8 , wherein indication comprises one or more commands to render the frame as a plurality of planes that are generated responsive to identification of at least one of a foveated region, a predicted point of focus, a region with high contrast edges, and a hint from software and/or hardware.

11. The method as recited in claim 8 , further comprising:
compressing each of the plurality of planes with a given compression level; and
separately transmitting each of the plurality of planes via a wireless connection.

12. The method as recited in claim 8 , further comprising inserting, in the multi-plane information, identification and a location in a video frame for each of the plurality of planes.

13. The method as recited in claim 8 , further comprising determining which regions of the frame qualify to be planes based on one or more of a level of contrast of a region, moving objects in a particular region, and objects in a region predicted to be points of focus.

14. A non-transitory computer readable storage medium storing program instructions, wherein the program instructions are executable by a processor to:
receive source data corresponding to a scene in a frame to be rendered for display on a display device;
receive an indication to render the frame as a plurality of planes;
render, using the source data, the plurality of planes, each plane comprising one or more blocks of a plurality of blocks of the frame corresponding to the scene, and wherein for a given plane of the plurality of planes, a resolution is different than a resolution of one or more other planes of the plurality of planes; and
insert metadata in of each of the plurality of planes, the metadata comprising multi-plane information including a rank for each of the plurality of planes indicative of an order in which the plurality of planes are to be decoded; and
transmit each of the plurality of planes to a receiver.

15. The non-transitory computer readable storage medium as recited in claim 14 , wherein the rank of each of the plurality of planes indicates a relative resolution of a given plane with respect to other planes of the plurality of planes.

16. The non-transitory computer readable storage medium as recited in claim 14 , wherein the indication comprises one or more commands to render the frame as a plurality of planes that are generated responsive to identification of at least one of a foveated region, a predicted point of focus, a region with high contrast edges, and a hint from software and/or hardware.

17. The non-transitory computer readable storage medium as recited in claim 14 , wherein the program instructions are executable by a processor to:
compress each of the plurality of planes with a given compression level; and
separately transmit each of the plurality of planes via a wireless connection.

18. The non-transitory computer readable storage medium as recited in claim 14 , wherein the program instructions are executable by a processor to insert, in the multi-plane information, identification and a location in a video frame for each of the plurality of planes.

19. The non-transitory computer readable storage medium as recited in claim 14 , wherein the program instructions are executable by a processor to determine which regions of the frame qualify to be planes based on one or more of a level of contrast of a region, moving objects in a particular region, and objects in a region predicted to be points of focus.

20. The non-transitory computer readable storage medium as recited in claim 14 , wherein the program instructions are executable by a processor to:
decode each of the plurality of planes; and
inset each of the plurality of planes on any lower resolution planes of the plurality of planes.

Assignees

• Advanced Micro Devices Inc

Inventors

• Li Adam H
• Naegle Nathaniel David

Classifications

• H04N19/174

  the region being a slice, e.g. a line of blocks or a group of blocks · CPC title

• H04N13/395

  with depth sampling, i.e. the volume being constructed from a stack or sequence of two-dimensional [2D] image planes · CPC title

• H04N19/59

  involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution · CPC title

• H04N19/176 Primary

  the region being a block, e.g. a macroblock · CPC title

• H04N19/23

  with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic · CPC title