Systems and methods for versatile video coding

Patent metadata

Field	Value
Publication number	US-12395680-B2
Application number	US-202017761754-A
Country	US
Kind code	B2
Filing date	Sep 18, 2020
Priority date	Sep 19, 2019
Publication date	Aug 19, 2025
Grant date	Aug 19, 2025

Abstract

Described herein are systems, methods, and instrumentalities associated with video coding. The signaling of certain syntax elements may be moved from a slice header to a picture header and/or a layer access unit delimiter (AUD). The dependency between AUD and one or more parameter sets may be explored. Syntax elements may be signaled to enable wrap-around motion compensation for certain sub-picture(s) and specify wrap-around motion compensation offsets for the sub-picture(s).

First claim

What is claimed is:

1. A video decoding device, comprising:
a processor configured to:
obtain a video bitstream associated with a picture, wherein the picture is partitioned into multiple sub-pictures and wherein the video bitstream indicates whether respective sub-picture identifiers (IDs) of the multiple sub-pictures are signaled in the video bitstream, the video bitstream further indicating whether at least one sub-picture of the multiple sub-pictures is treated as a picture and whether wrap-around motion compensation is enabled for the at least one sub-picture;
determine the respective sub-picture IDs of the multiple sub-pictures from the video bitstream in response to determining, based on the video bitstream, that the respective sub-picture IDs are signaled in the video bitstream; and
in response to determining, based on the video bitstream, that the at least one sub-picture is treated as a picture and that wrap-around motion compensation is enabled for the at least one sub-picture:
determine a wrap-around offset applicable to the at least one sub-picture;
decode the picture associated with the bitstream based at least on the respective sub-picture IDs of the multiple sub-pictures and the determined wrap-around offset.

2. The video decoding device of claim 1 , wherein, in response to determining that the respective sub-picture IDs are not signaled in the video bitstream, the processor is configured to determine the respective sub-picture IDs of the multiple sub-pictures based on a sequence of index values that range from 0 to a total number of sub-pictures included in the picture minus 1.

3. The video decoding device of claim 1 , wherein whether the at least one sub-picture is treated as a picture and whether wrap-around motion compensation is enabled for the at least one sub-picture are indicated in a sequence parameter set of the video bitstream.

4. The video decoding device of claim 1 , wherein whether the at least one sub-picture is treated as a picture and whether wrap-around motion compensation is enabled for the at least one sub-picture are indicated in a picture parameter set of the video bitstream.

5. The video decoding device of claim 1 , wherein each of the multiple sub-pictures includes one or more slices that collectively cover a region of the picture associated with the video bitstream.

6. The video decoding device of claim 1 , wherein the picture associated with the video bitstream is partitioned into a grid comprising the multiple sub-pictures, and wherein each of the sub-picture IDs indicates a position of the corresponding sub-picture in the grid.

7. The video decoding device of claim 1 , wherein whether wrap-around motion compensation is enabled for the at least one sub-picture applies to whether horizontal wrap-around motion compensation is enabled for the at least one sub-pictures.

8. The video decoding device of claim 1 , wherein the processor being configured to decode the picture associated with the video bitstream comprises the processor being-configured to perform wrap-around motion compensation for the at least one sub-picture based on the determined wrap-around offset.

9. The video decoding device of claim 8 , wherein the wrap-around offset is used to interpolate a luma sample associated with the at least one sub-picture.

10. A method of video decoding, the method comprising:
obtaining a video bitstream associated with a picture, wherein the picture is partitioned into multiple sub-pictures and wherein the video bitstream indicates whether respective sub-picture identifiers (IDs) of the multiple sub-pictures are signaled in the video bitstream, the video bitstream further indicating whether at least one sub-picture of the multiple sub-pictures is treated as a picture and whether wrap-around motion compensation is enabled for the at least one sub-picture;
determining the respective sub-picture IDs of the multiple sub-pictures from the video bitstream in response to determining, based on the video bitstream, that the respective sub-picture IDs are signaled in the video bitstream; and
in response to determining, based on the video bitstream, that the at least one sub-picture is treated as a picture and that wrap-around motion compensation is enabled for the at least one sub-picture:
determine a wrap-around offset applicable to the at least one sub-picture;
decoding the picture associated with the bitstream based at least on the sub-picture IDs of the multiple sub-pictures and the determined wrap-around offset.

11. The method of claim 10 , further comprising, in response to determining that the respective sub-picture IDs are not signaled in the video bitstream, determining the respective sub-picture IDs of the multiple sub-pictures based on a sequence of index values that range from 0 to a total number of sub-pictures included in the picture minus 1.

12. The method of claim 10 , wherein whether the at least one sub-picture is treated as a picture and whether wrap-around motion compensation is enabled for the at least one sub-picture are indicated in a sequence parameter set of the video bitstream.

13. The method of claim 10 , wherein whether the at least one sub-picture is treated as a picture and whether wrap-around motion compensation is enabled for the at least one sub-picture are indicated in a picture parameter set of the video bitstream.

14. The method of claim 10 , wherein each of the multiple sub-pictures includes one or more slices that collectively cover a region of the picture associated with the video bitstream.

15. The method of claim 10 , wherein the picture associated with the video bitstream is partitioned into a grid comprising the multiple sub-pictures, and wherein each of the sub-picture IDs indicates a position of the corresponding sub-picture in the grid.

16. The method of claim 10 , wherein whether wrap-around motion compensation is enabled for the at least one sub-picture applies to whether horizontal wrap-around motion compensation is enabled for the at least one sub-pictures.

17. The method of claim 16 , wherein decoding the picture associated with the video bitstream comprises performing the wrap-around motion compensation for the at least one sub-picture based on the determined wrap-around offset.

18. The method of claim 17 , wherein the wrap-around offset is used to interpolate a luma sample associated with the at least one sub-picture.

19. A video encoding device, comprising:
a processor configured to:
partition a picture into multiple sub-pictures;
based on a determination to include respective sub-picture identifiers (IDs) of the multiple sub-pictures in a video bitstream:
determine the respective sub-picture IDs of the multiple sub-pictures;
include the determined sub-picture IDs of the multiple sub-pictures in the video bitstream; and
add a first indication to the video bitstream indicating that the respective sub-picture IDs of the multiple sub-pictures are signaled in the video bitstream; and

based on a determination to treat at least one sub-picture of the multiple sub-pictures as a picture and to enable wrap-around motion compensation for the at least one sub-picture:
add a second indication to the video bitstream indicating that the at least one sub-picture is treated as a picture; and
add a third indication to the video bitstream indicating that wrap-around motion compensation is enabled for the at least one sub-picture.

20. The video encoding device of claim 19 , wherein the first indication, the second indication and the third

Assignees

• Vid Scale Inc
• Interdigital Madison Patent Holdings Sas

Inventors

• He Yong
• He Yuwen

Classifications

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N19/169

  characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding · CPC title

• H04N19/174

  the region being a slice, e.g. a line of blocks or a group of blocks · CPC title

• H04N19/136

  Incoming video signal characteristics or properties · CPC title

• H04N19/105 Primary

  Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction · CPC title