Support of non-HEVC base layer in HEVC multi-layer extensions

Patent metadata

Field	Value
Publication number	US-10547834-B2
Application number	US-201514590914-A
Country	US
Kind code	B2
Filing date	Jan 6, 2015
Priority date	Jan 8, 2014
Publication date	Jan 28, 2020
Grant date	Jan 28, 2020

Abstract

An apparatus configured to decode video information includes a memory and a processor in communication with the memory. The memory is configured to a memory configured to store video information associated with bitstream. The apparatus further includes a processor in communication with the memory, the processor configured to determine that a reference layer is not included in the bitstream and to receive, from an external source, a decoded base layer picture. The processor is further configured to receive, from the external source, a first indication that the picture is an intra random access point (IRAP) picture. The processor is also configured to receive a second indication whether the picture is one of an instantaneous decoder refresh (IDR) picture, a clean random access (CRA) picture, or a broken link access (BLA) picture; and to decode the video information based at least in part on the first and second indications.

First claim

What is claimed is:

1. A method of decoding video information via a H.265/High Efficiency Video Coding (HEVC) decoder, the method comprising:
receiving, via a receiver, one or more video blocks of one or more coded pictures associated with one or more enhancement layers based on a H.265/HEVC standard and a multi-layer extension thereof;
determining, via a processor of the H.265/HEVC decoder, that the one or more video blocks do not belong to coded pictures associated with a base layer, wherein the base layer is decoded according to a H.264/Advanced Video Coding (AVC) codec;
receiving, via the receiver and from an external source that is external to the H.265/HEVC decoder, a decoded base layer picture;
receiving, via the receiver and from the external source, a flag that indicates whether the decoded base layer picture is an intra random access point (IRAP) picture;
based on the flag indicating that the decoded base layer picture is an IRAP picture, receiving, via the receiver and from the external source, a value of a Network Abstraction Layer (NAL) unit type of the decoded base layer picture, wherein the value of the NAL unit type of the decoded base layer picture is required to be equal to one of IDR_W_RADL, CRA_NUT, and BLA_W_LP, and wherein:
the value of the NAL unit type of the decoded base layer picture being equal to IDR_W_RADL specifies that the decoded base layer picture is an instantaneous decoder refresh (IDR) picture and was decoded from a H.264/AVC IDR picture,
the value of the NAL unit type of the decoded base layer picture being equal to CRA_NUT specifies that the decoded base layer picture is a clean random access (CRA) picture and was decoded from a H.264/AVC coded picture that was associated with a H.264/AVC recovery point SEI message with recovery_frame_cnt equal to 0 and broken_link_flag equal to 0, and
the value of the NAL unit type of the decoded base layer picture being equal to BLA_W_LP indicates that the decoded base layer picture is a broken link access (BLA) picture and was decoded from a H.264/AVC coded picture that was associated with a H.264/AVC recovery point SEI message with recovery_frame_cnt equal to 0 and broken_link_flag equal to 1;

decoding, via the processor, the one or more coded pictures based at least in part on the flag and the NAL unit type of the decoded base layer picture received from the external source; and
displaying the decoded one or more coded pictures on a display device.

2. The method of claim 1 , wherein said determining that the received one or more video blocks do not belong to coded pictures associated with the base layer is based upon a value included in one of a video parameter set (VPS), a sequence parameter set (SPS), a picture parameter set (PPS), or an adaptation parameter set (APS).

3. The method of claim 1 , wherein the external source is a second decoder.

4. The method of claim 1 , wherein the flag has a value of either 1 or 0 to indicate that the decoded base layer picture is the IRAP picture.

5. An apparatus configured to decode video information, the apparatus comprising:
a memory configured to store information associated with one or more video blocks of one or more coded pictures associated with one or more enhancement layers based on a H.265/High Efficiency Video Coding (HEVC) standard and a multi-layer extension thereof; and
a receiver in communication with the memory, the receiver configured to:
receive the one or more video blocks;
receive, from an external source that is external to a H.265/HEVC decoder, a decoded base layer picture;
receive, from the external source, a flag that indicates whether the decoded base layer picture is an intra random access point (IRAP) picture;
based on the flag indicating that the decoded base layer picture is an IRAP picture, receive, from the external source, a value of a Network Abstraction Layer (NAL) unit type of the decoded base layer picture, wherein the value of the NAL unit type of the decoded base layer picture is required to be equal to one of IDR_W_RADL, CRA_NUT, and BLA_W_LP, and wherein:
the value of the NAL unit type of the decoded base layer picture being equal to IDR_W_RADL specifies that the decoded base layer picture is an instantaneous decoder refresh (IDR) picture and was decoded from a H.264/Advanced Video Coding (AVC) picture,
the value of the NAL unit type of the decoded base layer picture being equal to CRA_NUT specifies that the decoded base layer picture is a clean random access (CRA) picture and was decoded from a H.264/AVC coded picture that was associated with a H.264/AVC recovery point SEI message with recovery_frame_cnt equal to 0 and broken_link_flag equal to 0, a
the value of the NAL unit type of the decoded base layer picture being equal to BLA_W_LP indicates that the decoded base layer picture is a broken link access (BLA) picture and was decoded from a H.264/AVC coded picture that was associated with a H.264/AVC recovery point SEI message with recovery_frame_cnt equal to 0 and broken_link_flag equal to 1; and

a processor of the H.265/HEVC decoder in communication with the memory and the receiver, the processor configured to:
determine that the one or more video blocks do not include coded pictures associated with a base layer, wherein the base layer is decoded according to an H.264/AVC codec;
decode the one or more coded pictures based at least in part on the flag and the NAL unit type of the decoded base layer picture received from the external source; and
display the decoded one or more pictures on a display device.

6. The apparatus of claim 5 , wherein the determination that the one or more video blocks do not belong to coded pictures associated with the base layer is based upon a value included in one of a video parameter set (VPS), a sequence parameter set (SPS), a picture parameter set (PPS), or an adaptation parameter set (APS).

7. The apparatus of claim 5 , wherein the external source is a second decoder.

8. The apparatus of claim 5 , wherein the flag has a value of either 1 or 0 to indicate that the decoded base layer picture is the IRAP picture.

9. A non-transitory computer readable medium comprising code that, when executed, causes an apparatus to:
receive, via a receiver, one or more video blocks of one or more coded pictures associated with one or more enhancement layers based on a H.265/High Efficiency Video Coding (HEVC) standard and a multi-layer extension thereof;
determine, via a processor, that the one or more video blocks do not belong to coded pictures associated with a base layer, wherein the base layer is decoded according to a H.264/Advanced Video Coding (AVC) codec;
receive, via the receiver and from an external source that is external to the apparatus, a decoded base layer picture;
receive, via the receiver and from the external source, a flag that indicates whether the decoded base layer picture is an intra random access point (IRAP) picture;
based on the flag indicating that the decoded base layer picture is an IRAP picture, receive, via the receiver and from the external source, a value of a Network Abstraction Layer (NAL) unit type of the decoded base layer picture, wherein the value of the NAL unit type of the decoded base layer picture is required to be equal to one of IDR_W_RADL, CRA_NUT, and BLA_W_LP, and wherein:
the value of the NAL unit type of the decoded base layer picture being equal to IDR_W_RADL specifies that the decoded base layer picture is an instantaneous decoder refresh (IDR) picture and was decoded from a H.264/AVC IDR picture,
the value of the NAL unit type of the decoded base layer picture being equal to CRA_NUT specifies that the decoded base layer picture is a clean random access (CRA) picture and was decoded from

Assignees

• Qualcomm Inc

Inventors

• Wang Ye-Kui

Classifications

• H04N19/29

  involving scalability at the object level, e.g. video object layer [VOL] · CPC title

• H04N19/59

  involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution · CPC title

• H04N19/105 Primary

  Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction · CPC title

• H04N19/136

  Incoming video signal characteristics or properties · CPC title

• H04N19/39

  involving multiple description coding [MDC], i.e. with separate layers being structured as independently decodable descriptions of input picture data · CPC title