System and method for indicating temporal layer switching points

Patent metadata

Field	Value
Publication number	US-9712833-B2
Application number	US-21524408-A
Country	US
Kind code	B2
Filing date	Jun 25, 2008
Priority date	Jun 26, 2007
Publication date	Jul 18, 2017
Grant date	Jul 18, 2017

Abstract

Disclosed are a system, apparatus, computer programs and methods for indicating proper temporal layer switching points for temporal scalable coding. Various embodiments provide an apparatus and method for properly indicating temporal layer switching points in a scalable video bit stream or in a scalable video file container. Using these indications, a decoder can determine where to perform temporal layer switching, after which all of the pictures at and below the desired temporal layer can be correctly decoded.

First claim

What is claimed is:

1. A method, comprising:
encoding, with an encoder, a temporal scalable video bit stream including an indication of at least one temporal layer switching point from a first temporal layer to a second temporal layer, where the indication indicates a difference of frame number values between a current layer representation in the first temporal layer and a required layer representation in the second temporal layer, and includes information concerning where decoding of the first temporal layer should start to enable switching from the first temporal layer to the second temporal layer at the at least one temporal layer switching point, and wherein the indication determines where to perform temporal layer switching after which pictures in the temporal scalable video bit stream can be correctly decoded; and
at least one of storing the encoded video bit stream and sending the encoded video bit stream to a decoder.

2. The method of claim 1 , where the indication comprises a temporal layer switching point supplemental enhancement information message.

3. The method of claim 2 , where the temporal layer switching point supplemental enhancement information message is not included in a scalable nesting supplemental enhancement information message.

4. The method of claim 3 , where the temporal layer switching point supplemental enhancement information message applies to a target layer representation comprising network abstraction layer NAL units with a nal_unit_type in the range of 1 to 5, inclusive, of an access unit containing the temporal layer switching point supplemental enhancement information message.

5. The method of claim 2 , where the temporal layer switching point supplemental enhancement information message is included in a scalable nesting supplemental enhancement information message.

6. The method of claim 5 , where the temporal layer switching point supplemental enhancement information message applies to layer representations having dependency_id, quality_id, and temporal_id equal to dependency_id[i], quality_id[i], and temporal_id, respectively, as indicated in the scalable nesting supplemental enhancement information message.

7. The method of claim 1 , where the indication comprises a box containing:
a plurality of sample numbers;
for each sample number, dependency_id and quality_id values for a respective temporal switching point layer representation; and
for each combination of dependency_id and quality_id values, a target sample number.

8. A computer program embodied in a non-transitory computer-readable storage medium, configured to perform the method of claim 1 .

9. The method of claim 1 , where the encoder is connected to a plurality of video sources corresponding to a plurality of cameras each pointed in a fixed direction, where the first and second temporal layers comprise a group of presentations from the plurality of video sources.

10. An apparatus, comprising:
a processor; and
a memory communicatively connected to the processor and including computer code, the computer code executable by the processor to cause the apparatus to:
encode a temporal scalable video bit stream including an indication of at least one temporal layer switching point from a first temporal layer to a second temporal layer, where the indication indicates a difference of frame number values between a current layer representation in the first temporal layer and a required layer representation in the second temporal layer, and includes information concerning where decoding of the first temporal layer should start to enable switching from the first temporal layer to the second temporal layer at the at least one temporal layer switching point, and wherein the indication determines where to perform temporal layer switching after which pictures in the temporal scalable video bit stream can be correctly decoded.

11. The apparatus of claim 10 , where the indication comprises a temporal layer switching point supplemental enhancement information message.

12. The apparatus of claim 11 , where the temporal layer switching point supplemental enhancement information message is not included in a scalable nesting supplemental enhancement information message.

13. The apparatus of claim 12 , where the temporal layer switching point supplemental enhancement information message applies to a target layer representation comprising network abstraction layer NAL units with a nal_unit_type in the range of 1 to 5, inclusive, of an access unit containing the temporal layer switching point supplemental enhancement information message.

14. The apparatus of claim 11 , where the temporal layer switching point supplemental enhancement information message is included in a scalable nesting supplemental enhancement information message.

15. The apparatus of claim 14 , where the temporal layer switching point supplemental enhancement information message applies to layer representations having dependency_id, quality_id, and temporal_id equal to dependency_id[i], quality_id[i], and temporal_id, respectively, as indicated in the scalable nesting supplemental enhancement information message.

16. The apparatus of claim 10 , where the indication comprises a box containing:
a plurality of sample numbers;
for each sample number, dependency_id and quality_id values for a respective temporal switching point layer representation; and
for each combination of dependency_id and quality_id values, a target sample number.

17. An apparatus, comprising:
means for encoding a temporal scalable video bit stream including an indication of at least one temporal layer switching point from a first temporal layer to a second temporal layer, where the indication indicates a difference of frame number values between a current layer representation in the first temporal layer and a required layer representation in the second temporal layer, and includes information concerning where decoding of the first temporal layer should start to enable switching from the first temporal layer to the second temporal layer at the at least one temporal layer switching point, and wherein the indication determines where to perform temporal layer switching after which pictures in the temporal scalable video bit stream can be correctly decoded; and
means for at least one of storing the encoded video bit stream and sending the encoded video bit stream to a decoder.

18. The apparatus of claim 17 , where the indication comprises a temporal layer switching point supplemental enhancement information message.

19. A method, comprising:
receiving, via an interface, a temporal scalable video bit stream that includes an indication of at least one temporal layer switching point from a first temporal layer to a second temporal layer, where the indication indicates a difference of frame number values between a current layer representation in the first temporal layer and a required layer representation in the second temporal layer and includes information concerning where decoding of the first temporal layer should start to enable switching from the first temporal layer to the second temporal layer at the at least one temporal layer switching point, and wherein the indication determines where to perform temporal layer switching after which pictures in the temporal scalable video bit stream can be correctly decoded; and
decoding, based on at least the received information, the received temporal scalable video bit stream.

20. The method of claim 19 , where the indication comprises a temporal layer switching p

Assignees

• Wang Ye-Kui
• Hannuksela Miska
• Nokia Technologies Oy

Inventors

• Wang Ye-Kui
• Hannuksela Miska

Classifications

• H04N19/31 Primary

  in the temporal domain · CPC title

• H04N19/70

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title