Method and apparatus for decoding an enhanced video stream

Patent metadata

Field	Value
Publication number	US-9854272-B2
Application number	US-201514862200-A
Country	US
Kind code	B2
Filing date	Sep 23, 2015
Priority date	Mar 6, 2008
Publication date	Dec 26, 2017
Grant date	Dec 26, 2017

Abstract

A method of decoding an enhanced video stream composed of base layer video access units and enhancement layer video access units, each access unit comprising a plurality of syntax structures, includes passing the syntax structures of the base layer access units to a base layer buffer, passing syntax structures of the enhancement layer access units to an enhancement layer buffer, outputting the syntax structures passed to the base layer buffer in a predetermined sequence, outputting the syntax structures passed to the enhancement layer buffer in a predetermined sequence, and recombining the sequences of syntax structures output by the base layer buffer and the enhancement layer buffer respectively to form a complete enhanced access unit, composed of base layer syntax structures and enhancement layer syntax structures in a predetermined sequence.

First claim

The invention claimed is:

1. A method of decoding an enhanced video stream, the method comprising:
receiving a multiplexed transport stream conveying, in a plurality of packetized elementary streams, base layer video access units and enhancement layer video access units, each access unit comprising a plurality of syntax structures,
wherein said multiplexed transport stream conveys, with different respective program identifiers, the syntax structures of the base layer access units and remaining syntax structures other than those of the base layer access units, and
wherein the remaining syntax structures comprise a delimiting syntax structure marking a boundary of video layer syntax structures of the access unit;

demultiplexing the transport stream to create at least two program streams based on the different respective program identifiers;
passing the syntax structures of the base layer access units to a base layer buffer;
passing syntax structures of the enhancement layer access units to an enhancement layer buffer;
outputting the syntax structures passed to the base layer buffer in a predetermined sequence;
outputting the syntax structures passed to the enhancement layer buffer in a predetermined sequence; and
recombining the sequences of syntax structures output by the base layer buffer and the enhancement layer buffer respectively to form a complete enhanced access unit, comprising base layer syntax structures and enhancement layer syntax structures in a predetermined sequence.

2. A method according to claim 1 , wherein the enhanced video stream conveys a succession of enhanced access units each comprising a base layer access unit and at least one enhancement layer access unit, and the method further comprises separating the syntax structures of the base layer access units from the succession of enhanced access units.

3. A method according to claim 2 , wherein the syntax structures of the enhancement layer access units comprise video layer syntax structures and non-video layer syntax structures, and the step of separating the syntax structures of the base layer access units from the succession of enhanced access units includes separating non-video layer syntax structures of the enhancement layer access units from the succession, whereby the syntax structures passed to the base layer butler include enhancement layer non-video syntax structures, and wherein all the video layer syntax structures of the enhancement layer access units pass to the enhancement layer buffer.

4. A method according to claim 2 , wherein the syntax structures of an enhancement layer access unit in the succession of enhanced access units comprise video layer syntax structures, non-video layer syntax structures, and the delimiting syntax structure marking a boundary of the video layer syntax structures of the access unit, and the step of separating the syntax structures of the base layer access units from the unitary succession of access units includes passing syntax structures prior to the delimiting syntax structure to the base layer buffer and passing syntax structures after the delimiting syntax structure to the enhancement layer buffer.

5. A method according to claim 1 , wherein:
the step of passing the syntax structures of the base layer access units to the base layer buffer comprises passing a first program stream of the at least two program streams, the first program stream conveying the syntax structures of the base layer access units, to the base layer buffer; and
the step of passing the syntax structures of the enhancement layer access units to the enhancement layer buffer comprises passing remaining program streams of the at least two program streams to the enhancement layer buffer.

6. A method according to claim 1 , wherein the base layer buffer includes an elementary stream buffer segment and the enhancement layer buffer includes an elementary stream buffer segment, and the method comprises dynamically adjusting the combined sizes of the elementary stream buffer segments to optimize decoding of the enhanced video stream while restricting the maximum size of the elementary stream buffer segment of the base layer buffer.

7. A method according to claim 1 , comprising passing the complete enhanced access unit to a video decoder.

8. A method according to claim 1 , wherein the enhancement layer access units contain syntax structures of at least first and second enhancement layers, and the step of passing remaining syntax structures to an enhancement layer buffer includes passing syntax structures of the first and second enhancement layers to first and second enhancement layer buffers respectively.

9. A method according to claim 8 , wherein the enhanced video stream conveys a succession of enhanced access units each comprising a base layer access unit and at least first and second enhancement layer access units, and the method comprises separating the syntax structures of the base layer access units from the succession of enhanced access units.

10. A method according to claim 9 , wherein the syntax structures of each enhancement layer access unit comprise video layer syntax structures and non-video layer syntax structures, and the step of separating the syntax structures of the base layer access units from the succession of enhanced access units includes separating non-video layer syntax structures of the first and second enhancement layer access units from the succession, whereby the syntax structures passed to the base layer buffer include enhancement layer non-video syntax structures, and wherein all the video layer syntax structures of the first and second enhancement layer access units pass to the first and second enhancement layer buffers respectively.

11. A method according to claim 9 , wherein the syntax structures of an enhancement layer access unit in the succession of enhanced access units comprise video layer syntax structures, non-video layer syntax structures, and a delimiting syntax structure marking a boundary of the video layer syntax structures of the access unit, and the step of separating the syntax structures of the base layer access units from the unitary succession of access units includes passing syntax structures prior to the delimiting syntax structure to the base layer buffer and passing syntax structures after the delimiting syntax structure to the enhancement layer buffer.

12. A method according to claim 8 , comprising receiving a multiplexed transport stream conveying the syntax structures of the base layer access units with a first program identifier, syntax structures of the first enhancement layer with a second program, identifier, and syntax structures of the second enhancement layer with a third program identifier, demultiplexing transport stream to create at least first, second and third program streams based on the first, second and third program identifiers respectively, and passing the first, second and third program streams to the base layer buffer and the first and second enhancement layer buffer respectively.

13. A method according to claim 8 , wherein the base layer buffer includes an elementary stream buffer segment and the first and second enhancement layer buffers includes a first and second elementary stream buffer segments respectively, and the method comprises dynamically adjusting the combined sizes of the elementary stream buffer segments to optimize decoding of the enhanced video stream while restricting the maximum size of the elementary stream buffer segment of the base layer buffer.

14. A method according to claim 8 , comprising passing the complete enhanced access unit to a video decoder.

Assignees

• Arris Tech Inc
• Arris Entpr Inc

Inventors

• Narasimhan Mandayam A

Classifications

• H04N21/44004

  involving video buffer management, e.g. video decoder buffer or video display buffer · CPC title

• H04N21/4343

  Extraction or processing of packetized elementary streams [PES] · CPC title

• H04N19/70 Primary

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N19/187

  the unit being a scalable video layer · CPC title

• H04N19/423

  characterised by memory arrangements (H04N19/433 takes precedence) · CPC title