Video pipeline with direct linkage between decoding and post processing

Patent metadata

Field	Value
Publication number	US-9351011-B2
Application number	US-201213687093-A
Country	US
Kind code	B2
Filing date	Nov 28, 2012
Priority date	Nov 28, 2012
Publication date	May 24, 2016
Grant date	May 24, 2016

Abstract

In general, in one aspect, a decode order for a group of picture (GOP) frame structure for a video stream is modified to include regenerated P frames. The modified decode order includes a regenerated P frame of a P frame decoded prior to a sequence of B frames after last B frame in the sequence of B frames and before next I or P frame. The frames are decoded in modified decode order by a decode engine. The decoded frames are post processed in a display order (only includes regenerated P frames and does not include initial P frames defined in the decode order) by a post processing engine. The post processing engine may ignore the initial P frames or the decode engine may not forward the initial P frames to the post processing engine. The post processed frames may be prepared for presentation by a display engine.

First claim

What is claimed:

1. A method comprising:
receiving an encoded video bit stream;
determining a decode order for a group of picture (GOP) frame structure defined in the video bit stream, wherein the GOP frame structure includes an I frame, a plurality of P frames and a plurality of B frames, wherein the decode order for the GOP frame structure includes
the I frame,
a first P frame of the plurality of P frames,
a first subset of the plurality of B frames, wherein the first subset is associated with the I frame and the first P frame,
at least a second P frame, and
at least a second subset of B frames, wherein the second subset is associated with the first P frame and the second P frame;

decoding encoded frames received in the video bit stream per the decode order;
inserting additional decoded P frames that are same as decoded P frames including inserting an additional first decoded P frame after the first decoded subset of B frames and at least an additional second decoded P frame after the second decoded subset of B frames;
forwarding the decoded frames, including the additional decoded P frames, for further processing on the decoded frames in a display order, that is different than the decode order, without requiring the decoded frames to be stored in memory or reordered from the order they were decoded and forwarded;
receiving the forwarded decoded frames, wherein the forwarded decoded frames received have not be reordered from those that were decoded and forwarded;
post processing the received decoded frames, excluding the first decoded P frame and at least the second decoded P frame, wherein by excluding the decoded P frames the decoded frames are processed in the display order, wherein the display order for the GOP frame structure includes
the I frame,
the first subset of B frames,
the additional first decoded P frame,
at least the second subset of B frames, and
at least the additional second decoded P frame; and

preparing the post-processed frames for presentation on a display.

2. The method of claim 1 , wherein the inserting includes decoding the encoded P frames for a second time to create the additional decoded P frames.

3. The method of claim 1 , wherein the inserting includes temporarily storing decoded P frames and inserting the stored decoded P frames as the additional decoded P frames.

4. The method of claim 1 , wherein the forwarding the decoded frames includes forwarding the decoded frames excluding the decoded P frames.

5. The method of claim 4 , wherein the excluding the decoded P frames includes excluding the decoded P frames that do not match a display order for the GOP frame structure.

6. The method of claim 1 , wherein the determining the decode order, the decoding encoded frames, and the inserting the additional decoded P frames are performed by a decode engine.

7. The method of claim 1 , wherein the excluding the decoded P frames is performed by a post processing engine.

8. The method of claim 1 , wherein the determining the decode order, the decoding encoded frames, the inserting the additional decoded P frames, and the forwarding the decoded P frames are performed by a decode engine.

9. A video pipeline comprising:
a decode engine to:
receive an encoded video bit stream;
determine a decode order for a group of picture (GOP) frame structure for the video bit stream, wherein the GOP frame structure includes an I frame, a plurality of P frames and a plurality of B frames, wherein the decode order for the GOP frame structure includes
the I frame,
a first P frame of the plurality of P frames,
a first subset of the plurality of B frames, wherein the first subset is associated with the I frame and the first P frame,
at least a second P frame, and
at least a second subset of B frames, wherein the second subset is associated with the first P frame and the second P frame;

decode encoded frames received in the video bit stream per the decode order;
insert additional decoded P frames that are same as decoded P frames including an additional first decoded P frame after the first decoded subset of B frames and at least an additional second decoded P frame after the second decoded subset of B frames; and

forward the decoded frames, including the additional decoded P frames for further processing in a display order, that is different than the decode order, without requiring the decoded frames to be stored in memory or reordered from the order they were decoded and forwarded;
a post processing engine to:
receive the forwarded decoded frames directly from the decode engine, wherein the forwarded decoded frames received have not be reordered from those that were decoded and forwarded from the decode engine; and
perform post processing on the received decoded frames, excluding the first decoded P frame and at least the second decoded P frame, wherein by excluding the decoded P frames the decoded frames are processed in the display order, wherein the display order for the GOP frame structure includes
the I frame,
the first subset of B frames,
the additional first decoded P frame,
at least the second subset of B frames, and
at least the additional second decoded P frame; and

a display engine to prepare the post-processed frames for presentation on a display device.

10. The video pipeline of claim 9 , wherein the decode engine is further to
decode the first P frame a second time; and
decode at least the second P frame a second time.

11. The video pipeline of claim 9 , wherein the decode engine is further to
temporarily store the first decoded P frame and at least the second decoded P frame; and
insert the temporality stored first decoded P frame as the additional first decoded P frame and at least the temporarily stored second decoded P frame as at least the additional second decoded P frame.

12. The video pipeline of claim 9 , wherein the post processing engine is to ignore the decoded P frames that do not match the display order.

13. The video pipeline of claim 9 , wherein the post processing engine is to discard the decoded P frames that do not match the display order.

14. The video pipeline of claim 9 , wherein the decode engine is to forward the decoded frames to the post processing engine excluding the decoded P frames.

15. A system comprising:
a video source to provide a video stream;
a host processor;
a video pipeline including:
a decode engine to
determine a decode order for a group of picture (GOP) frame structure for the video stream, wherein the GOP frame structure includes an I frame, a plurality of P frames and a plurality of B frames, wherein the decode order for the GOP frame structure includes
the I frame,
a first P frame of the plurality of P frames,
a first subset of the plurality of B frames, wherein the first subset is associated with the I frame and the first P frame,
at least a second P frame, and
at least a second subset of B frames, wherein the second subset is associated with the first P frame and the second P frame;

decode encoded frames received in the video bit stream per the decode order; and
insert additional decoded P frames that are same as decoded P frames including an additional first decoded P frame after the first decoded subset of B frames and at least an additional second decoded P frame after the second decoded subset of B frames;

a post processing engine to perform post processing on the decoded frames, excluding the first decoded P frame and at least the second decoded P frame, wherein by excluding the decoded P frames the decoded frames are processed in a display order for the GOP frame s

Assignees

• Nanda Akshat
• Janus Scott
• Cheng Scott W
• Intel Corp

Inventors

• Nanda Akshat
• Janus Scott
• Cheng Scott W

Classifications

• H04N19/42

  characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation (H04N19/635 takes precedence) · CPC title

• H04N19/44 Primary

  Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder · CPC title

• H04N19/85

  using pre-processing or post-processing specially adapted for video compression · CPC title