Video encoder with adjustable intra-refresh rate

Patent metadata

Field	Value
Publication number	US-9955158-B2
Application number	US-201615230457-A
Country	US
Kind code	B2
Filing date	Aug 7, 2016
Priority date	Sep 1, 2015
Publication date	Apr 24, 2018
Grant date	Apr 24, 2018

Abstract

An encoding system for converting video data to a media stream based on a given intra-refresh rate includes an encoder for encoding the video data to frames based on the given intra-refresh rate, a decoder for reconstructing the encoded frames, and an evaluation unit for scoring macro blocks (MBs) of a current frame being decoded. A score of an intra-MB is defined as a predetermined value, and a score of an inter-MB is generated based on the scores of MBs of previous frames. A controller determines an actual refresh period based on a qualified frame identified based on the scores of the MBs of at least the current frame, and adjusts the given intra-refresh rate based on the actual refresh period.

First claim

The invention claimed is:

1. An encoding system for encoding a video source to a media stream that includes a plurality of frames, comprising:
an encoder that includes:
an encoding unit for converting the video source to the plurality of frames based on a given intra-refresh rate, wherein each frame comprises a plurality of macro blocks (MBs) including a first number of intra-MBs that are decoded based on information in the frame, and a second number of inter-MBs that are decoded based on information in previous frames, wherein the proportion of the first number of intra-MBs of the frame is determined by the given intra-refresh rate, and
a decoding unit connected to the encoding unit for providing the information in the previous frames;

an evaluation unit connected to the encoder for scoring a plurality of the MBs of a current frame that is being decoded by the decoding unit, wherein a score of an intra-MB is defined as a predetermined value, and a score of an inter-MB is generated based on scores of MBs of the previous frames; and
a controller connected between the encoder and the evaluation unit for identifying a qualified frame based on the scores of the plurality of MBs in at least the current frame, determining an actual refresh period based on the qualified frame, and adjusting the given intra-refresh rate at least based on the actual refresh period.

2. The encoding system of claim 1 , wherein at the beginning of said encoding, the given intra-refresh rate is an initial intra-refresh rate based on a target refresh period.

3. The encoding system of claim 1 , wherein each inter-MB comprises at least one prediction block, wherein each prediction block is decoded based on a corresponding reference block in a corresponding reference frame determined by a motion vector of the prediction block, wherein scoring an inter-MB comprises:
identifying the corresponding reference block of each prediction block of the inter-MB in a corresponding reference frame based on the motion vector;
breaking down the corresponding reference block of each prediction block into a plurality of portions respectively located within corresponding MBs of the reference frame;
calculating a score of each portion based on the score of the corresponding MB, a proportion of an area of the portion and an area of the corresponding MB, and quality distribution among the corresponding MB and MBs adjacent thereto;
generating a score for each prediction block based on the scores of the plurality of portions of each prediction block; and
generating the score of the inter-MB by summing the scores of the at least one prediction block of the inter-MB.

4. The encoding system of claim 3 , wherein if the reference blocks of the prediction blocks in the inter-MB belong to more than one reference frame, said summing the scores of the prediction blocks of the inter-MB comprises weighting the scores of the prediction blocks with corresponding weight coefficients of the more than one reference frames.

5. The encoding system of claim 1 , wherein the current frame is identified as the qualified frame if MBs that have scores below a predetermined threshold are out of a predetermined region of the current frame, or a distance between a position of a first MB that has the lowest score among the MBs in the current frame and a position of a second MB that has the lowest score among the MBs in a last frame is greater than a predetermined distance.

6. The encoding system of claim 1 , further comprising a memory coupled to the evaluation unit for storing the scores of the MBs of the previously decoded frames.

7. The encoding system of claim 6 , wherein the qualified frame is identified based on a frame score of at least one of the current frame and the previously decoded frames, wherein the frame score of each frame is determined based on scores of the MBs in the frame.

8. The encoding system of claim 7 , wherein the frame score of each frame is determined as a weighted sum of scores of the MBs in the frame, wherein a weight coefficient of each MB is based on a region of interest, and stored in the memory.

9. The encoding system of claim 7 , wherein the current frame is identified as the qualified frame if the frame score of the current frame is greater than a predetermined threshold.

10. The encoding system of claim 7 , wherein one of the current frame and a last frame is identified as the qualified frame if a difference of the frame scores of the current frame and the last frame is less than a predetermined threshold.

11. The encoding system of claim 7 , wherein one of the current frame and the last two frames is identified as the qualified frame if a difference between a difference of the frame scores of the current frame and the last frame, and a difference of the frame scores of the last and the second to last frame is less than a predetermined threshold.

12. A method for encoding a video source to a media stream that includes a plurality of frames, comprising:
encoding the video source to the plurality of frames based on a given intra-refresh rate, wherein each frame comprises a plurality of macro blocks (MBs) including a first number of intra-MBs that are decoded based on information in the frame, and a second number of inter MBs that are decoded based on information in previous frames, wherein the proportion of the first number of intra-MBs of the frame is determined by the given intra-refresh rate;
decoding the plurality of frames;
calculating scores of a plurality of the MBs in a current frame that is being decoded, wherein a score of an intra-MB is defined as a predetermined value, and a score of an inter-MB is determined based on scores of MBs of the previously decoded frames;
identifying a qualified frame based on the scores of the plurality of MBs of at least the current frame;
determining an actual refresh period based on the qualified frame; and
adjusting the given-intra refresh rate at least based on the actual refresh period.

13. The method of claim 12 , wherein at a beginning of said encoding, the given intra-refresh rate is an initial intra-refresh rate based on a target refresh period.

14. The method of claim 12 , wherein each MB comprises at least one prediction block, wherein each prediction block is decoded based on a corresponding reference block in a corresponding reference frame determined by a motion vector of the prediction block, and wherein calculating the score of an inter-MB in the current frame comprises:
identifying the corresponding reference block of each prediction block of the inter-MB based on the motion vector in a corresponding reference frame,
breaking down the corresponding reference block of each prediction block into a plurality of portions that are respectively located within corresponding MBs of the corresponding reference frame,
calculating a score of each portion based on the score of the corresponding MB, a proportion of an area of the portion and an area of the corresponding MB, and a quality distribution among the corresponding MB and MBs adjacent thereto,
calculating a score of each prediction block based on scores of the plurality of portions of the prediction block, and
calculating a score of the inter-MB by summing the scores of the at least one prediction block in the inter-MB.

15. The method of claim 14 , wherein if the reference blocks of the prediction blocks in the inter-MB belong to more than one reference frame, then said summing the scores of the prediction blocks in the inter-MB comprises weighting the scores of the prediction blocks with corresponding weight coefficients of the reference frames.

Assignees

• Freescale Semiconductor Inc
• Nxp Usa Inc

Inventors

• Yang Hongzhang
• Wang Zening
• Zhou Peng

Classifications

• H04N19/172

  the region being a picture, frame or field · CPC title

• H04N19/107 Primary

  between spatial and temporal predictive coding, e.g. picture refresh · CPC title

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title