Interpolated video error concealment

Patent metadata

Field	Value
Publication number	US-9247243-B1
Application number	US-201213722614-A
Country	US
Kind code	B1
Filing date	Dec 20, 2012
Priority date	Jan 2, 2012
Publication date	Jan 26, 2016
Grant date	Jan 26, 2016

Abstract

Embodiments of the present disclosure provide a method that comprises receiving a first stream of video frames at a first frame rate and generating a second stream of video frames at a second frame rate. The method also comprises interpolating between a pair of adjacent video frames of the first stream of video frames to produce a first number of interpolated intermediate video frames in a particular sequence of the intermediate video frames. The method further comprises duplicating at least one of the adjacent video frames of the pair of adjacent video frames to produce a second number of duplicated intermediate video frames in the particular sequence of the intermediate video frames. The method further comprises, in response to a change in observed interpolation quality, dynamically changing the first number of interpolated intermediate video frames and the second number of duplicated intermediate video frames.

First claim

What is claimed is:

1. A method comprising:
receiving a first stream of video frames at a first frame rate;
generating a second stream of video frames at a second frame rate, wherein the second stream comprises (i) video frames of the first stream of video frames and (ii) sequences of intermediate video frames inserted between video frames of the first stream of video frames;
interpolating between a pair of adjacent video frames of the first stream of video frames to produce a first number of interpolated intermediate video frames in a particular sequence of the intermediate video frames;
duplicating at least one of the adjacent video frames of the pair of adjacent video frames to produce a second number of duplicated intermediate video frames in the particular sequence of the intermediate video frames;
receiving a plurality of interpolation quality values corresponding to one or more interpolated intermediate video frames;
temporally filtering the plurality of interpolation quality values to obtain observed interpolation quality; and
in response to a change in the observed interpolation quality, dynamically changing the first number of interpolated intermediate video frames and the second number of duplicated intermediate video frames in the second stream of video frames.

2. The method of claim 1 , wherein dynamically changing the first number of interpolated intermediate video frames and the second number of duplicated intermediate video frames comprises changing a ratio of the first number of interpolated intermediate video frames to the second number of duplicated intermediate video frames.

3. The method of claim 1 , further comprising:
in response to an increase in the observed interpolation quality, increasing the ratio of the first number of interpolated intermediate video frames to the second number of interpolated duplicated video frames; and
in response to a decrease in the observed interpolation quality, decreasing the ratio of the first number of interpolated intermediate video frames to the second number of duplicated intermediate video frames.

4. The method of claim 1 , wherein (i) the first number of interpolated intermediate video frames and (ii) the second number of duplicated intermediate video frames are greater than or equal to zero.

5. The method of claim 1 , wherein the interpolated intermediate video frames are calculated based on proportional temporal spacings of the interpolated intermediate video frames relative to the adjacent video frames of the pair of adjacent video frames.

6. The method of claim 1 , wherein temporally filtering comprises averaging a plurality of most recently received interpolation quality values.

7. The method of claim 1 , wherein temporally filtering comprises hysteretic filtering.

8. One or more computer-readable storage media storing a plurality of instructions executable by one or more processors of a computing system to cause the computing system to perform actions comprising:
receiving a first stream of video frames at a first frame rate;
generating a second stream of video frames at a second frame rate, wherein the second stream comprises (i) video frames of the first stream of video frames and (ii) sequences of intermediate video frames inserted between video frames of the first stream of video frames;
interpolating between a pair of adjacent video frames of the first stream of video frames to produce a first number of interpolated intermediate video frames in a particular sequence of the intermediate video frames;
duplicating at least one of the adjacent video frames of the pair to produce a second number of duplicated intermediate video frames in the particular sequence of the intermediate video frames;
receiving a plurality of interpolation quality values corresponding to one or more interpolated intermediate video frames;
temporally filtering the plurality of interpolation quality values to obtain observed interpolation quality; and
in response to a change in observed interpolation quality, dynamically changing the first number of interpolated intermediate video frames and the second number of duplicated intermediate video frames in the second stream of video frames.

9. The one or more computer-readable storage media of claim 8 , wherein dynamically changing the first number of interpolated intermediate video frames and the second number of duplicated intermediate video frames comprises changing a ratio of the first number of interpolated intermediate video frames to the second number of duplicated intermediate video frames.

10. The one or more computer-readable storage media of claim 8 , wherein the actions further comprise:
in response to an increase in the observed interpolation quality, increasing the ratio of the first number of interpolated intermediate video frames to the second number of duplicated intermediate video frames; and
in response to a decrease in the observed interpolation quality, decreasing the ratio of the first number of interpolated intermediate video frames to the second number of duplicated intermediate video frames.

11. The one or more computer-readable storage media of claim 8 , wherein the interpolated intermediate video frames are calculated based on proportional temporal spacings of the interpolated intermediate video frames relative to the adjacent video frames of the pair of adjacent video frames.

12. The one or more computer-readable storage media of claim 8 , wherein the actions further comprise receiving interpolation quality values that indicate the observed interpolation quality.

13. The one or more computer-readable storage media of claim 8 , wherein temporally filtering the interpolation quality values comprises averaging a plurality of most recently received interpolation quality values.

14. The one or more computer-readable storage media of claim 8 , wherein temporally filtering the interpolation quality values comprises hysteretic filtering.

15. A video system, comprising:
a conversion engine configured to (i) receive a first stream of video frames at a first frame rate, and (ii) generate a second stream of video frames at a second frame rate, wherein the second stream of video frames comprises (i) video frames of the first stream of video frames and (ii) sequences of intermediate video frames inserted between video frames of the first stream of video frames;
wherein the conversion engine is further configured to:
interpolate between a pair of adjacent video frames of the first stream of video frames to produce a first number of interpolated intermediate video frames in a particular sequence of the intermediate video frames;
duplicate at least one of the adjacent video frames of the pair of adjacent video frames to produce a second number of duplicated intermediate video frames in the particular sequence of the intermediate video frames;
receive a plurality of interpolation quality values corresponding to the interpolated intermediate video frames;
temporally filter the interpolation quality values to obtain the observed interpolation quality; and
in response to a change in observed interpolation quality, dynamically change the first number of interpolated intermediate video frames and the second number of duplicated intermediate video frames in the second stream of video frames.

16. The video system of claim 15 , wherein dynamically changing the first number of interpolated intermediate video frames and the second number of duplicated intermediate video frames comprises changing a ratio of the first number of interpolated intermediate video frames to the second number of

Assignees

• Marvell Int Ltd

Inventors

• Namboodiri Vipin
• Agara Venkatesha Rao Krishna Prasad

Classifications

• H04N19/00127 Primary

  Electricity · mapped topic

• H04N19/895

  in combination with error concealment · CPC title

• H04N19/137

  Motion inside a coding unit, e.g. average field, frame or block difference · CPC title

• H04N19/132

  Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking · CPC title

• H04N19/154

  Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147) · CPC title