Content adaptive telecine and interlace reverser

Patent metadata

Field	Value
Publication number	US-9521358-B2
Application number	US-201615072773-A
Country	US
Kind code	B2
Filing date	Mar 17, 2016
Priority date	Sep 30, 2014
Publication date	Dec 13, 2016
Grant date	Dec 13, 2016

Abstract

Techniques related to processing a mixed content video stream to generate progressive video for encoding and/or display are discussed. Such techniques may include determining conversion techniques for various portions of the mixed content video stream and converting the portions based on the determined techniques. The conversion of true interlaced video include content adaptive interlace reversal and the conversion of pseudo-interlaced telecine converted video may include adaptive telecine pattern reversal.

First claim

What is claimed is:

1. A computer-implemented method for processing video for encoding and/or display comprising:
receiving a mixed content video stream comprising a plurality of video formats comprising at least a true interlaced format and a pseudo-interlaced telecine converted format;
determining a first conversion technique for a first segment of the mixed content video stream having the true interlaced format and a second conversion technique for a second segment of the mixed content video stream having the telecined format, wherein the first and second conversion techniques are different; and
converting the mixed content video stream to a progressive video stream based at least in part on the first conversion technique and the second conversion technique.

2. The method of claim 1 , wherein the first conversion technique comprises a content adaptive deinterlacer and the second conversion technique comprises an adaptive telecine pattern reverser technique.

3. The method of claim 1 , wherein determining the first conversion technique comprises determining a first frame format of a first frame of the first segment and a first frame group format of the first segment.

4. The method of claim 3 , wherein determining the first frame format comprises:
determining a plurality of descriptors associated with content of the first frame;
evaluating a plurality of comparison tests based on the plurality of descriptors; and
determining the first frame format based on the comparison tests, wherein the first frame format comprises an interlaced frame.

5. The method of claim 3 , wherein determining the first frame format comprises:
determining a plurality of descriptors associated with content of the first frame;
evaluating, at a first stage, a plurality of comparison tests based on the plurality of descriptors;
determining, at the first stage, whether the first frame format is progressive, interlaced, or uncertain based on the comparison tests;
evaluating, when the first frame format is uncertain at the first stage, a second stage comprising machine learning based comparison tests; and
determining, at the second stage, the first frame is interlaced based on the machine learning based comparison tests.

6. The method of claim 1 , wherein determining the second conversion technique comprises determining an individual telecine pattern of the second segment, wherein converting the mixed content video stream comprises reversing the individual telecine pattern, and wherein the individual telecine pattern comprises at least one of a 3:2 pull down pattern, a 2:3:3:2 pull down pattern, a 4:1 pull down pattern or a blended pattern.

7. The method of claim 1 , wherein determining the second conversion technique comprises determining the second segment has an undetected pattern and wherein converting the mixed content video stream comprises applying an adaptive interlace reverser to the second segment.

8. The method of claim 1 , further comprising:
determining a third segment of the mixed content video stream comprises a progressive format; and
providing the progressive format video segment as output with no conversion.

9. At least one machine non-transitory readable medium comprising a plurality of instructions that, in response to being executed on a computing device, cause the computing device to process video for encoding and/or display by:
receiving a mixed content video stream comprising a plurality of video formats comprising at least a true interlaced format and a pseudo-interlaced telecine converted format;
determining a first conversion technique for a first segment of the mixed content video stream having the true interlaced format and a second conversion technique for a second segment of the mixed content video stream having the telecined format, wherein the first and second conversion techniques are different; and
converting the mixed content video stream to a progressive video stream based at least in part on the first conversion technique and the second conversion technique.

10. The machine readable medium of claim 9 , wherein determining the first conversion technique comprises determining a first frame format of a first frame of the first segment and a first frame group format of the first segment.

11. The machine readable medium of claim 10 , wherein determining the first frame format comprises:
determining a plurality of descriptors associated with content of the first frame;
evaluating a plurality of comparison tests based on the plurality of descriptors; and
determining the first frame format based on the comparison tests, wherein the first frame format comprises an interlaced frame.

12. The machine readable medium of claim 10 , wherein determining the first frame format comprises:
determining a plurality of descriptors associated with content of the first frame;
evaluating, at a first stage, a plurality of comparison tests based on the plurality of descriptors;
determining, at the first stage, whether the first frame format is progressive, interlaced, or uncertain based on the comparison tests;
evaluating, when the first frame format is uncertain at the first stage, a second stage comprising machine learning based comparison tests; and
determining, at the second stage, the first frame is interlaced based on the machine learning based comparison tests.

13. The machine readable medium of claim 9 , wherein determining the second conversion technique comprises determining an individual telecine pattern of the second segment, wherein converting the mixed content video stream comprises reversing the individual telecine pattern, and wherein the individual telecine pattern comprises at least one of a 3:2 pull down pattern, a 2:3:3:2 pull down pattern, a 4:1 pull down pattern or a blended pattern.

14. The machine readable medium of claim 9 , wherein determining the second conversion technique comprises determining the second segment has an undetected pattern and wherein converting the mixed content video stream comprises applying an adaptive interlace reverser to the second segment.

15. A system for processing video for encoding and/or display comprising:
a memory buffer configured to store video frames; and
a central processing unit coupled to the memory buffer, the central processing unit to receive a mixed content video stream comprising a plurality of video formats comprising at least a true interlaced format and a pseudo-interlaced telecine converted format, to determine a first conversion technique for a first segment of the mixed content video stream having the true interlaced format and a second conversion technique for a second segment of the mixed content video stream having the telecined format, wherein the first and second conversion techniques are different, and to convert the mixed content video stream to a progressive video stream based at least in part on the first conversion technique and the second conversion technique.

16. The system of claim 15 , wherein the central processing unit to determine the first conversion technique comprises the central processing unit to determine a first frame format of a first frame of the first segment and a first frame group format of the first segment.

17. The system of claim 16 , wherein the central processing unit to determine the first frame format comprises the central processing unit to determine a plurality of descriptors associated with content of the first frame, to evaluate a plurality of comparison tests based on the plurality of descriptors, and to determine the first frame format based on the compa

Assignees

• Intel Corp

Inventors

• Possos Sebastian
• Puri Atul

Classifications

• H04N7/012 Primary

  Conversion between an interlaced and a progressive signal (for graphics images G09G2310/0229) · CPC title

• H04N7/0112

  one of the standards corresponding to a cinematograph film standard · CPC title

• H04N7/0147 Primary

  the interpolation using an indication of film mode or an indication of a specific pattern, e.g. 3:2 pull-down pattern · CPC title

• H04N7/0115 Primary

  with details on the detection of a particular field or frame pattern in the incoming video signal, e.g. 3:2 pull-down pattern · CPC title