One pass video processing and composition for high-definition video

Patent metadata

Field	Value
Publication number	US-9584785-B2
Application number	US-201314055870-A
Country	US
Kind code	B2
Filing date	Oct 16, 2013
Priority date	Jun 11, 2008
Publication date	Feb 28, 2017
Grant date	Feb 28, 2017

Abstract

A video composition model that provides a set of application programming interfaces (APIs) to set device contexts, and determine capabilities of graphics hardware from a device driver. After the model determines a configuration, the model determines input video stream states applicable to frame rates, color-spaces and alpha indexing of input video streams, interactive graphics, and background images. The model prepares the input video frames and reference frames, as well as a frame format and input/output frame index information. The input video streams, interactive graphics and background images are processed individually and mixed to generate an output video stream.

First claim

What is claimed:

1. A method performed on a computing device, the method comprising:
configuring a video composition model executing on the computing device to expose an application programming interface (API) to a video playback application that executes on the computing device, the API being configured to enable the video playback application to control processing by the video composition model and composition of an output video stream;
receiving at least one input video stream at a discrete data input (DDI) of the video composition model;
receiving processing specifications for the at least one input video stream from the video playback application at the API; and
processing, by the video composition model, each of the at least one input video stream according to the received processing specifications, the processing comprising:
converting a color space of the each of the at least one input video stream to a designated color space in response to the color space differing from the designated color space, where the designated color space is designated by the received processing specifications, and
scaling a resolution of the each of the at least one input video stream to a designated resolution in response to the resolution differing from the designated resolution, where the designated resolution is designated by the received processing specifications,
wherein the processing of the least one input video stream and composition of the output video stream is performed in a single pass by the video composition model.

2. The method of claim 1 further comprising querying, by the video composition model via a device driver, capabilities of a graphics device associated with the device driver.

3. The method of claim 1 further comprising providing, by the video composition model, at least one application programming interface configured for enabling the video playback application and a device driver to establish proprietary content protection.

4. The method of claim 1 where the video composition model is configured for alpha blending a plurality of the at least one video stream.

5. The method of claim 1 where the video composition model is configured for reducing a quality of the at least one video stream.

6. The method of claim 1 where the video composition model is configured for performing linear scaling of the at least one video stream.

7. The method of claim 1 where the video composition model is configured for performing non-linear scaling of the at least one video stream.

8. At least one computer storage device storing computer-executable instructions that, when executed by a computing device, cause the computing device to perform actions comprising:
configuring a video composition model executing on the computing device to expose an application programming interface (API) to a video playback application that executes on the computing device, the API being configured to enable the video playback application to control processing by the video composition model and composition of an output video stream;
receiving at least one input video stream at a discrete data input (DDI) of the video composition model;
receiving processing specifications for the at least one input video stream from the video playback application at the API; and
processing, by the video composition model, each of the at least one input video stream according to the received processing specifications, the processing comprising:
converting a color space of the each of the at least one input video stream to a designated color space in response to the color space differing from the designated color space, where the designated color space is designated by the received processing specifications, and
scaling a resolution of the each of the at least one input video stream to a designated resolution in response to the resolution differing from the designated resolution, where the designated resolution is designated by the received processing specifications,
wherein the processing of the least one input video stream and composition of the output video stream is performed in a single pass by the video composition model.

9. The at least one computer storage device of claim 8 , the actions further comprising querying, by the video composition model via a device driver, capabilities of a graphics device associated with the device driver.

10. The at least one computer storage device of claim 8 , the actions further comprising providing, by the video composition model, at least one application programming interface configured for enabling the video playback application and a device driver to establish proprietary content protection.

11. The at least one computer storage device of claim 8 where the video composition model is configured for alpha blending a plurality of the at least one video stream.

12. The at least one computer storage device of claim 8 where the video composition model is configured for reducing a quality of the at least one video stream.

13. The at least one computer storage device of claim 8 where the video composition model is configured for performing linear scaling of the at least one video stream.

14. The at least one computer storage device of claim 8 where the video composition model is configured for performing non-linear scaling of the at least one video stream.

15. A system comprising a computing device and at least one program module together configured for performing actions comprising:
configuring a video composition model executing on the computing device to expose an application programming interface (API) to a video playback application that executes on the computing device, the API being configured to enable the video playback application to control processing by the video composition model and composition of an output video stream;
receiving at least one input video stream at a discrete data input (DDI) of the video composition model;
receiving processing specifications for the at least one input video stream from the video playback application at the API; and
processing, by the video composition model, each of the at least one input video stream according to the received processing specifications, the processing comprising:
converting a color space of the each of the at least one input video stream to a designated color space in response to the color space differing from the designated color space, where the designated color space is designated by the received processing specifications, and
scaling a resolution of the each of the at least one input video stream to a designated resolution in response to the resolution differing from the designated resolution, where the designated resolution is designated by the received processing specifications,
wherein the processing of the least one input video stream and composition of the output video stream is performed in a single pass by the video composition model.

16. The system of claim 15 , the actions further comprising querying, by the video composition model via a device driver, capabilities of a graphics device associated with the device driver.

17. The system of claim 15 , the actions further comprising providing, by the video composition model, at least one application programming interface configured for enabling the video playback application and a device driver to establish proprietary content protection.

18. The system of claim 15 where the video composition model is configured for alpha blending a plurality of the at least one video stream.

19. The system of claim 1

Assignees

• Microsoft Corp
• Microsoft Technology Licensing Llc

Inventors

• Nakayama Kazuyuki

Classifications

• H04N7/012

  Conversion between an interlaced and a progressive signal (for graphics images G09G2310/0229) · CPC title

• H04N9/76 Primary

  for mixing of colour signals (H04N9/75 takes precedence) · CPC title

• H04N7/0112

  one of the standards corresponding to a cinematograph film standard · CPC title

• H04N7/013

  the incoming video signal comprising different parts having originally different frame rate, e.g. video and graphics · CPC title

• G09G5/006

  Details of the interface to the display terminal (specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04) · CPC title