Optimized rendering of multimedia content

Patent metadata

Field	Value
Publication number	US-9685140-B1
Application number	US-201113232071-A
Country	US
Kind code	B1
Filing date	Sep 14, 2011
Priority date	Sep 17, 2010
Publication date	Jun 20, 2017
Grant date	Jun 20, 2017

Abstract

Systems, methods and articles of manufacture for optimized rendering of multimedia content as described herein. An embodiment includes identifying one or more content layers for display and promoting the multimedia content layer for display over all layers of the one or more content layers, when no content is to be displayed over the multimedia content layer. Another embodiment includes identifying one or more content layers for display and displaying a bitmap representing a multimedia content layer directly on a display device, when no content is to be displayed over the multimedia content layer.

First claim

What is claimed is:

1. A computer implemented method for rendering content in one or more content layers in a tab of a browser window, comprising:
identifying one or more content layers for display in the tab of the browser window;
promoting a multimedia content layer for display over all layers of the one or more content layers, when no content is to be displayed over the multimedia content layer, wherein the promoting comprises modifying a z-index attribute associated with the multimedia content layer;
checking opacity of one or more pixels in the multimedia content layer;
blending the one or more pixels with corresponding pixels of the one or more content layers based on the checking; and
displaying the multimedia content layer with one or more blended pixels in the tab of the browser window,
wherein the identifying, the promoting, the checking, the blending and the displaying are performed using one or more processors.

2. The method of claim 1 , further comprising storing the content layers and the promoted multimedia content layer in shared memory.

3. The method of claim 2 , further comprising compositing the stored content layers and the multimedia content layer for display.

4. The method of claim 1 , further comprising:
determining when the multimedia content layer includes transparent or partially transparent areas;
caching content layers under the transparent or partially transparent areas; and
blending the multimedia content layer with the cached content layers.

5. The method of claim 1 , further comprising:
determining when the multimedia content layer includes transparent or partially transparent areas;
caching previously blended content layers under the transparent or partially transparent areas; and
blending the multimedia content layer with the blended cached content layers.

6. The method of claim 5 , further comprising:
caching content areas under the transparent or partially transparent areas for subsequent display.

7. The method of claim 1 , further comprising:
checking a first flag to determine if the multimedia content layer is to be displayed over all layers of the one or more content layers; and
promoting the multimedia content layer for display over all layers of the one or more content layers based on the checking.

8. The method of claim 7 , further comprising:
setting a second flag when content other than multimedia content is painted in a layer above the multimedia content layer, and when the layer completely or partially obscures the multimedia content layer.

9. The method of claim 8 , further comprising checking the second flag before promoting the multimedia content layer over all layers of the one or more content layers.

10. The method of claim 1 , further comprising:
storing a reference for a presently displayed multimedia content layer frame in a backing store; and
replacing the stored reference with another reference associated with a subsequently displayed frame, the replacing performed when the subsequently displayed frame completely or partially obscures the presently displayed frame.

11. A computer-based system for rendering content in one or more content layers in a tab of a browser window, comprising:
one or more processors;
a painting engine configured to identify one or more content layers for display in the tab of the browser window; and
a layering engine configured to promote a multimedia content layer for display over all layers of the one or more content layers based on modifying a z-index attribute associated with the multimedia content layer, when no content is to be displayed over the multimedia content layer, and check opacity of one or more pixels in the multimedia content layer; and
a compositing and display engine configured to blend the one or more pixels with corresponding pixels of the one or more content layers based on the checking, and display the multimedia content layer with one or more blended pixels,
wherein the painting engine, the layering engine, and the compositing and display engine are implemented using the one or more processors.

12. The system of claim 11 , further comprising:
a plug-in process configured to render multimedia content.

13. The system of claim 11 , further comprising a module configured to check a flag prior to promoting the multimedia content layer over all layers of the one or more content layers.

14. The system of claim 11 , further comprising a module configured to determine when the multimedia content layer includes transparent or partially transparent areas.

15. An article of manufacture including a computer-readable medium having instructions stored thereon that, when executed by a computing device, cause the computing device to perform operations comprising:
identifying one or more content layers for display in a tab of a browser window;
promoting a multimedia content layer for display over all layers of the one or more content layers, when no content is to be displayed over the multimedia content layer, wherein the promoting comprises modifying a z-index attribute associated with the multimedia content layer;
checking opacity of one or more pixels in the multimedia content layer;
blending the one or more pixels with corresponding pixels of the one or more content layers based on the checking; and
displaying the multimedia content layer with one or more blended pixels in the tab of the browser window.

16. The article of manufacture of claim 15 , the operations further comprising storing the content layers and the promoted multimedia content layer in shared memory.

17. The article of manufacture of claim 16 , the operations further comprising compositing the stored content layers and the multimedia content layer for display.

18. The article of manufacture of claim 15 , the operations further comprising:
determining when the multimedia content layer includes transparent or partially transparent areas;
caching content layers under the transparent or partially transparent areas; and
blending the multimedia content layer with the cached content layers.

19. The article of manufacture of claim 15 , the operations further comprising:
determining when the multimedia content layer includes transparent or partially transparent areas;
caching previously blended content layers under the transparent or partially transparent areas; and
blending the multimedia content layer with the blended cached content layers.

20. The article of manufacture of claim 15 , the operations further comprising:
checking a first flag to determine if the multimedia content layer is to be displayed over all layers of the one or more content layers; and
promoting the multimedia content layer for display over all layers of the one or more content layers based on the checking.

21. The article of manufacture of claim 15 , the operations further comprising:
setting a second flag when content other than multimedia content is painted in a layer above the multimedia content layer, and when the layer completely or partially obscures the multimedia content layer.

22. The article of manufacture of claim 21 , the operations further comprising:
checking the second flag before promoting the multimedia content layer over all layers of the one or more content layers.

23. The article of manufacture of claim 15 , the operations further comprising:
storing a reference for a presently displayed multimedia content layer frame in a backing store; and
replacin

Assignees

• Wilson Brett
• Labour Antoine
• Google Inc

Inventors

• Wilson Brett
• Labour Antoine

Classifications

• G09G2340/125

  wherein one of the images is motion video · CPC title

• G09G5/14 Primary

  Display of multiple viewports · CPC title

• G09G2340/10

  Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels · CPC title