Changing visual content communication

Patent metadata

Field	Value
Publication number	US-9330634-B2
Application number	US-201514731717-A
Country	US
Kind code	B2
Filing date	Jun 5, 2015
Priority date	Dec 14, 2007
Publication date	May 3, 2016
Grant date	May 3, 2016

Abstract

Techniques for presenting changing visual content, including video, animation and so on, as an overlay are discussed. Changing visual content, included in a visual presentation, may be identified from other visual elements included in the visual presentation. The changing visual content may be manipulated based on available resources associated with presenting the changing visual content as an overlay for a client.

First claim

What is claimed is:

1. A computer system comprising:
a processor; and
a memory communicatively coupled to the processor comprising computer-readable instructions that when executed by the processor cause the computing system to:
detect changing visual content based on a comparison to non-changing visual content;
evaluate available resources;
transmit the non-changing visual content in a first format to the remote client;
manipulate the changing visual content based at least in part on the evaluation of the available resources; and
transmit the manipulated changing visual content in a second format to the remote client, wherein the second format is different from the first format.

2. The computer system of claim 1 , wherein the changing visual content is identified based on evaluating at least one of:
update frequency, aspect ratio, window identification, and process name.

3. The computer system of claim 1 , wherein the changing visual content is identified based on evaluating a combination of two or more of:
update frequency, aspect ratio, window identification, and process name.

4. The computer system of claim 1 , further comprising:
provide one or more timestamps in the changing visual content for matching the changing visual content to corresponding audio content based at least in part on the one or more timestamps.

5. The computer system of claim 4 , further comprising:
overlay the changing visual content over the corresponding audio content.

6. The computer system of claim 1 , wherein evaluating available resources comprises:
evaluate resources available on a server;
evaluate resources available on a network communicatively coupling the server and the remote client; and
evaluate resources available on the remote client.

7. The computer system of claim 1 , wherein transmitting the manipulated changing visual content further comprises:
transmit control information for recreating the changing visual content as an overlay over the non-changing visual content at the remote client, wherein the control information comprises at least one of: child video window detection data and geometry tracking data.

8. The computer system of claim 1 , wherein the changing visual content is uncompressed prior to manipulation.

9. The computer system of claim 1 , wherein the non-changing visual content further comprises:
visual content that does not change; and
visual content that changes an amount less than a threshold.

10. A computing system comprising:
at least one processor; and
at least one memory communicatively coupled to the at least one processor comprising computer-readable instructions that when executed by the at least one processor cause the computing system to implement a method of transmitting visual content to a remote client, the method comprising:
distinguishing changing visual content from non-changing visual content, wherein the changing visual content is detected based on a comparison to the non-changing visual content;
evaluating available resources;
manipulating the changing visual content based at least in part on the evaluation of the available resources;
transmitting the non-changing visual content in a first format to the remote client; and
transmitting the manipulated changing visual content in a second format to the remote client.

11. The computer system of claim 10 , wherein the changing visual content is distinguished from non-changing visual content based on heuristic learning techniques.

12. The computer system of claim 10 , wherein manipulating the changing visual content comprises at least one of: compressing the changing visual content, not transmitting screen updates of the changing visual content, and not transmitting video frames of the changing visual content.

13. The computer system of claim 10 , wherein evaluating available resources comprises:
evaluating resources available on a server;
evaluating resources available on a network communicatively coupling the server and the remote client; and
evaluating resources available on the remote client.

14. The computer system of claim 10 , wherein a bitmap of the changing visual content changes at a predetermined update rate.

15. The computer system of claim 10 , wherein manipulating the changing visual content is based on one or more of: available bandwidth, available server processing capability, available client processing capability, available decoders, and available encoders.

16. The computer system of claim 10 , further comprising:
providing one or more timestamps in the changing visual content for matching the changing visual content to corresponding audio content based at least in part on the one or more timestamps; and
overlaying the changing visual content over the corresponding audio content.

17. The computer system of claim 10 , wherein the non-changing visual content further comprises:
visual content that does not change; and
visual content that changes an amount less than a threshold.

18. The computer system of claim 10 , wherein the changing visual content is uncompressed prior to manipulation.

19. A method implemented on a computing system for transmitting visual content to a remote client, comprising:
distinguishing changing visual content from non-changing visual content, wherein the changing visual content is detected based on a comparison to the non-changing visual content;
evaluating available resources;
manipulating the changing visual content based at least in part on the evaluation of the available resources;
transmitting the non-changing visual content in a first format to the remote client; and
transmitting the manipulated changing visual content in a second format to the remote client.

20. The method of claim 19 , wherein the changing visual content is distinguished from non-changing visual content based on one of:
update frequency, aspect ratio, window identification, and process name.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Mahajan Rajneesh
• Stoyanov Vladimir
• Dvorak Casey

Classifications

• G09G5/14

  Display of multiple viewports · CPC title

• G09G5/006 Primary

  Details of the interface to the display terminal (specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04) · CPC title

• G09G2340/125

  wherein one of the images is motion video · CPC title

• H04N19/156

  Availability of hardware or computational resources, e.g. encoding based on power-saving criteria · CPC title

• G09G2320/103

  Detection of image changes, e.g. determination of an index representative of the image change · CPC title