Content provisioning for wireless back channel

Patent metadata

Field	Value
Publication number	US-10108386-B2
Application number	US-201213364576-A
Country	US
Kind code	B2
Filing date	Feb 2, 2012
Priority date	Feb 4, 2011
Publication date	Oct 23, 2018
Grant date	Oct 23, 2018

Abstract

In one example, this disclosure describes a method that includes, in an example, determining, by a source device, that display data rendered by the source device comprises one or more displayable graphical objects. The method also includes in response to determining an event, selecting, by the source device, a set of the one or more graphical objects for rendering at a sink device. The method also includes generating, by the source device, configuration data based at least in part on the set of the one or more graphical objects, wherein the configuration data is usable by the sink device to render representations of graphical objects in the set of one or more graphical objects based at least in part on one or more display parameters associated with the sink device. The method also includes sending, by the source device, the configuration data to the sink device.

First claim

What is claimed is:

1. A method comprising:
determining, by a source device, that display data rendered and displayed by the source device comprises one or more displayable graphical objects;
in response to input, provided at the source device, that corresponds to a set of the one or more graphical objects displayed by the source device, selecting, by the source device, the set of the one or more graphical objects for rendering and displaying at both the source device and a sink device, wherein a size of a display of the sink device is larger than a size of a display of the source device;
generating, by the source device, configuration data based at least in part on the set of the one or more graphical objects being rendered and displayed by the source device and based at least in part on one or more display parameters associated with the sink device, wherein the configuration data comprises one or more commands of a graphics programming language that are directly usable by a graphics processing unit (GPU) of the sink device to render pixel-level representations of graphical objects in the set of one or more graphical objects on the sink device; and
sending, by the source device, the configuration data to the sink device for rendering the set of one or more graphical objects at the sink device.

2. The method of claim 1 , wherein the configuration data further comprises at least one of graphical commands to modify the set of one or more graphical objects for rendering at the sink device.

3. The method of claim 2 , wherein the graphical commands do not comprise pixel values of a colorspace.

4. The method of claim 1 , further comprising:
receiving, by the source device and from the sink device, a display resolution of the display of the sink device;
generating, by the source device, a mapping between the display resolution of the display of the sink device and a display resolution of the display of the source device; and
generating, by the source device, the configuration data based at least in part on the mapping between the display resolution of the display of the sink device and the display resolution of the display of the source device.

5. The method of claim 1 , wherein generating configuration data based at least in part on the set of the one or more graphical objects further comprises:
generating, by the source device, configuration data to render the set of the one or more graphical objects only at the sink device.

6. The method of claim 1 , wherein the one or more displayable graphical objects comprise a first group of displayable graphical objects and a second group of displayable graphical objects, wherein the method further comprises:
rendering, by the source device, the first group of displayable graphical objects, and wherein the second group of displayable graphical objects comprise the set of the one or more graphical objects for rendering at the sink device.

7. The method of claim 1 , wherein the display of the source device comprises a touch sensitive display, the method further comprising:
receiving, at the touch sensitive display of the source device, a first indication of user input;
in response to receiving the first indication, generating, by the source device, a first event based at least in part on the first indication that is associated with a first timestamp;
receiving, by the source device and from the sink device, a second event that is associated with a second timestamp;
determining, by the source device, whether the second timestamp represents an earlier time than the first timestamp; and
when the second timestamp represents the earlier time than the first timestamp, generating, by the source device, configuration data based at least in part on the first timestamp and the second timestamp.

8. The method of claim 1 , further comprising:
executing, by the source device, a first application;
determining, by the source device, an indication to execute the first application at the sink device;
in response to determining the indication, determining, by the source device, that a second instance of the application is executable by the sink device at the sink device; and
generating, by the source device, the configuration data to cause the sink device to execute the second instance of the application.

9. The method of claim 1 , further comprising:
receiving, by the source device, information specifying processing capabilities of a graphics processing unit (GPU) of the sink device; and
generating, by the source device, the configuration data based at least in part on the capabilities of the GPU of the sink device.

10. A wireless source device comprising:
a display;
one or more processors; and
a non-transitory memory storing instructions that, when executed, cause the one or more processors to:
determine that display data rendered and displayed by the display of the source device comprises one or more displayable graphical objects;
in response to input, provided at the source device, that corresponds to a set of the one or more graphical objects displayed by the display of source device, select the set of the one or more graphical objects for rendering and displaying at both the source device and a sink device, wherein a size of a display of the sink device is larger than a size of the display of the source device;
generate configuration data based at least in part on the set of the one or more graphical objects being rendered and displayed by the source device and based at least in part on one or more display parameters associated with the sink device, wherein the configuration data comprises one or more commands of a graphics programming language that are directly usable by a graphics processing unit (GPU) of the sink device to render pixel-level representations of graphical objects in the set of one or more graphical objects on the sink device; and
send the configuration data to the sink device for rendering the set of one or more graphical objects at the sink device.

11. The wireless source device of claim 10 , wherein the configuration data further comprises at least one of graphical commands to modify the set of one or more graphical objects for rendering at the sink device.

12. The wireless source device of claim 11 , wherein the graphical commands do not comprise pixel values of a colorspace.

13. The wireless source device of claim 10 , wherein, when executed, the instructions further cause the one or more processors to:
receive, from the sink device, a display resolution of the display of the sink device;
generate a mapping between the display resolution of the display of the sink device and a display resolution of the display of the source device; and
generate the configuration data based at least in part on the mapping between the display resolution of the display of the sink device and the display resolution of the display of the source device.

14. The wireless source device of claim 10 , wherein, when executed, the instructions further cause the one or more processors to:
generate configuration data to render the set of the one or more graphical objects only at the sink device.

15. The wireless source device of claim 10 , wherein, when executed, the instructions further cause the one or more processors to:
render the first group of displayable graphical objects, and wherein the second group of displayable graphical objects comprise the set of the one or more graphical objects for rendering at the sink device.

16. The wireless source device of claim 10 , wherein the display of the source device comprises a touch sensitive d

Assignees

• Raveendran Vijayalakshmi R
• Wang Xiaodong
• Shaukat Fawad
• Huang Xiaolong
• Qualcomm Inc

Inventors

• Raveendran Vijayalakshmi R
• Wang Xiaodong
• Shaukat Fawad
• Huang Xiaolong

Classifications

• G09G2370/04

  Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller · CPC title

• G09G2370/16

  Use of wireless transmission of display information · CPC title

• G09G2340/0407

  Resolution change, inclusive of the use of different resolutions for different screen areas · CPC title

• G06F3/1407 Primary

  General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros · CPC title

• G06F3/14 Primary

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title