Application content delivery to multiple computing environments using existing video conferencing solutions

Patent metadata

Field	Value
Publication number	US-9549152-B1
Application number	US-201514734646-A
Country	US
Kind code	B1
Filing date	Jun 9, 2015
Priority date	Jun 9, 2014
Publication date	Jan 17, 2017
Grant date	Jan 17, 2017

Abstract

Example implementations are related to establishing, by an application delivery system in response to an identification of an application from a client device, a video conferencing session between a first video conferencing endpoint provided on the application delivery system and a second video conferencing endpoint provided on a client device, selecting a video capture module as a video input device for the first video conferencing endpoint, receiving, by the video capture module provided on the application delivery system, display data output by the application, converting, by the video capture module, the display data to a plurality of video frames, streaming the plurality of video frames received via the video capture module from the first video conferencing endpoint to the second video conferencing endpoint via the video conferencing session; and receiving, by the application delivery system from the client device, a user input signal for the application.

First claim

What is claimed is:

1. An apparatus comprising at least one processor and at least one memory including computer instructions, when executed by the at least one processor, cause the apparatus to:
establish, by an application delivery system in response to an identification of an application from a client device, a video conferencing session between a first video conferencing endpoint provided on the application delivery system and a second video conferencing endpoint provided on the client device;
select, by the application delivery system, a video capture module as a video input device for the first video conferencing endpoint;
receive, by the video capture module provided on the application delivery system, display data output by the application;
convert, by the video capture module, the display data to a plurality of video frames;
stream the plurality of video frames received via the video capture module from the first video conferencing endpoint to the second video conferencing endpoint via the video conferencing session; and
receive, by the application delivery system from the client device, a user input signal for the application.

2. The apparatus of claim 1 , wherein the video capture module comprises a virtual webcam that is configured to interface between the application and the first video conferencing endpoint and to output a plurality of video display frames in a format that is compatible with the first video conferencing endpoint.

3. The apparatus of claim 1 , wherein the computer instructions that cause the apparatus to receive the display data comprises computer instructions that cause the apparatus to:
receive, by the video capture module, one or more display frames output by the application; and
buffer, by the video capture module, each of the one or more display frames.

4. The apparatus of claim 1 , wherein the computer instructions that cause the apparatus to convert the display data comprises computer instructions that further cause the apparatus to:
convert, by the video capture module, the display data from a first frame format to a plurality of video frames having a second frame format.

5. The apparatus of claim 1 and further comprising instructions that cause the apparatus to:
select an audio capture module as an audio input device for the first video conferencing endpoint;
receive, by the audio capture module provided on the application delivery system, audio data output by the application; and
stream the audio data received via the audio capture module from the first video conferencing endpoint to the second video conferencing endpoint via the video conferencing session.

6. The apparatus of claim 5 , wherein the audio capture module comprises a virtual microphone that is configured to interface between the application and the first video conferencing endpoint and to output audio data in a format that is compatible with at least the first video conferencing endpoint.

7. The apparatus of claim 5 , wherein the computer instructions that cause the apparatus to receive, by the audio capture module, comprises computer instructions that cause the apparatus to:
receive, by the audio capture module, audio data output by the application in a first audio format associated with the application;
convert, by the audio capture module, the audio data output by the application from the first audio format to a second audio format that is associated with at least the first video conferencing endpoint; and
output the audio data in the second audio format to the first video conferencing endpoint.

8. The apparatus of claim 1 and further comprising computer instructions that cause the apparatus to:
establish a control channel between the application delivery system and the client device; and
receive, by the application delivery system from the client device via the control channel, the user input signal for the application.

9. The apparatus of claim 1 , wherein the computer instructions that cause the apparatus to receive, by the application delivery system from the client device, the user input signal comprise instructions that cause the apparatus to:
receive, by the application delivery system from the client device via the video conferencing session, a user input signal from a user of the client device, the user input signal provided as at least one of:
a first signal indicating a visual gesture by the user that is streamed by the second video conferencing endpoint to the first video conferencing endpoint via a video channel of the video conferencing session; and
a second signal indicating an audible input by the user that is streamed by the second video conferencing endpoint to the first video conferencing endpoint via an audio channel of the video conferencing session.

10. The apparatus of claim 1 , wherein the video conferencing session comprises at least a first video channel and a first audio channel for streaming of video data and audio data, respectively, from the first video conferencing endpoint to the second video conferencing endpoint, and a second video channel and a second audio channel for streaming of video data and audio data, respectively, from the second video conferencing endpoint to the first video conferencing endpoint, the apparatus further comprising computer instructions that cause the apparatus to:
receive the user input signal via at least one of the second video channel and the second audio channel of the video conferencing session.

11. The apparatus of claim 1 and further comprising computer instructions that cause the apparatus to:
provide the user input signal to the application; and
receive, by the video capture module provided on the application delivery system, changed or updated display data output by the application in response to the user input signal.

12. The apparatus of claim 1 , wherein the computer instructions that cause the apparatus to receive, by the application delivery system from the client device, a user input signal comprise instructions that cause the apparatus to:
receive, by the first video conferencing endpoint from the second video conferencing endpoint via the video conferencing session, a user input signal indicating an audible input or a visual gesture by a user of the client device; and
convert the user input signal indicating the audible input or the visual gesture to a control signal for the application; and
provide the control signal to the application to control the application; and
receive, by the video capture module provided on the application delivery system, changed or updated display data output by the application in response to the control signal.

13. The apparatus of claim 1 , wherein the application is not present on the client device, and wherein the computer instructions that cause the apparatus to receive, by the application delivery system from the client device, a user input signal comprise instructions that cause the apparatus to:
receive, by the first video conferencing endpoint from the second video conferencing endpoint via a video channel of the video conferencing session, a user input signal; and
changing, by the application, the display data output by the application based on the user input signal.

14. The apparatus of claim 13 wherein the user input signal comprises a visual gesture from a user of the client device.

15. The apparatus of claim 5 , wherein the application is not present on the client device, and wherein the computer instructions that cause the apparatus to receive, by the application delivery system from the client device, a user input signal comprise instructions that c

Assignees

• Google Inc

Inventors

• Nayyar Harsh
• Relan Rohan
• Chang Chuo-Ling
• Tan Peter Kai Hua

Classifications

• H04N7/15 Primary

  Conference systems · CPC title

• H04L65/403 Primary

  Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15) · CPC title

• H04N7/148

  Interfacing a video terminal to a particular transmission medium, e.g. ISDN · CPC title