Systems and methods for providing media communication programmable services

Patent metadata

Field	Value
Publication number	US-12368763-B2
Application number	US-202418594653-A
Country	US
Kind code	B2
Filing date	Mar 4, 2024
Priority date	May 14, 2021
Publication date	Jul 22, 2025
Grant date	Jul 22, 2025

Abstract

Systems and methods for providing real-time media communication services to make use of a software application resident on a server that receives the media feeds of multiple sending participants, and generates a single composed media feed that includes media feeds of the sending participants and that sends the composed media feed to other computing services for manifold purposes like recording, re-broadcasting and/or re-transmission to remote computing devices of multiple real-time media communication participants. The composed media feed can include supplementary information in addition to the media feeds of live participants. This supplementary information is provided by means of API configurable programmatic code that is then executed and used as the software application resident on the server.

First claim

What is claimed is:

1. An apparatus for providing a composed media stream for publication to a plurality of presenter(s) and participants that are part of a communication session via interconnected computing devices, comprising:
an API interface unit configured to receive instructions relating to programmatic control over the rendering and publishing of a composed media stream;
a rendering engine control unit configured to control the rendering and publication of the composed media stream based on information received from the API interface unit;
a rendering engine unit configured to process one or more media streams received from the interconnected computing devices of the communication session and supplementary information and configured to generate the composed media stream; and
a composed media sending unit configured to cause the composed media stream to be published to participants of the communication session;
wherein the rendering engine control unit provides a URL to the rendering engine unit, and wherein the rendering engine unit is configured to use the provided URL to access and run a computer program configured to generate the composed media stream.

2. The apparatus of claim 1 , wherein the rendering engine unit is further configured to use the provided URL to obtain one or more media streams that are to be used to generate the composed media stream.

3. The apparatus of claim 2 , wherein the rendering engine unit is also configured to use the provided URL to obtain supplementary information that is to be used to generate the composed media stream.

4. The apparatus of claim 1 , wherein the rendering engine unit further is configured to output audio and video streams for the composed media stream to a virtual audio device unit and a virtual display server unit, respectively.

5. The apparatus of claim 4 wherein the composed media sending unit reads data from the virtual audio device unit and the virtual display server unit and uses the read data to cause the composed media stream to be published to participants of the communication session.

6. An apparatus for providing a composed media stream for publication to a plurality of presenter(s) and participants that are part of a communication session via interconnected computing devices, comprising:
an API interface that includes means for receiving instructions relating to programmatic control over the rendering and publishing of a composed media stream;
means for controlling the rendering and publication of the composed media stream based on information received from the API interface unit;
means for processing one or more media streams received from the interconnected computing devices of the communication session and supplementary information and for generating the composed media stream; and
means for causing the composed media stream to be published to participants of the communication session;
wherein the means for controlling the rendering and publication of the composed media stream provides a URL to the means for processing one or more media streams, and wherein the means for processing one or more media streams is configured to use the provided URL to access and run a computer program configured to generate the composed media stream.

7. A non-transitory computer readable medium containing instructions which, when implemented by one or more processors of a computing device cause the computing device to perform a method comprising:
receiving, via an API interface, instructions relating to programmatic control over the rendering and publishing of a composed media stream;
processing one or more media streams received from the interconnected computing devices of the communication session and supplementary information based on the information received via the API interface to generate the composed media stream; and
causing the composed media stream to be published to participants of the communication session;
wherein processing one or more media streams comprises using a provided URL to access and run a computer program configured to generate the composed media stream.

8. The non-transitory computer readable medium of claim 7 , wherein the processing step further comprises using the provided URL to obtain one or more media streams that are to be used to generate the composed media stream.

9. The non-transitory computer readable medium of claim 8 , wherein the processing step further comprises using the provided URL to obtain supplementary information that is to be used to generate the composed media stream.

10. The non-transitory computer readable medium of claim 7 , wherein the method further comprises:
outputting an audio stream for the composed media stream to a virtual audio device unit; and
outputting a video stream for the composed media stream to a virtual display server unit.

11. The non-transitory computer readable medium of claim 10 , wherein causing the composed media stream to be published comprises reading data from the virtual audio device unit and the virtual display server unit and using the read data to cause the composed media stream to be published to participants of the communication session.

Assignees

• Vonage Business Inc

Inventors

• Escoda Òscar Divorra
• O'Connell John G
• Rossi Caio De Mello
• Talusani Rajkiran
• Poh Yee Hui
• Shoushan Roy Ben

Classifications

• H04L12/1831

  Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status · CPC title

• H04L65/402

  wherein the services involve a main real-time session and one or more additional parallel non-real time sessions, e.g. downloading a file in a parallel FTP session, initiating an email or combinational services · CPC title

• H04N7/155

  involving storage of or access to video conference sessions (tracking arrangements for later retrieval of a computer conference content or participants activities H04L12/1831) · CPC title

• H04L65/403 Primary

  Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15) · CPC title

• H04N7/152 Primary

  Multipoint control units therefor · CPC title