Flexible upstream/downstream support for network-based media processing pipelines

Patent metadata

Field	Value
Publication number	US-11824911-B2
Application number	US-202217567444-A
Country	US
Kind code	B2
Filing date	Jan 3, 2022
Priority date	Jan 4, 2021
Publication date	Nov 21, 2023
Grant date	Nov 21, 2023

Abstract

An apparatus includes circuitry configured to: process media, the processing having an input and an output; determine a value of a mode to process the data, the value of the mode set to either push or pull; wherein the mode is added to an input descriptor or an output descriptor, and the mode functions with a protocol together in the input descriptor and the output descriptor; determine, for the input, when the value of the mode is set to push, that the data is pushed to the input, otherwise when the value of the mode is set to pull, that the data is pulled with the input; and determine, for the output, when the value of the mode is set to push, that the data is pushed from the output, otherwise when the value of the mode is set to pull, that the data is pulled from the output.

First claim

What is claimed is:

1. A method comprising:
processing media comprising data over a network, the processing having an input and an output;
determining a value of a mode parameter to process the data, the value of the mode parameter set to either push or pull;
wherein the mode parameter is added to an input descriptor or an output descriptor, and the mode parameter functions with a protocol parameter together in the input descriptor and the output descriptor;
determining, for the input, when the value of the mode parameter is set to push, that the data is pushed to the input, otherwise when the value of the mode parameter is set to pull, that the data is pulled by the input; and
determining, for the output, when the value of the mode parameter is set to push, that the data is pushed from the output, otherwise when the value of the mode parameter is set to pull, that the data is pulled from the output;
wherein the input descriptor and the output descriptor at least partially define a caching server uniform resource locator parameter configured to indicate a uniform resource locator of a server where the media is sent or retrieved;
wherein in response to the caching server uniform resource locator parameter being missing for a workflow, a workflow manager is configured to assign destination information of a media processing entity to a media source, wherein a media sink is configured to ingest the media.

2. The method of claim 1 , wherein the input descriptor or the output descriptor comprises a duration parameter that indicates a duration of availability of the data, the duration comprising a time in milliseconds from a moment the data appears when the data is pulled to an end of the duration.

3. The method of claim 2 , wherein the duration parameter comprises a value that indicates that a stream is live and a continuous stream ready to be pulled or continuously pushed.

4. The method of claim 3 , wherein the value of the duration parameter that indicates that the stream is live and a continuous stream ready to be pulled or continuously pushed is 0.

5. The method of claim 1 , wherein:
the media is processed as a media stream with a first media source and a second media source;
the first media source is a framework for live uplink streaming media sink client of the second media source, and the second media source is a network based media processing receiver configured to ingest the media stream in push mode; or
the first media source is a framework for live uplink streaming media sink server to the second media source, and the second media source is a network based media processing client configured to collect the media stream in pull mode.

6. The method of claim 1 , wherein:
the media is processed from a first media source to a second media source, where the first media source comprises an upstream task, and the second media source comprises a downstream task; or
the media is processed as a media stream with a network based media processing entity, the network based media processing entity comprising at least one input and output descriptor comprising at least one identification parameter configured to identify a type of the media stream.

7. The method of claim 1 , wherein the at least one description parameter describing the media comprises a latency parameter, where the latency parameter defines an interval between two fetches or pushes accepted with input of the input descriptor or output of the output descriptor.

8. The method of claim 1 , further comprising determining a persistence parameter, the persistence parameter comprising at least one of:
a persistency capability parameter configured to indicate whether storage provided with media processing is automatically persistent;
a secure persistency parameter configured to indicate whether a transfer of media processing entity data and state to another media processing entity is secure; or
a persistence storage uniform resource locator parameter comprising at least one uniform resource locator, the at least one uniform resource locator defining a location of persistent storage.

9. The method of claim 8 , wherein a default value of the persistency capability parameter comprises true, and wherein a default value of the secure persistency parameter comprises false.

10. The method of claim 1 , wherein a workflow description for processing the media is passed from a network based media processing source to a workflow manager, wherein the workflow description describes input data and output data, and functions used to process the media during a network based media processing workflow, wherein the network based media processing workflow is described using the input descriptor and the output descriptor.

11. An apparatus comprising:
at least one processor; and
at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
process media comprising data over a network, the processing having an input and an output;
determine a value of a mode parameter to process the data, the value of the mode parameter set to either push or pull;
wherein the mode parameter is added to an input descriptor or an output descriptor, and the mode parameter functions with a protocol parameter together in the input descriptor and the output descriptor;
determine, for the input, when the value of the mode parameter is set to push, that the data is pushed to the input, otherwise when the value of the mode parameter is set to pull, that the data is pulled by the input; and
determine, for the output, when the value of the mode parameter is set to push, that the data is pushed from the output, otherwise when the value of the mode parameter is set to pull, that the data is pulled from the output;
wherein the input descriptor and the output descriptor at least partially define a caching server uniform resource locator parameter configured to indicate a uniform resource locator of a server where the media is sent or retrieved;
wherein in response to the caching server uniform resource locator parameter being missing for a workflow, a workflow manager is configured to assign destination information of a media processing entity to a media source, wherein a media sink is configured to ingest the media.

12. The apparatus of claim 11 , wherein the input descriptor or the output descriptor comprises a duration parameter that indicates a duration of availability of the data, the duration comprising a time in milliseconds from a moment the data appears when the data is pulled to an end of the duration.

13. The apparatus of claim 12 , wherein the duration parameter comprises a value that indicates that a stream is live and a continuous stream ready to be pulled or continuously pushed.

14. The apparatus of claim 13 , wherein the value of the duration parameter that indicates that the stream is live and a continuous stream ready to be pulled or continuously pushed is 0.

15. The apparatus of claim 11 , wherein:
the media is processed as a media stream with a first media source and a second media source;
the first media source is a framework for live uplink streaming media sink client of the second media source, and the second media source is a network based media processing receiver configured to ingest the media stream in push mode; or
the first media source is a framework for live uplink streaming media sink server to the second media source, and the second media source is a network based media processing client configured to collect the media stream in pull mode.

16. The apparatus of claim 1

Assignees

• Nokia Technologies Oy

Inventors

• You Yu
• Mate Sujeet Shyamsundar
• Kammachi Sreedhar Kashyap

Classifications

• H04L65/65 Primary

  Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP] · CPC title

• H04L65/70

  Media network packetisation · CPC title

• H04L65/75

  Media network packet handling · CPC title

• H04L65/103

  in the network · CPC title

• H04L65/61

  for supporting one-way streaming services, e.g. Internet radio · CPC title