Adaptive performance control of multi-stream data transfer from a source system to a target system

Patent metadata

Field	Value
Publication number	US-9699233-B1
Application number	US-201615336700-A
Country	US
Kind code	B1
Filing date	Oct 27, 2016
Priority date	Jun 30, 2015
Publication date	Jul 4, 2017
Grant date	Jul 4, 2017

Abstract

According to one embodiment, in response to a request to transfer a data set from a source system to a target system over a network, an adaptive performance control (APC) controller allocates a plurality of data streams for transferring the data set. The APC controller activates one or more data streams from the allocated data streams to transfer the data set from the source system to the target system. The APC controller monitors an overall throughput of the activated data streams assigned to transfer the data set from the source system to the target system. The APC controller dynamically adjusts a number of the activated data streams based on the monitored overall throughput of the activated data streams, such that a maximum overall throughput of the activated data streams is reached while maintaining a minimum number of the activated data streams.

First claim

What is claimed is:

1. A computer-implemented method for managing data streams for data transfer operations, the method comprising:
in response to a request to transfer a data set from a source system to a target system over a network, activating, by an adaptive performance control (APC) controller, a primary data stream and a first secondary data stream from a set of allocated data streams to transfer the data set from the source system to the target system;
monitoring an overall throughput of the activated data streams for a first predetermined period of time;
deactivating the first secondary data stream from the activated data streams if the overall throughput drops below a first predetermined threshold over the first predetermined period of time;
suspending an operation of the APC controller for a second predetermined period of time in response to determining that the overall throughput drop is not greater than the first predetermined threshold and there is at least one allocated data stream that has been previously deactivated; and
reactivating the first secondary data stream that has been previously deactivated, after the second predetermined period of time.

2. The method of claim 1 , wherein the primary data stream remains activated during the transfer of the data set, and a secondary data stream can be activated, deactivated, or reactivated during the transfer of the data set.

3. The method of claim 1 , wherein a number of the activated data streams is adjusted based on the monitored overall throughput of the activated data streams, such that a maximum overall throughput of the activated data streams is reached while maintaining a minimum number of the activated data streams.

4. The method of claim 1 , further comprising:
determining whether all allocated data streams have been activated if the overall throughput does not drop below the first predetermined threshold;
iteratively performing monitoring the overall throughput for the first predetermined period of time and deactivating a secondary data stream, in response to determining that all allocated data streams have been activated.

5. The method of claim 1 , further comprising deactivating a third secondary data stream from the activated data streams, in response to determining that the overall throughput has gained less than a second predetermined threshold after activating of the first secondary data stream.

6. The method of claim 1 , further comprising iteratively performing activating the first secondary data stream and monitoring the overall throughput for the first predetermined period of time, if the overall throughput has gained more than or equal to the second predetermined threshold.

7. The method of claim 5 , further comprising determining whether all allocated data streams have been activated, wherein iteratively performing activating the first secondary data stream and monitoring the overall throughput for the first predetermined period of time is performed only if there is at least one allocated data stream that has not been activated.

8. A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations of managing data streams for data transfer operations, the operations comprising:
in response to a request to transfer a data set from a source system to a target system over a network, activating, by an adaptive performance control (APC) controller, a primary data stream and a first secondary data stream from a set of allocated data streams to transfer the data set from the source system to the target system;
monitoring an overall throughput of the activated data streams for a first predetermined period of time;
deactivating the first secondary data stream from the activated data streams if the overall throughput drops below a first predetermined threshold over the first predetermined period of time;
suspending an operation of the APC controller for a second predetermined period of time in response to determining that the overall throughput drop is not greater than the first predetermined threshold and there is at least one allocated data stream that has been previously deactivated; and
reactivating the first secondary data stream that has been previously deactivated, after the second predetermined period of time.

9. The machine-readable medium of claim 8 , wherein the primary data stream remains activated during the transfer of the data set, and a secondary data stream can be activated, deactivated, or reactivated during the transfer of the data set.

10. The machine-readable medium of claim 8 , wherein a number of the activated data streams is adjusted based on the monitored overall throughput of the activated data streams, such that a maximum overall throughput of the activated data streams is reached while maintaining a minimum number of the activated data streams.

11. The machine-readable medium of claim 8 , wherein the operations further comprise:
determining whether all allocated data streams have been activated if the overall throughput does not drop below the first predetermined threshold;
iteratively performing monitoring the overall throughput for the first predetermined period of time and deactivating a secondary data stream, in response to determining that all allocated data streams have been activated.

12. The machine-readable medium of claim 8 , wherein the operations further comprise deactivating a third secondary data stream from the activated data streams, in response to determining that the overall throughput has gained less than a second predetermined threshold after activating of the first secondary data stream.

13. The machine-readable medium of claim 8 , wherein the operations further comprise iteratively performing activating the first secondary data stream and monitoring the overall throughput for the first predetermined period of time, if the overall throughput has gained more than or equal to the second predetermined threshold.

14. The machine-readable medium of claim 12 , wherein the operations further comprise determining whether all allocated data streams have been activated, wherein iteratively performing activating the first secondary data stream and monitoring the overall throughput for the first predetermined period of time is performed only if there is at least one allocated data stream that has not been activated.

15. A data processing system operating as a source system, comprising:
a processor; and
a memory storing instructions, which when executed by the processor, cause the processor to perform operations, the operations including
in response to a request to transfer a data set from a source system to a target system over a network, activating, by an adaptive performance control (APC) controller, a primary data stream and a first secondary data stream from a set of allocated data streams to transfer the data set from the source system to the target system,
monitoring an overall throughput of the activated data streams for a first predetermined period of time,
deactivating the first secondary data stream from the activated data streams if the overall throughput drops below a first predetermined threshold over the first predetermined period of time,
suspending an operation of the APC controller for a second predetermined period of time in response to determining that the overall throughput drop is not greater than the first predetermined threshold and there is at least one allocated data stream that has been previously deactivated, and
reactivating the first secondary data stream that has been previously de

Assignees

• Emc Corp
• Emc Ip Holding Co Llc

Inventors

• Armorer Peter
• Kulkarni Gururaj
• Chai Mu
• Muchalambe Uday Devidas
• Fernandes Roland Anthony

Classifications

• H04L47/12 Primary

  Avoiding congestion; Recovering from congestion · CPC title

• H04L65/608

  Electricity · mapped topic

• H04L65/601 Primary

  Electricity · mapped topic

• H04L43/0888

  Throughput · CPC title

• H04L65/65

  Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP] · CPC title