Load-based management for NVME over TCP connections

Patent metadata

Field	Value
Publication number	US-12438806-B2
Application number	US-202318520207-A
Country	US
Kind code	B2
Filing date	Nov 27, 2023
Priority date	May 18, 2022
Publication date	Oct 7, 2025
Grant date	Oct 7, 2025

Abstract

The disclosed systems, methods and computer readable media relate to managing Non-Volatile Memory Express (NVMe) over Transmission Control Protocol (TCP) (NVMeOTCP) connections between a smart network interface card (smartNIC) and a block storage data plane (BSDP) of a cloud computing environment. A software agent (“agent”) executing at the smartNIC may manage a number of network paths (active and, in some cases, passive network paths). The agent may monitor the network traffic (e.g., input/output operations (IOPS)) through the paths (e.g., using established NVMeOTCP connections corresponding to the paths). If a condition is met relating to a performance threshold associated with the monitored paths, the agent may increase or decrease the number established NVMeOTCP connections to match real time network conditions.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
identifying, by a software agent executing at a smart network interface card of a cloud-computing environment, a performance threshold associated with established network connections of one or more active network paths between the smart network interface card and a data plane component of the cloud-computing environment;
executing, by the software agent, operations that cause respective network connections for the one or more active network paths to be established between the smart network interface card and one or more endpoints associated with the data plane component of the cloud-computing environment; and
modifying, by the software agent, a quantity of established network connections of the one or more active network paths between the smart network interface card and the data plane component based at least in part on 1) comparing a throughput value associated with network traffic that utilizes the established network connections of the one or more active network paths to the performance threshold and 2) determining that the network traffic that utilizes the established network connections has met a condition related to the performance threshold.

2. The computer-implemented method of claim 1 , wherein the data plane component is a block storage volume.

3. The computer-implemented method of claim 1 , wherein executing the operations that cause the respective network connections for the one or more active network paths to be established comprises instructing a non-volatile memory express over transmission control protocol (NVMe/TCP) initiator of the smart network interface card to establish the one or more active network paths between the smart network interface card and the one or more endpoints associated with the data plane component.

4. The computer-implemented method of claim 1 , wherein the performance threshold corresponds to a number of input/output operations that are able to be processed by the data plane component over a time period.

5. The computer-implemented method of claim 1 , further comprising calculating a number of active network paths needed to meet the performance threshold associated with the data plane component, the number of active network paths being calculated based at least in part on a throughput capability associated with each active network path needed, wherein the one or more active network paths comprise the number of active network paths needed to meet the performance threshold.

6. The computer-implemented method of claim 1 , further comprising:
monitoring, by the software agent over a time period, network traffic of the one or more active network paths; and
calculating the throughput value based at least in part on identifying input/output operations of the network traffic over the time period.

7. The computer-implemented method of claim 1 , wherein modifying the quantity of the one or more active network paths comprises increasing the quantity of the one or more active network paths based at least in part on determining, by the software agent, that the throughput value has exceeded the performance threshold for at least a threshold period of time.

8. The computer-implemented method of claim 1 , further comprising receiving, from a block storage control plane, configuration information corresponding to the one or more active network paths to be established between the smart network interface card and the data plane component, wherein the quantity of the one or more active network paths is specified in the configuration information received from the block storage control plane.

9. The computer-implemented method of claim 8 , wherein the one or more active network paths form a first subset of a plurality of network paths, and wherein the configuration information identifies a second subset of the plurality of network paths corresponding to passive network paths for which no network connection has been established.

10. The computer-implemented method of claim 9 , wherein each passive network path serves as a failover when an established connection of an active network path becomes unavailable.

11. A smart network interface card, comprising:
one or more processors; and
one or more memories storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to:
receive, by a non-volatile memory express initiator of the smart network interface card from a software agent executing at the smart network interface card, instructions to establish connections for one or more active network paths between the smart network interface card and a data plane endpoint associated with a data plane resource, the smart network interface card being configured to determine whether throughput associated with network traffic that utilizes established network connections of the one or more active network paths has met a condition related to a performance threshold that is associated with the established network connections;
in response to receiving the instructions, establishing, by the non-volatile memory express initiator, the established network connections corresponding to the one or more active network paths between the smart network interface card and the data plane endpoint; and
modifying a quantity of the established network connections of the one or more active network paths based at least in part on receiving subsequent instructions from the software agent.

12. The smart network interface card of claim 11 , wherein the subsequent instructions received from the software agent comprise termination instructions, and wherein modifying the quantity of the established network connections of the one or more active network paths comprises terminating one or more established network connections of the one or more active network paths.

13. The smart network interface card of claim 12 , wherein the software agent transmits the termination instructions based at least in part on determining that a rate associated with the network traffic that utilizes the established network connections has fallen below the performance threshold.

14. The smart network interface card of claim 11 , wherein the subsequent instructions received from the software agent indicates an additional network connection is to be established between the smart network interface card and the data plane resource, and wherein modifying the quantity of the established network connections comprises establishing at least one additional network connection between the smart network interface card and the data plane resource.

15. The smart network interface card of claim 14 , wherein the software agent transmits the instructions based at least in part on determining that network traffic of the established network connections has exceeded the performance threshold.

16. The smart network interface card of claim 15 , wherein executing the computer-executable instructions further causes the one or more processors to update the performance threshold subsequent to modifying the quantity of the established network connections.

17. The smart network interface card of claim 11 , wherein executing the computer-executable instructions that modify the quantity of the established network connections comprises activating a passive network path of a path group and deactivating an active network path of the path group.

18. The smart network interface card of claim 17 , wherein executing the computer-executable instructions further causes the one or more processors to update configuration infor

Assignees

• Oracle Int Corp

Inventors

• Wang Qiang
• Lee Kent

Classifications

• H04L45/24

  Multipath · CPC title

• H04L43/067

  using time frame reporting · CPC title

• G06F3/0635

  by changing the path, e.g. traffic rerouting, path reconfiguration · CPC title

• H04L43/062

  related to network traffic · CPC title

• H04L41/046

  comprising network management agents or mobile agents therefor · CPC title