Communications for workloads

Patent metadata

Field	Value
Publication number	US-2022138021-A1
Application number	US-202117561903-A
Country	US
Kind code	A1
Filing date	Dec 24, 2021
Priority date	Jul 23, 2021
Publication date	May 5, 2022
Grant date	—

Abstract

Examples described herein relate to a sender process having a capability to select from use of a plurality of connections to at least one target process, wherein the plurality of connections to at least one target process comprise a connection for the sender process and/or one or more connections allocated per job. In some examples, the connection for the sender process comprises a datagram transport for message transfers. In some examples, the one or more connections allocated per job utilize a kernel bypass datagram transport for message transfers. In some examples, the one or more connections allocated per job comprise a connection oriented transport and wherein multiple remote direct memory access (RDMA) write operations for a plurality of processes are to be multiplexed using the connection oriented transport.

First claim

What is claimed is:

1 . A computer-readable medium comprising instructions stored thereon, that if executed by one or more processors, cause the one or more processors to:
provide a sender process with a capability to select from use of a plurality of connections to at least one target process, wherein the plurality of connections to at least one target process comprise a connection for the sender process and/or one or more connections allocated per job.

2 . The computer-readable medium of claim 1 , wherein the connection for the sender process comprises a datagram transport for message transfers.

3 . The computer-readable medium of claim 1 , wherein the one or more connections allocated per job utilize a kernel bypass datagram transport for message transfers.

4 . The computer-readable medium of claim 1 , wherein the one or more connections allocated per job comprise a connection oriented transport and wherein multiple remote direct memory access (RDMA) write operations for a plurality of processes are to be multiplexed using the connection oriented transport.

5 . The computer-readable medium of claim 1 , wherein the one or more connections allocated per job load balance message transmission for multiple processes over one or more connections.

6 . The computer-readable medium of claim 1 , wherein selection from use of a plurality of connections to at least one target process is based on one or more of: available memory for message queues, speed of message traversal to a destination, latency of message traversal to the destination, or message size.

7 . The computer-readable medium of claim 1 , wherein an intermediary or sender process is to select from use of a plurality of connections to at least one target process, wherein the plurality of connections to at least one target process comprise a connection for the sender process and/or one or more connections allocated per job and wherein the intermediary is to comprise one or more of: a process executing in kernel space on a processor, a process executing on an accelerator in a network interface device, or a process executing on a hardware accelerator in a host.

8 . The computer-readable medium of claim 1 , wherein the sender process is to perform an application based on Message Passing Interface (MPI).

9 . A method comprising:
a plurality of processes utilizing an intermediary for transfers of messages, wherein the intermediary establishes at least one connection oriented transport to at least one remote node and provides message transfers for a plurality of processes over at least one of the at least one connection oriented transport to the at least one remote node.

10 . The method of claim 9 , wherein the at least one connection oriented transport is consistent with one or more of: InfiniBand, Internet Wide Area RDMA Protocol (iWARP), Transmission Control Protocol (TCP), User Datagram Protocol (UDP), quick UDP Internet Connections (QUIC), RDMA over Converged Ethernet (RoCE) v2.

11 . The method of claim 9 , comprising:
providing reliable transport over the at least one connection oriented transport in addition to reliable transport provided by a sender process.

12 . The method of claim 9 , wherein:
at least one process of the plurality of processes utilizes a datagram transport for message transfers.

13 . The method of claim 9 , wherein:
at least one connection oriented transport to at least one remote node utilizes a Reliable Connection (RC) queue pair (QP) for message transfers.

14 . The method of claim 9 , wherein queue resources of the at least one connection oriented transport are configured within an on-network interface device memory or cache.

15 . An apparatus comprising:
a network interface device comprising circuitry configured to:
provide a sender process with a capability to select from use of a plurality of connections to at least one target process, wherein the plurality of connections to at least one target process comprise a connection for the sender process and/or one or more connections allocated per job.

16 . The apparatus of claim 15 , wherein the connection for the sender process comprises a datagram transport for message transfers.

17 . The apparatus of claim 15 , wherein the one or more connections allocated per job comprise a connection oriented transport and wherein multiple remote direct memory access (RDMA) write and/or read operations for a plurality of processes are to be multiplexed using the connection oriented transport.

18 . The apparatus of claim 15 , wherein selection from use of a plurality of connections to at least one target process is based on one or more of: available memory for message queues, speed of message traversal to a destination, latency of message traversal to the destination, or message size.

19 . The apparatus of claim 15 , wherein an intermediary or sender process is to select from use of a plurality of connections to at least one target process, wherein the plurality of connections to at least one target process comprise a connection for the sender process and/or one or more connections allocated per job and wherein the intermediary is to comprise one or more of: a process executing in kernel space on a processor, a process executing on an accelerator in a network interface device, or a process executing on a hardware accelerator in a host.

20 . The apparatus of claim 15 , wherein the network interface device comprises one or more of: a network interface controller (NIC), a remote direct memory access (RDMA)-enabled NIC, SmartNlC, router, switch, forwarding element, infrastructure processing unit (IPU), or data processing unit (DPU).

Assignees

• Intel Corp

Inventors

• Rimmer Todd
• Debbage Mark

Classifications

• H04L49/9047

  including multiple buffers, e.g. buffer pools · CPC title

• G06F9/546

  Message passing systems or structures, e.g. queues · CPC title

• G06F9/545 Primary

  where tasks reside in different layers, e.g. user- and kernel-space · CPC title

• G06F15/17331

  Distributed shared memory [DSM], e.g. remote direct memory access [RDMA] · CPC title

• G06F9/505

  considering the load · CPC title