Meta broker for publish-subscribe-based messaging

Patent metadata

Field	Value
Publication number	US-10645181-B2
Application number	US-201615376540-A
Country	US
Kind code	B2
Filing date	Dec 12, 2016
Priority date	Dec 12, 2016
Publication date	May 5, 2020
Grant date	May 5, 2020

Abstract

A messaging meta broker gateway for publish-subscribe messaging environments can provide connectivity, message routing, and subscription management between large numbers of clients and large numbers of brokers. The messaging meta broker gateway can provide access to large numbers of brokers to a client through a single connection. To a broker, the messaging meta broker gateway provides extremely wide fan-in and fan-out to gateway clients. To a service provider, the messaging meta broker gateway is a single system providing easy scaling with lightweight replication of instances, and shared, private, or virtual messaging environments supporting multiple customers and applications. The meta broker gateway can also connect gateway clients with other clients of the brokers, and also with archiving facilities. Protocol translation, security, and statistics logging are supported. The messaging meta broker gateway is suitable for cloud-based Internet-of-Things environments.

First claim

What is claimed is:

1. A method comprising:
establishing a plurality of connections between a messaging meta broker gateway and respective messaging meta broker clients, wherein the messaging meta broker gateway defines a persistless messages layer through which the messaging meta broker clients are coupled to a plurality of message brokers in a publish-subscribe messaging environment, and wherein the plurality of message brokers are configured to provide persistent storage of published messages;
at the messaging meta broker gateway, processing subscription requests and persistlessly transporting published messages received from the messaging meta broker clients, and subscribed messages received from the message brokers, across the messaging meta broker gateway, wherein the processing comprises:
responsive to receiving a first subscription request having a specified topic identifier from a first requesting messaging meta broker client over one of the connections, sending a second subscription request from the messaging meta broker gateway to one or more message brokers, among the plurality of message brokers, on behalf of the requesting messaging meta broker client; and
responsive to receiving, from a subsequent requesting messaging meta broker client, a subsequent subscription request having a same topic identifier as that specified in the first subscription request, adding the subsequent subscription request to a subscription mapping repository in lieu of sending a subscription request to any message broker for the subsequent subscription request; and

wherein the persistlessly transporting comprises:
receiving a plurality of the published messages, including a first published message, from the messaging meta broker clients, wherein the published messages comprise respective topic identifiers;
persistlessly routing the plurality of published messages to respective message brokers, among the plurality of message brokers connected to the messaging meta broker gateway, by the topic identifiers, according to a topic mapping repository; and
responsive to receiving a first one of the subscribed messages from any of the one or more message brokers within scope of the specified topic identifier, persistlessly fanning the first subscribed message out to a plurality of subscribing messaging meta broker clients indicated by the subscription mapping repository, wherein the plurality of subscribing messaging meta broker clients comprise the first requesting client and the subsequent requesting client;
wherein the first subscribed message has message and topic fields that are identical to message and topic fields of the first published message.

2. The method of claim 1 , wherein:
the plurality of message brokers accept messages of particular, different messaging protocols; and
the messaging meta broker gateway translates messages received from the messaging meta broker clients into the different messaging protocols of the plurality of message brokers.

3. The method of claim 1 , wherein:
the first subscription request is of a first messaging protocol;
at least one message broker of the one or more message brokers accepts subscription requests in a second, different messaging protocol; and
the messaging meta broker gateway translates the first subscription request from the first messaging protocol into the second messaging protocol before sending the second subscription request to the message broker.

4. The method of claim 1 , wherein:
routing the plurality of published messages among a plurality of message brokers by the topic identifiers according to a topic mapping repository also maps the plurality of published messages to at least one data repository according to the topic mapping repository.

5. The method of claim 1 , wherein:
choosing the one or more message brokers to which the second subscription request is sent based on the topic identifier according to the topic mapping repository.

6. The method of claim 1 , wherein:
the messaging meta broker relays messages from the messaging meta broker clients to the message brokers without persisting the messages in a queue and without persisting the messages in a database.

7. The method of claim 1 , wherein:
the messaging meta broker gateway is one of a plurality of messaging meta broker gateways, in the persistless layer, that cooperate to handle a flow of incoming messages; and
a total number of the messaging meta broker clients coupled through the messaging meta broker gateways to a given one of the plurality of message brokers exceeds a connection capacity of the given message broker.

8. The method of claim 7 wherein:
the topic mapping repository is a common topic mapping repository shared among the plurality of messaging meta broker gateways.

9. The method of claim 7 wherein:
mirror replicas of the topic mapping repository are held by respective ones of the plurality of messaging meta broker gateways.

10. The method of claim 1 , further comprising:
before the sending of the second subscription request from the messaging meta broker gateway to the one or more message brokers on behalf of the requesting messaging meta broker client, replacing a client identifier with an identifier of the messaging meta broker gateway in the second subscription request.

11. The method of claim 1 , wherein the messaging meta broker gateway supports published messages from the messaging meta broker gateway clients of the following messaging protocols: AMQP, MQTT, MQTT over WebSocket, OpenMAMA, and REST.

12. The method of claim 1 wherein:
the topic mapping repository maps topic identifiers to one or more respective of the message brokers.

13. The method of claim 12 wherein:
the topic mapping repository supports topic identifier patterns.

14. The method of claim 1 , further comprising:
responsive to receiving the first subscription request from the requesting messaging meta broker client, determining that the specified topic identifier is outside scope of any pre-existing entries in the subscription mapping repository;
based on the specified topic identifier, identifying within the topic mapping repository one or more sources, among the plurality of message brokers, persisting messages matching the specified topic identifier, wherein the identified one or more sources are the one or more message brokers to which the second subscription request is sent; and
adding at least one entry to the subscription mapping repository associating the requesting messaging meta broker client with the specified topic identifier.

15. The method of claim 1 , further comprising:
establishing a connection between a message broker and the messaging meta broker gateway, wherein the establishing is initiated by the messaging meta broker gateway.

16. A computer-implemented meta broker gateway system for publish-subscribe messaging, comprising:
a plurality of computing nodes comprising one or more processors and memory coupled thereto;
a common topic mapping repository shared among the plurality of computing nodes;
a plurality of internal network connections between the computing nodes;
respective ones of the plurality of computing nodes configured to host respective instances of a messaging meta broker gateway comprising:
a messaging meta broker gateway client-facing protocol adapter subsystem comprising a plurality of protocol adapters supporting respective messaging meta broker gateway client protocols, each protocol adapter being configured to support one or more messaging meta broker gateway client connections according to the respective client proto

Assignees

• Sap Se

Inventors

• Hoffner Andreas
• Sabiwalsky Dirk
• Fichter Timur

Classifications

• H04L67/26 Primary

  Electricity · mapped topic

• H04L67/55 Primary

  Push-based network services · CPC title