Feeding networks of message brokers with compound data elaborated by dynamic sources

Patent metadata

Field	Value
Publication number	US-10572500-B2
Application number	US-201615052761-A
Country	US
Kind code	B2
Filing date	Feb 24, 2016
Priority date	Feb 24, 2016
Publication date	Feb 25, 2020
Grant date	Feb 25, 2020

Abstract

Various embodiments of the invention disclosed herein provide techniques for transforming and distributing data in a distributed computing system. New data types are created on-demand by deriving, transforming, and aggregating data from already existing data sources. A data transformation engine identifies a first subscription request received from a first subscriber for a first resource included in a plurality of resources. The data transformation engine determines that the first resource is not available from any publisher included in a plurality of publishers. The data transformation engine generates a transformation rule that transforms a set of second resources available from a set of first publishers included in the plurality of publishers into the first resource. The data transformation engine transforms the set of second resources into the first resource based on the inferred transformation rule. The data transformation engine publishes the first resource to the first subscriber.

First claim

What is claimed is:

1. A computer-implemented method for transforming and distributing data in a distributed computing system, comprising:
identifying a first subscription request received from a first subscriber for a first resource included in a plurality of resources;
determining that the first resource is not available from any publisher included in a plurality of publishers;
in response to determining that the first resource is not available from any publisher, generating, via a processor, a first transformation rule that combines at least a second resource available from a first publisher included in the plurality of publishers and a third resource available from a second publisher included in the plurality of publishers, wherein the first resource is derivable from at least the second resource and the third resource;
buffering the second resource while waiting for the third resource to be received;
in response to receiving the third resource, combining at least the second resource and the third resource to derive the first resource based on the first transformation rule; and
publishing the first resource to at least the first subscriber.

2. The computer-implemented method of claim 1 , further comprising, in response to determining that the first resource is not available from any publisher, determining that the first resource is derivable based on at least the second resource.

3. The computer-implemented method of claim 1 , further comprising:
identifying a second subscription request received from a second subscriber for a fourth resource included in the plurality of resources;
determining that the fourth resource is not available from any publisher included in the plurality of publishers;
generating a second transformation rule that transforms at least the first resource into the fourth resource;
transforming at least the first resource into the fourth resource based on the second transformation rule; and
publishing the fourth resource to the first subscriber.

4. The computer-implemented method of claim 1 , further comprising:
determining whether the second resource is associated with a second subscription request received from a second subscriber; and
if the second resource is not associated with a second subscription request, then generating a filter rule that routes the second resource from the first publisher to a transformation engine; or
if the second resource is associated with a second subscription request, then generating a filter rule that routes the second resource from the first publisher to both a transformation engine and a first message broker.

5. The computer-implemented method of claim 4 , further comprising, if the second resource is not associated with a second subscription request, then:
determining that the second resource is associated with a third subscription request received from a third subscriber; and
altering the filter rule to route the second resource from the first publisher to both a transformation engine and a first message broker.

6. The computer-implemented method of claim 1 , where the first transformation rule changes at least one of a reporting frequency associated with the second resource and a format associated with the second resource.

7. A non-transitory computer-readable storage medium including instructions that, when executed by a processor, cause the processor to transform and distribute data in a distributed computing system, by performing the steps of:
identifying a first subscription request received from a first subscriber for a first resource included in a plurality of resources;
determining that the first resource is not available from any publisher included in a plurality of publishers;
in response to determining that the first resource is not available from any publisher, generating, via a processor, a first transformation rule that combines at least a second resource available from a first publisher included in the plurality of publishers and a third resource available from a second publisher included in the plurality of publishers, wherein the first resource is derivable from at least the second resource and the third resource;
buffering the second resource while waiting for the third resource to be received;
in response to receiving the third resource, combining at least the second resource and the third resource to derive the first resource based on the first transformation rule; and
publishing the first resource to at least the first subscriber.

8. The non-transitory computer-readable storage medium of claim 7 , further comprising transmitting a message to a first message broker associated with the first subscriber that includes the first resource.

9. The non-transitory computer-readable storage medium of claim 7 , further comprising:
identifying a second subscription request received from a second subscriber for the second resource; and
transmitting a message to a second message broker associated with the second subscriber that includes the second resource.

10. The non-transitory computer-readable storage medium of claim 7 , further comprising:
identifying a second subscription request received from a second subscriber for a fourth resource included in the plurality of resources;
determining that the fourth resource is not available from any publisher included in the plurality of publishers;
generating a second transformation rule that transforms at least the first resource into the fourth resource;
transforming at least the first resource into the fourth resource based on the second transformation rule; and
publishing the fourth resource to the first subscriber.

11. The non-transitory computer-readable storage medium of claim 7 , further comprising:
determining whether the second resource is associated with a second subscription request received from a second subscriber; and
if the second resource is not associated with a second subscription request, then generating a filter rule that routes the second resource from the first publisher to a transformation engine; or
if the second resource is associated with a second subscription request, then generating a filter rule that routes the second resource from the first publisher to both a transformation engine and a first message broker.

12. The non-transitory computer-readable storage medium of claim 11 , further comprising, if the second resource is not associated with a second subscription request, then:
determining that the second resource is associated with a third subscription request received from a third subscriber; and
altering the filter rule to route the second resource from the first publisher to both a transformation engine and a first message broker.

13. The non-transitory computer-readable storage medium of claim 7 , further comprising:
identifying a second subscription request received from a second subscriber for a fourth resource included in the plurality of resources;
determining that the fourth resource is not available from any publisher included in the plurality of publishers;
generating a second transformation rule that transforms the first resource and a fifth resource included in the plurality of resources into the fourth resource;
transforming the first resource and the fifth resource into the fourth resource based on the second transformation rule; and
publishing the fourth resource to the first subscriber.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the fifth resource is available from a third publisher included in the plurality of publishers.

15. The non-transitory computer-readable stor

Assignees

• Verisign Inc

Inventors

• Schonfeld Daniel
• Maresca Paolo

Classifications

• G06F16/258 Primary

  Data format conversion from or to a database · CPC title

• H04L67/562 Primary

  Brokering proxy services · CPC title

• H04L67/565

  Conversion or adaptation of application format or content (adding application control or application functional data H04L67/561) · CPC title