Automated management of data transformation flows based on semantics

Patent metadata

Field	Value
Publication number	US-11663228-B2
Application number	US-202016743847-A
Country	US
Kind code	B2
Filing date	Jan 15, 2020
Priority date	Jan 15, 2020
Publication date	May 30, 2023
Grant date	May 30, 2023

Abstract

Various embodiments are provided for intelligent management of data flows in a computing environment by a processor. One or more data transformation in time-series data applications templates may be created and managed according to concepts, one or more instances of the concepts, relationships between the concepts, and a mapping of the concepts to one or more data sources.

First claim

What is claimed is:

1. A method for intelligent management of data flows in a computing environment by a processor comprising:
automatically creating and managing one or more data transformation templates in time-series data applications according to concepts indicative of semantic descriptions of the time-series data applications represented in a graph of nodes, one or more instances of the concepts, relationships between the concepts, and a mapping of the concepts to one or more data sources, wherein the creating and managing of the one or more data transformation templates comprises initializing the one or more transformation templates by receiving transformation code specific to one or more of the concepts from a user;
creating new data sources representing an output of the one or more data transformation templates and mapping the new data sources to the concepts describing the output of the one or more data transformation templates, wherein the creating of the new data sources representing the output comprises performing one or more data transformations by the one or more data transformation templates; and
in response to the creating of the new data sources, using the newly created data sources by inferring additional data to generate additional data transformations.

2. The method of claim 1 , further including representing the semantic description of the time-series data applications using a semantic database according to the concepts, the one or more instances of the concepts, the relationships between the concepts, and the mapping of the concepts to the one or more data sources.

3. The method of claim 1 , further including receiving the one or more data transformation templates and meta information specifying concepts of inputs and outputs of the data transformation.

4. The method of claim 1 , further including creating one or more instances of the one or more data transformation templates applied to the one or more data sources that match the one or more instances of a concept describing input data to the one or more data transformation templates.

5. The method of claim 1 , further including mapping the time-series data, the one or more data sources, and the concepts, or a combination thereof to a semantic database.

6. The method of claim 1 , further including:
monitoring and detecting one or more changes in the one or more data sources and the concepts; or
creating the additional data transformation templates upon determining the one or more data transformation templates are invalid.

7. A system for providing intelligent management of data flows in a computing environment, comprising:
one or more processors with executable instructions that when executed cause the system to:
automatically create and manage one or more data transformation templates in time-series data applications according to concepts indicative of semantic descriptions of the time-series data applications represented in a graph of nodes, one or more instances of the concepts, relationships between the concepts, and a mapping of the concepts to one or more data sources, wherein the creating and managing of the one or more data transformation templates comprises initializing the one or more transformation templates by receiving transformation code specific to one or more of the concepts from a user;
create new data sources representing an output of the one or more data transformation templates and mapping the new data sources to the concepts describing the output of the one or more data transformation templates, wherein the creating of the new data sources representing the output comprises performing one or more data transformations by the one or more data transformation templates; and
in response to the creating of the new data sources, use the newly created data sources by inferring additional data to generate additional data transformations.

8. The system of claim 7 , wherein the executable instructions further represent the semantic description of the time-series data applications using a semantic database according to the concepts, the one or more instances of the concepts, the relationships between the concepts, and the mapping of the concepts to the one or more data sources.

9. The system of claim 7 , wherein the executable instructions further receive the one or more data transformation templates and meta information specifying the concepts of inputs and outputs of the data transformation.

10. The system of claim 7 , wherein the executable instructions further create one or more instances of the one or more data transformation templates applied to the one or more data sources that match the one or more instances of a concept describing input data to the one or more data transformation templates.

11. The system of claim 7 , wherein the executable instructions further map the time-series data, the one or more data sources, and the concepts, or a combination thereof to a semantic database.

12. The system of claim 7 , wherein the executable instructions further:
monitor and detect one or more changes in the one or more data sources and the concepts; or
create the additional data transformation templates upon determining the one or more data transformation templates are invalid.

13. A computer program product for, by one or more processors, providing intelligent management of data flows in a computing environment, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:
an executable portion that automatically creates and manages one or more data transformation templates in time-series data applications according to concepts indicative of semantic descriptions of the time-series data applications represented in a graph of nodes, one or more instances of the concepts, relationships between the concepts, and a mapping of the concepts to one or more data sources, wherein the creating and managing of the one or more data transformation templates comprises initializing the one or more transformation templates by receiving transformation code specific to one or more of the concepts from a user;
an executable portion that creates new data sources representing an output of the one or more data transformation templates and mapping the new data sources to the concepts describing the output of the one or more data transformation templates, wherein the creating of the new data sources representing the output comprises performing one or more data transformations by the one or more data transformation templates; and
an executable portion that, in response to the creating of the new data sources, uses the newly created data sources by inferring additional data to generate additional data transformations.

14. The computer program product of claim 13 , further including an executable portion that represents the semantic description of the time-series data applications using a semantic database according to the concepts, the one or more instances of the concepts, the relationships between the concepts, and the mapping of the concepts to the one or more data sources.

15. The computer program product of claim 13 , further including an executable portion that receives the one or more data transformation templates and meta information specifying the concepts of inputs and outputs of the data transformation.

16. The computer program product of claim 13 , further including an executable portion that creates one or more instances of the one or more data transformation templates applied to th

Assignees

• IBM

Inventors

• Fusco Francesco
• Gormally Robert
• Purcell Mark
• Tirupathi Seshu

Classifications

• G06F16/2474 Primary

  Sequence data queries, e.g. querying versioned data · CPC title

• G06F16/2477 Primary

  Temporal data queries · CPC title

• G06F16/24575

  using context · CPC title

• G06F16/284

  Relational databases · CPC title

• G06F9/3005

  to perform operations for flow control · CPC title