Conversion of data integration system files

Patent metadata

Field	Value
Publication number	US-10089313-B2
Application number	US-201514626271-A
Country	US
Kind code	B2
Filing date	Feb 19, 2015
Priority date	Feb 19, 2015
Publication date	Oct 2, 2018
Grant date	Oct 2, 2018

Abstract

According to one embodiment, a system for converting data integration system (“DIS”) files comprises a memory operable to store data associated with at least one DIS and a processor communicatively coupled to the memory and operable to convert files associated with a first DIS to files associated with a second DIS. The operating system used by the first DIS is different from the operating system used by the second DIS. The processor converts the files by being operable to determine differences between the first DIS and the second DIS, determine a set of transformation rules based on the differences, create a conversion algorithm based on the set of transformation rules, and execute the conversion algorithm to convert the files. The system is further operable to execute the second DIS such that the second DIS uses the converted data integration files.

First claim

What is claimed is:

1. A system, comprising:
a memory operable to store data associated with at a least one data integration system; and
a processor communicatively coupled to the memory and the processor is operable to:
identify a first data integration system that uses a first operating system;
identify a first file format associated with data for the first data integration system, wherein the first file format is specific to the first operating system;
identify a second data integration system that that uses a second operating system, wherein the first operating system is different than the second operating system;
identify a second file format associated with data for the second data integration system, wherein the second file format is specific to the second operating system;
determine a plurality of differences between the first data integration system and the second data integration system, wherein the plurality of differences comprises:
format differences between the first file format and the second file format; and
operation differences between the first data integration system and the second data integration system;

determine a set of transformation rules, based at least in part on at least one of the plurality of differences, wherein the set of transformation rules describe how to convert data from the first file format to the second file format;
create a conversion algorithm, based at least in part on the set of transformation rules;
execute the conversion algorithm to convert a set of files associated with the first data integration system to a corresponding set of files associated with the second data integration system, wherein converting the set of files associated with the first data integration system comprises:
parsing the set of files associated with the first data integration system into a plurality of source tokens;
identifying source tokens from among the plurality of source tokens to convert to a target token;
converting the identified source tokens into target tokens;
sending the target tokens to a post-conversion file;
sending source tokens from among the plurality of source files that were not converted to target tokens to the post-conversion file; and
assembling the file associated with the second data integration system using source tokens and target tokens in the post-conversion file; and

execute the second data integration system, wherein the second data integration system uses at least one of the converted files associated with the second data integration system.

2. The system of claim 1 , wherein the plurality, of differences are determined, based least in part, on an additional plurality of differences between:
a first set of tokens associated with the first data integration system; and
a second set of tokens associated with the second data integration system.

3. The system of claim 1 , wherein:
the file associated with the first data integration system comprises a first set of multiple files, wherein the first set of multiple files comprises at least one of a .dsx and a .bat file associated with a first data integration application, wherein the first data integration application comprises instructions for executing at least one function of the first data integration system; and
the file associated with the second data integration system comprises a second set of multiple files, wherein the second set of multiple files comprises at least one of a .dsx, a .sh, and a .ksh file associated with a second data integration application, wherein the second data integration application comprises instructions for executing at least one function of the second data integration system.

4. The system of claim 3 , Wherein:
the first operating system is a version of a Windows operating system;
the second operating system is a version of a Linux operating system;
the first data integration application is a first version of DataStage; and
the second data integration application is a second version of DataStage.

5. The system of claim 1 , wherein;
the first data integration system comprises a first scheduler tool, wherein the first scheduler tool manages at least one function of a third data integration system; and
the second data integration system comprises a second scheduler tool, wherein the second scheduler tool manages at least one function of a fourth data integration system.

6. The system of claim 1 , wherein;
the first data integration system further comprises a first scheduler tool that uses the first operating system, wherein the first scheduler tool manages at least one function of the first data integration system;
the second data integration system further comprises a second scheduler tool that uses the second operating system, wherein the second scheduler tool manages at least one function of the second data integration system; and
the processor is further operable to:
determine an additional plurality of differences between the first scheduler tool and the second scheduler tool;
determine an additional set of transformation rules, based at least in part on at least one of the additional plurality of differences;
create an additional conversion algorithm, based at least in part on the additional set of transformation rules;
execute the additional conversion algorithm to convert a file associated with the first scheduler tool to a file associated with the second scheduler tool; and
execute the second scheduler tool, wherein the second scheduler tool uses the second at least one file.

7. The system of claim 6 , wherein:
the file associated with the first scheduler tool is a .jil file associated with a first scheduler application; and
the file associated with the second scheduler tool is a .jil file associated with a second scheduler application.

8. One or more non-transitory computer-readable media comprising logic, the logic When executed by one or more processors operable to perform operations comprising:
identifying a first data integration system that uses a first operating system;
identifying a first file format associated with data for the first data integration system, wherein the first file format is specific to the first operating system;
identifying a second data integration system that that uses a second operating system, wherein the first operating system is different than the second operating system;
identifying a second file format associated with data for the second data integration system, wherein the second file format is specific to the second operating system;
determining a plurality of differences between the first data integration system and the second data integration system, wherein the plurality of differences comprises:
format differences between the first file format and the second file format; and
operation differences between the first data integration system and the second data integration system;

determining a set of transformation rules, based at least in part on at least one of the plurality of differences, wherein the set of transformation rules describe how to convert data from the first file format to the second file format;
creating a conversion algorithm, based at least in part on the set of transformation rules;
executing the conversion algorithm to convert a set of files associated with the first data integration system to a corresponding set of files associated with the second data integration system, wherein converting the set of files associated with the first data integration system comprises:
parsing the set of files associated with the first data integration system into a plurality of source tokens;
identifying source tokens from among the plurality of source tokens to convert to a target token;
converting th

Assignees

• Bank Of America

Inventors

• Romano Brad E
• Abraham John

Classifications

• G06F16/119 Primary

  Details of migration of file systems (migration mechanisms in storage systems G06F3/0647) · CPC title

• G06F16/254

  Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses · CPC title

• G06F17/30563

  Physics · mapped topic

• G06F17/30079 Primary

  Physics · mapped topic