System and method for enabling etl (extract-transform-load) as a service
US-2022405294-A1 · Dec 22, 2022 · US
US12339865B2 · US · B2
| Field | Value |
|---|---|
| Publication number | US-12339865-B2 |
| Application number | US-202318241472-A |
| Country | US |
| Kind code | B2 |
| Filing date | Sep 1, 2023 |
| Priority date | Jul 19, 2023 |
| Publication date | Jun 24, 2025 |
| Grant date | Jun 24, 2025 |
A practical reading order for non-experts. Skip the full description unless you need deep technical detail.
What the patent document calls the invention.
A short plain-language summary of the technical disclosure.
Who owns or filed the patent and who is credited as inventor.
Filing, priority, publication, and grant dates set the timeline.
The legal scope of protection — read this for what is actually claimed.
Technology tags used to group this patent with similar filings.
Prior art links and similar publications in this corpus.
Official abstract text for this publication.
Various methods and processes, apparatuses/systems, and media for processing of multiple files having different formats and structures are disclosed. The method includes identifying a plurality of data files each having a predefined file format and structure and viewing corresponding file status. The plurality of data files being received from various data sources. The method implements a generic single ETL processor for front loading of ETL in a manner such that user input is received to configure the plurality of files and transmit to multiple downstream systems for further processing via UI mapping. Data file configuration screen can be used to search list of files configured under any report masters along with its status. This configuration screen can be also used to configure new external source files or edit an existing one thereby providing, among others, user controlled data loads, reducing tech dependency, providing reusability and scalability, and eliminating manual overrides.
Opening claim text (preview).
What is claimed is: 1. A method for processing of multiple files having different formats and structures by utilizing one or more processors and one or more memories, the method comprising: implementing a data processing module (DPM) configured to implement a generic single ETL (Extract-Transform-Load) processor for configuring and loading multiple files having different formats and structures which can be extended to a plurality of files, the DPM including an identifying module, an implementing module, a receiving module, an uploading module, a monitoring module, a determining module, an outputting module, and a communication module, wherein each module being called via corresponding application programming interface (API); identifying, by calling the identifying module, a plurality of data files each having a predefined file format and structure and viewing corresponding file status, the plurality of data files being received from various data sources; implementing, by calling the implementing module, a user interface (UI) platform that includes a configuration UI layer, an upload UI layer, and an external data dashboard screen, wherein the external data dashboard screen receives user input from the user to search the plurality of data files that have been submitted and view file status, wherein the configuration UI layer includes an external data file configuration page which receives user input from the user to configure the plurality of data files and fields that are to be generated in multiple downstream systems and see status of already configured files, wherein the upload UI layer includes an external data file upload screen which receives user input from the user to upload the plurality of data files being received from the various data sources into the multiple downstream systems; receiving user input, via the configuration UI layer, to configure the files and corresponding fields that are to be generated in the multiple downstream systems for further processing via UI mapping; receiving, by calling the receiving module, approval for the files that has been configured; uploading, in response to receiving approval, the files via the upload UI layer by calling the uploading module; monitoring the uploaded files by calling the monitoring module; determining, by calling the determining module, that an uploaded file is valid based on matching corresponding configuration details and file rules received from the generic single ETL processor; transmitting, by calling the communication module, the valid file to a corresponding downstream system based on received corresponding output configuration and outbound rules; outputting, by calling the outputting module, a final publication by the downstream system based on receiving the valid file; implementing, by calling the implementing module, the generic single ETL processor for the front loading of ETL; and plugging components of the generic single ETL processor along with front loading approach to an application in the downstream system. 2. The method according to claim 1 , further comprising: receiving user input to configure the corresponding fields available in the files to consume in a host platform; and redirecting the files to any field available in the downstream system based on user selection. 3. The method according to claim 1 , wherein in implementing the front loading approach, the method further comprising: receiving user input via the configuration UI layer to define: a predefined file format of each of said plurality of data files; standard nomenclature; and attributes. 4. The method according to claim 3 , wherein the predefined file format includes one or more of the following file formats: .pdf, .doc, .csv, .xls, and .xlsx. 5. The method according to claim 4 , wherein, in a case where the predefined file format is .xls, the attributes include indication as to where to start reading, and wherein, in a case where the predefined file format is .doc, the attributes include indication of what type of delimiter is utilized. 6. The method according to claim 1 , wherein each of said plurality of data files belongs to a particular reporting master, wherein the reporting master is a logical grouping of all similar data files having same end usage as a part of financial statements, and wherein the reporting master is client and financial institution agnostic. 7. A system for processing of multiple files having different formats and structures, the system comprising: a processor; and a memory operatively connected to the processor via a communication interface, the memory storing computer readable instructions, when executed, causes the processor to: implement a data processing module (DPM) configured to implement a generic single ETL (Extract-Transform-Load) processor for configuring and loading multiple files having different formats and structures which can be extended to a plurality of files, the DPM including an identifying module, an implementing module, a receiving module, an uploading module, a monitoring module, a determining module, an outputting module, and a communication module, wherein each module being called via corresponding application programming interface (API); identify, by calling the identifying module, a plurality of data files each having a predefined file format and structure and viewing corresponding file status, the plurality of data files being received from various data sources; implement, by calling the implementing module, a user interface (UI) platform that includes a configuration UI layer, an upload UI layer, and an external data dashboard screen, wherein the external data dashboard screen receives user input from the user to search the plurality of data files that have been submitted and view file status, wherein the configuration UI layer includes an external data file configuration page which receives user input from the user to configure the plurality of data files and fields that are to be generated in multiple downstream systems and see status of already configured files, wherein the upload UI layer includes an external data file upload screen which receives user input from the user to upload the plurality of data files being received from the various data sources into the multiple downstream systems; receive user input, via the configuration UI layer, to configure the files and corresponding fields that are to be generated in the multiple downstream systems for further processing via UI mapping; receive, by calling the receiving module, approval for the files that has been configured; upload, in response to receiving approval, the files via the upload UI layer by calling the uploading module; monitor the uploaded files by calling the monitoring module; determine, by calling the determining module, that an uploaded file is valid based on matching corresponding configuration details and file rules received from the generic single ETL processor; transmit, by calling the communication module, the valid file to a corresponding downstream system based on received corresponding output configuration and outbound rules; output, by calling the outputting module, a final publication by the downstream system based on receiving the valid file; implement, by calling the implementing module, the generic single ETL processor for the front loading of ETL; and plug components of the generic single ETL processor along with front loading approach to an application in the downstream system. 8. The system according to claim 7 , wherein the processor is further configured to: receive user input to configure the corresponding fields available in the files to consume in a host platform; and redirect the files to any field available in the downstream syste
Execution arrangements for user interfaces · CPC title
Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses · CPC title
Related publications grouped by family.
Answers are generated from the same data shown on this page.