Export data from tables into partitioned folders on an external data lake
US-2024211491-A1 · Jun 27, 2024 · US
US2020004837A1 · US · A1
| Field | Value |
|---|---|
| Publication number | US-2020004837-A1 |
| Application number | US-201816025299-A |
| Country | US |
| Kind code | A1 |
| Filing date | Jul 2, 2018 |
| Priority date | Jul 2, 2018 |
| Publication date | Jan 2, 2020 |
| Grant date | — |
A practical reading order for non-experts. Skip the full description unless you need deep technical detail.
What the patent document calls the invention.
A short plain-language summary of the technical disclosure.
Who owns or filed the patent and who is credited as inventor.
Filing, priority, publication, and grant dates set the timeline.
The legal scope of protection — read this for what is actually claimed.
Technology tags used to group this patent with similar filings.
Prior art links and similar publications in this corpus.
Official abstract text for this publication.
A system, method and the like for front-end comprehensive validation of data files that require processing by multiple different computing systems having different validation requirements. Validation for all of the multiple different computing systems is performed upon receipt of the data file by the data processing entity and, as such, in the event that validation results in an error/failure, the originator/sender of the data file can be notified of the error failure proximate in time to when the data file is transmitted to the data processing entity and can re-submit a valid data file in due time. In addition, the present invention is configured to insure that the validation meets the current requirements of all the computing systems that process the data file by employing a centralized data file validation requirements database that stores validation requirements for each of the computing systems.
Opening claim text (preview).
1 . A system for front-end validation of a data file requiring processing by a plurality of computing systems, the system comprising: a first computing platform disposed in a distributed computing network and including a first memory and at least one first processor in communication with the memory; a centralized data file validation requirements database stored in the first memory, accessible by the at least one first processor and configured to store one or more data file validation requirements for each of a plurality of downstream computing systems; a second computing platform disposed in the distributed computing network and including a second memory and at least one second processor in communication with the memory; and a data file validation application stored in the second memory, executable by the at least one second processor and configured to: in response to receiving a data file, identify (i) two or more of the downstream computing systems that will process the data file, and (ii) one or more file format attributes, access the centralized data file validation requirements database to retrieve data file validation requirements for the two or more of the downstream computing systems, validate that the file format of the data file complies with the data file validation requirements of the two or more of the downstream computing systems by comparing the file format attributes to the retrieved data file validation requirements, and in response to validating, authorize the data file for processing by the two or more of the downstream computing systems. 2 . The system of claim 1 , wherein the data file validation application is further configured to: in response to receiving the data file, scan the data file to identify data entries in predetermined data fields, and validate that the data entries comply with the data file validation requirements of the two or more of the downstream computing systems by comparing the data entries to the retrieved data file validation requirements. 3 . The system of claim 1 , wherein the predetermined data fields are mandatory data fields required for performing processing by the two or more of the downstream computing systems. 4 . The system of claim 1 , wherein the data file validation application is further configured to: in response to receiving the data file, scan the data file to identify all data entries in the data file, and validate that all of the data entries comply with the data file validation requirements of the two or more of the downstream computing systems. 5 . The system of claim 1 , wherein the centralized data file validation requirements database is in active communication with a plurality of the downstream computing systems, such that changes made to one of the plurality downstream computing systems that affect formatting, are reflected in a real-time update to a corresponding one of the data file validation requirements stored in the centralized data file validation requirements database. 6 . The system of claim 1 , wherein the data file validation application is further configured to: validate that the file format of the data file complies with the data file validation requirements of the two or more of the downstream computing systems by performing pattern matching of the file format attributes to the data file validation requirements of the two or more of the downstream computing systems. 7 . The system of claim 6 , wherein the data file validation application is further configured to: validate that the file format of the data file complies with the data file validation requirements of the two or more of the downstream computing systems by verifying that common file format attributes associated with the two or more of the downstream computing systems match the data file. 8 . The system of claim 7 , wherein the data file validation application is further configured to: validate that the file format of the data file complies with the data file validation requirements of the two or more of the downstream computing systems by, in response to verifying that the common file format attributes do match the data file validation requirements, verifying one or more unique format attributes for at least one of the two or more of the downstream computing systems match the data file validation requirements. 9 . The system of claim 1 , further comprising: a third computing platform disposed in a distributed computing network and including a third memory and at least one third processor in communication with the memory; and a plurality of data file entry applications stored in the third memory, executable by the third processor and configured to provide user interfaces for inputting the data file and initiating communication of the data file to the data file validation application. 10 . The system of claim 9 , wherein the data file validation application is further configured to: in response to validating the file format of the data file communicate, via one of the data file entry applications used to initiate communication of the data file, a first real-time notification that is configured to indicate that the data file has been validated and a that data processing by the computing systems id ensuing; and in response to failing to validate the file format of the data file based on non-compliance with the data file validation requirements of the two or more of the downstream computing systems, communicate, via one of the data file entry applications used to initiate communication of the data file, a real-time notification that is configured to indicate expected formatting requirements and a need to re-submit the data file that meets the expected formatting requirements. 11 . A computer-implemented method for front-end validation of a data file requiring processing by a plurality of computing systems, the method executed by a computing device processor and comprising: in response to receiving a data file, identifying (i) two or more of the downstream computing systems that will process the data file, and (ii) one or more file format attributes; accessing a centralized data file validation requirements database to retrieve data file validation requirements for the two or more of the downstream computing systems; validating that the file format of the data file complies with the data file validation requirements of the two or more of the downstream computing systems by comparing the one or more file format attributes to the retrieved data file validation requirements; and in response to validating, authorizing the data file for processing by the two or more of the downstream computing systems. 12 . The computer-implemented method of claim 11 , further comprising: in response to receiving the data file, scanning the data file to identify data entries in predetermined data fields; and validating that the data entries comply with the data file validation requirements of the two or more of the downstream computing systems by comparing the data entries to the retrieved data file validation requirements, wherein the predetermined data fields are mandatory data fields required for performing processing by the two or more of the downstream computing systems. 13 . The computer-implemented method of claim 11 , wherein validating further comprises: validating that the file format of the data file complies with the data file validation requirements of the two or more of the downstream computing systems by performing pattern matching of the file format attributes to the data file validation requirements of the two or more of the downstream computing systems. 14
using management policies (point-in-time backing up or restoration of persistent data G06F11/1446; file migration policies for HSM systems G06F16/185) · CPC title
Ensuring data consistency and integrity · CPC title
Details of conversion of file system types or formats · CPC title
Physics · mapped topic
Physics · mapped topic
Related publications grouped by family.
Answers are generated from the same data shown on this page.