System and method for data error notification in interconnected data production systems

Patent metadata

Field	Value
Publication number	US-11023304-B2
Application number	US-202016798721-A
Country	US
Kind code	B2
Filing date	Feb 24, 2020
Priority date	Oct 28, 2019
Publication date	Jun 1, 2021
Grant date	Jun 1, 2021

Abstract

An error notification system includes a plurality of data production systems in communication with a monitoring server. Each data production system has a data processor configured to receive input data from a first set of data production systems, process the input data to produce output data, and make the output data accessible to a second set of data production systems. The monitoring server is configured to monitor data transmissions between the data production systems and to identify, for each data transmission, originating and receiving systems. The monitoring server is further configured to map data flow from each originating source system to identify all downstream data production systems. Upon identification of a data error in the originating source system, the monitoring server obtains data error information, assembles a data error notification, and transmits the data error notification to data production systems meeting system notification criteria.

First claim

What is claimed is:

1. A data production error notification system comprising:
a plurality of data production systems, each data production system having a data processor configured to
receive input data from any other of the plurality of data production systems,
process the received input data to produce output data,
make the output data accessible to any other of the plurality of data production systems, and
responsive to identification of a data error in the production of the output data, generate data error information; and

a monitoring server in communication with each of the plurality of data production systems, the monitoring server being configured to
monitor data transmissions between the data production systems,
map data flow from each data production system to identify all downstream data production systems receiving transmitted data from each data production system or data derived from such transmitted data, and
upon identification of a data error in a data transmission originating data production system,
obtain data error information,
assemble a data error notification including an identification of the originating data production system and the data error information, and
transmit the data error notification to those of the plurality of data production systems that meet system notification criteria.

2. A system according to claim 1 , wherein the system notification criteria specifies notification of all data production systems downstream of the originating data production system.

3. A system according to claim 1 , wherein
the monitoring server is further configured to determine, for each data transmission, one or more operating characteristics of an originating source system associated with the transmitted data.

4. A system according to claim 3 , wherein the one or more operating characteristics is a software tool.

5. A system according to claim 3 , wherein the system notification criteria specifies notification of each of the plurality of data production systems having one of the one or more operating characteristics in common with the originating data production system.

6. A system according to claim 1 , wherein
each data production system has an error monitor configured to
identify a format of the output data,
determine whether the output data format matches an expected format, and
responsive to a determination that the output data format does not match the expected format, notify the monitoring server that a data error in the production of the output data has been identified.

7. A system according to claim 1 ,
wherein the monitoring server is further configured to determine, based at least in part on the data error information, a risk level associated with the data error, and
wherein the risk level is included in the data error notification.

8. A system according to claim 1 ,
wherein the data processor of each data production system is further configured to, upon receiving a data error notification from the monitoring server, determine whether input data received from the originating data production system should be processed, and
wherein the actions to process the received input data from the originating data production system and to make the output data accessible are carried out only upon a positive determination that the input data should be processed.

9. A system according to claim 8 ,
wherein the monitoring server is further configured to determine, based at least in part on the data error information, a risk level associated with the data error,
wherein the risk level is included in the data error notification, and
wherein the action of the data processor to determine whether the input data from the originating data production system should be processed is carried out using the risk level.

10. A method of mitigating error propagation risk in a plurality of interconnected data production systems, the method comprising:
monitoring, by a monitoring server in communication with the plurality of data production systems, a plurality of data transmissions between the data production systems, each data transmission being from a transmitting system to a receiving system,
mapping, by the monitoring server, data flow between the data production systems,
receiving, by the monitoring server, an error message indicating that a data error has occurred in an originating source system, the error message including data error information,
assembling, by the monitoring server, a data error notification including an identification of the originating source system and the data error information, and
transmitting, by the monitoring server, the data error notification to those of the plurality of data production systems that meet system notification criteria.

11. A method according to claim 10 , wherein the system notification criteria specifies notification of the data production systems that have received transmitted data from that originating source system.

12. A method according to claim 10 , further comprising:
determining, by the monitoring server, for each data transmission, one or more operating characteristics of the originating source system.

13. A method according to claim 12 , wherein the system notification criteria specifies notification of each of the plurality of data production systems having one of the one or more operating characteristics in common with the originating source system.

14. A method according to claim 13 , wherein the one of the one or more operating characteristics is a software tool.

15. A method according to claim 10 , wherein the error message is received from an error monitor in the originating source system.

16. A method according to claim 10 , wherein the error message is received from an error monitor in a receiving processing system downstream of the originating source system.

17. A method according to claim 10 , further comprising:
determining, by the monitoring server, based at least in part on the data error information, a risk level associated with the data error,
wherein the risk level is included in the data error notification.

18. A data production monitoring server comprising:
a communication interface in communication with each of a plurality of data production systems, the communication interface being configured for receiving data transmission information for each data transmission between data production systems;
a mapping processor configured to identify, for each data production system originating a data transmission, all data production systems that have received transmitted data generated by that originating data production system, and
a notification processor configured to, upon identification of a data error in the originating data production system,
obtain data error information,
assemble a data error notification including an identification of the originating data production system and the data error information, and
transmit, via the communication interface, the data error notification to data production systems that meet system notification criteria.

19. A data production monitoring server according to claim 18 , wherein the system notification criteria specifies notification of at least one of the set consisting of all data production systems that have received transmitted data generated by the originating data production system and all data production systems having a predetermined operating characteristic in common with the originating source system.

20. A data production monitoring server

Assignees

• Capital One Services Llc

Inventors

• Pham Vincent
• Farivar Reza
• Key Kate
• Goodsitt Jeremy
• Watson Mark
• Abad Fardin Abdi Taghi
• Truong Anh
• Walters Austin

Classifications

• B60G2600/602

  high pass · CPC title

• B60G2500/30

  Height or ground clearance · CPC title

• G06F11/0772

  Means for error signaling, e.g. using interrupts, exception flags, dedicated error registers · CPC title

• G06F11/3051

  Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs (verification or detection of system hardware configuration G06F11/2247) · CPC title

• G06F11/0781

  Error filtering or prioritizing based on a policy defined by the user or on a policy defined by a hardware/software module, e.g. according to a severity level · CPC title