Systems for sanitizing production data for use in testing and development environments

Patent metadata

Field	Value
Publication number	US-2021124842-A1
Application number	US-201916665157-A
Country	US
Kind code	A1
Filing date	Oct 28, 2019
Priority date	Oct 28, 2019
Publication date	Apr 29, 2021
Grant date	—

Abstract

An online data hub/portal that provides for data to be extracted from production environments, sanitized (removal of non-public information NPI) and loaded into non-production environment (e.g., testing and development environment)g. The online data hub/portal allows users to extract data from a disparate production applications into a first secure staging location that triggers identification of Non-Public Information (NPI), sanitization of the identified NPI and validation of the data (e.g., verifying that NPI has been identified and sanitized and that all relationships between data elements in downstream and upstream applications are kept intact). Once sanitized and validated, the data hub places the data in a second secure staging location that provides for loading the sanitized data into the non-production environment.

First claim

What is claimed is:

1 . A system for extracting and sanitizing production data for testing and development environments, the system comprising:
a plurality of production applications configured to process production data that comprises data elements including non-public information; a plurality of non-production applications configured for, at least one of, testing and developing prior to potential release as one of the plurality of production applications; and a computing platform in public network communication with the production and non-production applications and including a memory and at least one processor in communication with the memory, wherein the memory stores instructions that are executable by the at least one processor and configured to:
receive a first user request for a copy job, wherein the first user request includes first parameters defining one or more occurrence of copying user-specified production data from at least one of the production applications,
in response to receiving the user request, execute the copy job to capture the production data from the at least one of the production applications and copy the captured production data to a first secure staging location,
at the first staging location, identify, from within the data elements of the production data, the non-public information and sanitize the user-specified production data by replacing the identified non-public information with fictitious information,
copy the sanitized data to a second secure staging location,
receive a second user request for a load job, wherein the second user request includes second parameters defining one or more occurrences of loading the sanitized data from the second secure staging location to a plurality of the non-production applications, and
load the sanitized data from the second secure staging location to the plurality of the non-production applications.

2 . The system of claim 1 , wherein the instructions are further configured to, in response to sanitizing the user-specified production data, validate that the data elements of production elements that included the non-public information have replaced the non-public information with the fictitious information.

3 . The system of claim 2 , wherein the instructions configured to validate include instructions for insuring that relationships between date elements are maintained after the identified non-public information has been replaced with the fictitious information.

4 . The system of claim 1 , wherein the instructions configured to receive the first user request for the copy job are further configured to receive the first user request for the copy job including the first parameters that define a plurality of scheduled occurrences of copying the user-specified production data from the at least one of the production applications.

5 . The system of claim 4 , wherein the instructions configured to execute the copy job are further configured to execute the copy job in accordance with the plurality of scheduled occurrences of copying the user-specified production data from the at least one of the production applications.

6 . The system of claim 1 , wherein the instructions configured to copy the sanitized data to the second secure staging location further comprise instructions configured to maintain a copy of the sanitized data at the second secure staging location after loading the sanitized data to the plurality of the non-production applications.

7 . The system of claim 1 , wherein the instructions are further configured to, in response to receiving the first user request, verify that a user submitting the user request has authorized access to the at least one of the production applications.

8 . The system of claim 1 , wherein the instructions are further configured to, in response to copying the sanitized data to the second secure staging location, communicate an electronic notification to a user that notifies the user that the sanitized data is available for requesting second copy jobs.

9 . The system of claim 1 , wherein the instructions are further configured to monitor progress and completion of the instructions including of at least one of (i) the copy job, (ii) the identification of the non-public identification in the production data, (iii) the sanitization of the production data, and (iv) the load job.

10 . The system of claim 1 , wherein the instructions are further configured to log and store actions performed by the instructions including (i) the copy job, (ii) the identification of the non-public identification in the production data, (iii) the sanitization of the production data, and (iv) the load job.

11 . A computer-implemented method for extracting and sanitizing production for testing and development environments, the method implemented by one or more processing devices and including:
receiving a first user request for a copy job, wherein the first user request includes first parameters defining one or more occurrence of copying user-specified production data from at least one of the production applications; in response to receiving the user request, executing the copy job to capture the production data from the at least one of the production applications and copy the captured production data to a first secure staging location; at the first staging location, identifying, from within the data elements of the production data, the non-public information and sanitizing the production data by replacing the identified non-public information with fictitious information; copying the sanitized data to a second secure staging location; receiving a second user request for a load job, wherein the second user request includes second parameters defining one or more occurrences of loading the sanitized data from the second secure staging location to a plurality of the non-production applications; and loading the sanitized data from the second secure staging location to the plurality of the non-production applications.

12 . The computer-implemented method of claim 11 , further comprising, in response to sanitizing the user-specified production data, validating that the data elements of production elements that included the non-public information have replaced the non-public information with the fictitious information, wherein validating includes insuring that relationships between date elements are maintained after the identified non-public information has been replaced with the fictitious information.

13 . The computer-implemented method of claim 11 , wherein receiving the first user request for the copy job further comprises receiving the first user request for the copy job including the first parameters that define a plurality of scheduled occurrences of copying the user-specified production data from the at least one of the production applications, and executing the copy job further comprises executing the copy job in accordance with the plurality of scheduled occurrences of copying the user-specified production data from the at least one of the production applications.

14 . The computer-implemented method of claim 11 , further comprising maintaining a copy of the sanitized data at the second secure staging location after loading the sanitized data to the plurality of the non-production applications.

15 . The computer-implemented method of claim 11 , further comprising, in response to receiving the first user request, verifying that a user submitting the user request has authorized access to the at least one of the production applications.

16 . The computer-implemented method of claim 11 , furth

Assignees

• Bank Of America

Inventors

• Raju Sujata Devon
• Alladi Vinod Kumar
• Maratha Bhimeswar Rao Kharade
• Shanmugam Parthiban Tiruvayur
• Turaga Durga Prasad

Classifications

• G06F11/3698

  Environments for analysis, debugging or testing of software · CPC title

• G06V30/413

  Classification of content, e.g. text, photographs or tables · CPC title

• G06F2221/2143

  Clearing memory, e.g. to prevent the data from being stolen · CPC title

• G06F21/6218

  to a system of files or objects, e.g. local or distributed file system or database · CPC title

• G06F40/279

  Recognition of textual entities · CPC title