Dynamically switching between data sources

Patent metadata

Field	Value
Publication number	US-10360231-B2
Application number	US-201615157127-A
Country	US
Kind code	B2
Filing date	May 17, 2016
Priority date	Jul 6, 2015
Publication date	Jul 23, 2019
Grant date	Jul 23, 2019

Abstract

In various embodiments, a data integration system is disclosed which enables dynamically switching between sources for loading data into a data warehouse by utilizing a source-dependent data store at the data warehouse.

First claim

What is claimed is:

1. A method comprising:
identifying, by a computing system, a plurality of data sources comprising a first data source and a second data source of data to be loaded to a data warehouse, the first data source comprising a business intelligence server and the second data source comprising a local table of the computing system;
receiving, by the computing system, information about the plurality of data sources and one or more data types of the data associated with the plurality of data sources;
selecting, by the computing system, a first transport mechanism from among a plurality of selectable transport mechanisms based at least in part on the first data source comprising the business intelligence server;
loading, by the computing system, a first subset of the data from the first data source into the data warehouse using the first transport mechanism;
identifying, at deployment time and by the computing system, that a second subset of the data is to be loaded from the second data source;
selecting, by the computing system, a second transport mechanism from among the plurality of selectable transport mechanisms based at least in part on the second data source comprising the local table of the computing system and a particular data type of the one or more data types that corresponds to the local table of the computing system, the second transport mechanism being different from the first transport mechanism; and
loading, by the computing system, the second subset of the data from the second data source into the data warehouse using the second transport mechanism.

2. A computer-readable medium storing program code that when executed by a processor of a computing system causes the processor to perform operations comprising:
identifying a plurality of data sources comprising a first data source and a second data source of data to be loaded to a data warehouse, the first data source comprising a business intelligence server and the second data source comprising a local table of the computing system;
receiving information about the plurality of data sources and one or more data types of the data associated with the plurality of data sources;
selecting a first transport mechanism from among a plurality of selectable transport mechanisms based at least in part on the first data source comprising the business intelligence server;
loading a first subset of the data from the first data source into the data warehouse using the first transport mechanism;
identifying, at deployment time, from which of the plurality of data sources to source a second subset of the data;
selecting a second transport mechanism from among the plurality of selectable transport mechanisms based at least in part on an identification and a particular data type of the one or more data types that corresponds to the identified data source, the second transport mechanism being different from the first transport mechanism; and
loading the second subset of the data from the identified data source into the data warehouse using the second transport mechanism.

3. A system, comprising:
a memory configured to store computer-executable instructions; and
a processor configured to access the memory and execute the computer-executable instructions to at least:
identify a plurality of data sources comprising a first data source and a second data source of data to be loaded to a data warehouse, the first data source comprising a business intelligence server and the second data source comprising a local table of the system;
select a first transport mechanism from among a plurality of selectable transport mechanisms based at least in part on the first data source comprising the business intelligence server;
load a first subset of the data from the first data source into the data warehouse using the first transport mechanism;
receive information about the plurality of data sources and one or more data types of the data associated with the plurality of data sources;
identify, at deployment time, from which of the plurality of data sources to source a second subset of the data;
select a second transport mechanism from among the plurality of selectable transport mechanisms based at least in part on the identification and a particular data type of the one or more data types that corresponds to the identified data source, the second transport mechanism being different from the first transport mechanism; and
load the second subset of the data from the identified data source into the data warehouse using the second transport mechanism.

4. The method of claim 1 , further comprising receiving at least the second subset of the data from the first data source.

5. The method of claim 1 , wherein selecting the second transport mechanism from among the plurality of selectable transport mechanisms based at least in part on the second data source comprising the local table of the computing system and the particular data type of the one or more data types comprises selecting an object-oriented database connectivity transport mechanism.

6. The method of claim 1 , wherein selecting the second transport mechanism from among the plurality of selectable transport mechanisms based at least in part on the second data source comprising the local table of the computing system and the particular data type of the one or more data types comprises selecting a Database link transport mechanism.

7. The method of claim 1 , wherein selecting the second transport mechanism from among the plurality of selectable transport mechanisms based at least in part on the second data source comprising the local table of the computing system and the particular data type of the one or more data types comprises selecting a source-dependent data store (SDS) transport mechanism.

8. The method of claim 1 :
wherein identifying that the data is to be loaded from the second data source further comprises identifying that the data is to be loaded from the second data source using a same mapping as used to connect to the first data source;
wherein the same mapping is an only mapping maintained by the computing system;
wherein loading the data from the second data source involves using the same mapping as used to connect to the first data source, the same mapping re-configured to source from the local table instead of the business intelligence server; and
further comprising configuring the same mapping to source from the local table instead of the business intelligence server.

9. The method of claim 1 , wherein identifying that the second subset of the data is to be loaded from the second data source is based at least in part on a parameter in a data integrator that enables users to switch data sources.

10. The method of claim 1 , wherein identifying that the data is to be loaded from the second data source further comprises using a Data Integration Agent to transfer the data into a dynamically created temporary target table, and wherein a respective target table corresponds to a respective loading knowledge module (LKM) of a physical design.

11. The computer-readable medium of claim 2 , wherein the operations further comprise:
receiving at least the second subset of the data from the first data source;
storing at least the second subset of the data as a text file in the second data source; and
converting data types of the data to the particular data type based at least in part on a mapping.

12. The computer-readable medium of claim 2 , wherein selecting the second transport mechanism from among the plurality of selectable transport mechanisms based at least in part on the identification and the particular data type of the one or more data types

Assignees

• Oracle Int Corp

Inventors

• Hyde Justin
• Titmas Jeff
• Vasireddy Gunaranjan

Classifications

• G06F16/211

  Schema design and management · CPC title

• G06F16/2365

  Ensuring data consistency and integrity · CPC title

• G06F16/254 Primary

  Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses · CPC title