Point in Time Consistent Materialization for Object Storage Environments

Patent metadata

Field	Value
Publication number	US-2020110748-A1
Application number	US-201816235098-A
Country	US
Kind code	A1
Filing date	Dec 28, 2018
Priority date	Oct 6, 2018
Publication date	Apr 9, 2020
Grant date	—

Abstract

A query that is frequently processed to access an object storage is identified. Results from the query returned from the object storage is transformed into a relational database format as a materialized view. When the query is submitted a subsequent time, updated results are managed from the materialized view, other materialized views, and/or the object storage when needed.

First claim

1 . A method, comprising:
transforming storage object values provided with from an object storage as results to a query into a relational database format within a materialized view; maintaining storage object identifiers and timestamps as provided with storage objects associated with the storage object values from the object storage within the materialized view; and providing the materialized view to satisfy the query when submitted a second time without accessing the object storage.

2 . The method of claim 1 , wherein transforming further includes identifying the query as a particular query submitted more than a threshold amount of times for processing and processing a Structured Query Language (SQL) SELECT Data Manipulation Language (DML) statement that defines a mapping between the storage object values to a relational table format.

3 . The method of claim 1 wherein maintaining further includes, maintaining a filter representing text-formatted query conditions for the query with the MV.

4 . The method of claim 3 , wherein maintaining further includes periodically submitting the filter for the query to the object storage and updating the MV with new timestamps and new object values.

5 . The method of claim 4 , wherein updating further includes removing at least one storage object identifier and corresponding storage object values associated with the at least one storage object identifier.

6 . The method of claim 4 , wherein updating further includes adding at least one storage object identifier and corresponding storage object values associated with the at least one storage object identifier.

7 . The method of claim 1 , wherein providing further includes updating a portion of the storage object values with data values obtained from a different materialized view and a corresponding time stamp when a particular storage object identifier of the different materialized matches a corresponding storage object identifier of the materialized view and has a more recent time stamp.

8 . The method of claim 1 , wherein providing further includes updating a portion of the storage object values from the object storage based on a filter associated with a particular storage object identifier included in the materialized view.

9 . The method of claim 1 , wherein providing further includes provide the materialized view to satisfy the query without accessing the object storage.

10 . The method of claim 1 , wherein providing further includes updating the materialized view to satisfy the query by obtaining: first storage object values from different materialized views and second storage object values from the object store.

11 . The method of claim 10 further comprising, periodically refreshing the materialized view from the object storage based on a refresh policy.

12 . A method comprising:
identifying a frequently processed query that accesses an object storage; transforming results returned from the object storage into a relational database format as a materialized view; and managing the materialized view to provide updated results for the query a next time the query is processed.

13 . The method of claim 12 , wherein transforming further includes maintaining storage object identifiers and timestamps for each storage object identified in the results within the materialized view.

14 . The method of claim 12 , wherein managing further includes using the storage object identifiers and the timestamps to determine where different portions of the materialized view is to be updated from.

15 . The method of claim 15 , wherein using further includes obtaining some of the updated results from different materialized views.

16 . The method of claim 15 , wherein obtaining further includes obtaining another portion of the updated results from the object storage based on filters associated with particular storage object identifiers in the materialized view.

17 . The method of claim 12 further comprising, periodically refreshing the materialized view by obtaining new results from the object storage for the query based on a refresh policy.

18 . The method of claim 12 further comprising, automatically obtaining new results from the object storage for the query when a determination is made that more than a predefined portion of the results are out of date with the object storage or other materialized views.

19 . A system, comprising:
a database management system; at least one hardware processor; a non-transitory computer-readable storage medium having executable instructions representing a storage object materialized-view manager; the storage object materialized-view manager configured to execute on the at least one hardware processor from the non-transitory computer-readable storage medium and to perform processing to:
i) identify a query that frequently processes against an object storage;
ii) transform results returned from the object storage for the query into a relational format within a materialized view;
iii) manage updated results for the query when submitted a next time within the database management system from the materialized view, different materialized views associated with other queries, and the object storage.

20 . The system of claim 19 , wherein the storage object materialized-view manager is further configured to perform processing to: iv) refresh the materialized view with new results obtained from the object storage.

Assignees

• Teradata Us Inc

Inventors

• Watzke Michael Warren
• Cohen Steven B
• Pederson Donald Raymond

Classifications

• G06F16/2393 Primary

  Updating materialised views · CPC title

• G06F16/284

  Relational databases · CPC title

• G06F16/24539 Primary

  using cached or materialised query results · CPC title