Granular creation and refresh of columnar data

Patent metadata

Field	Value
Publication number	US-9606921-B2
Application number	US-201414337045-A
Country	US
Kind code	B2
Filing date	Jul 21, 2014
Priority date	Sep 21, 2013
Publication date	Mar 28, 2017
Grant date	Mar 28, 2017

Abstract

Techniques are provided for granular load and refresh of columnar data. In an embodiment, a particular data object that contains particular data formatted different from column-major format is maintained, the particular data including first data and second data. First and second data objects contain the first and second data, respectively, organized in the column-major format. In response to changes being committed to the first data in the particular data object, invalidating one or more rows of the first data object. In response to a number of invalidated rows of the first data object exceeding a threshold, automatically performing a refresh operation on the first data object independent of any refresh operation on the second data object.

First claim

What is claimed is:

1. A method comprising:
maintaining a particular data object that contains particular data formatted different from column-major format, wherein the particular data includes first data and second data;
maintaining a first data object that contains the first data organized in the column-major format;
maintaining a second data object that contains the second data organized in the column-major format;
in response to changes being committed to the first data in the particular data object, invalidating one or more rows of the first data object;
in response to refresh criteria being satisfied relative to the first data object, automatically performing a refresh operation on the first data object independent of any refresh operation on the second data object;
in response to changes being committed to the second data in the particular data object, invalidating one or more rows of the second data object; and
in response to refresh criteria being satisfied relative to the second data object, automatically performing a refresh operation on the second data object independent of any refresh operation on the first data object.

2. The method of claim 1 , wherein a single set of journal extents is used to maintain an indication of which rows are invalid for both the first data object and the second data object.

3. The method of claim 1 , wherein maintaining the particular data object comprises maintaining the particular data object formatted in row-major format in a persistent storage, and wherein maintaining the first data object comprises maintaining the first data object in a volatile memory.

4. The method of claim 1 , wherein the particular data object comprises at least one of a table, a table partition, a table sub-partition, one or more segments, a set of segments, one or more extents, a set of extents, a set of block of data, one or more columns of a table, one or more on-disk extents, or a set of data.

5. The method of claim 1 , wherein automatically performing the refresh operation on the first data object comprises automatically performing the refresh operation on the first data object in response to a number of invalidated rows of the first data object exceeding an invalidated row count threshold.

6. The method of claim 1 , wherein automatically performing the refresh operation on the first data object comprises automatically performing the refresh operation on the first data object in response to a number of invalidated rows of the first data object exceeding a percentage threshold.

7. The method of claim 1 , wherein automatically performing the refresh operation on the first data object comprises automatically performing the refresh operation on the first data object in response to a number of new rows within a block range of the first data object added to the particular data object after creation of the first data object exceeding a new row count threshold.

8. The method of claim 1 , wherein automatically performing the refresh operation on the first data object comprises automatically creating a replacement data object for the first data object, the replacement data object containing a more current version of the first data than a version of the first data contained in the first data object, the first data in the replacement data object organized in the column-major format, and further comprising deleting the first data object after automatically creating the replacement data object.

9. The method of claim 1 , wherein automatically performing the refresh operation on the first data object comprises automatically creating a replacement data object for the first data object using the first data included in the first data object and at least one of the particular data or a journal associated with the first data object, the journal including a record of each change to one or more portions of the first data after creation of the first data object, each change to the one or more portions of the first data mirroring each respective change to corresponding one or more portions of the particular data.

10. The method of claim 1 , wherein automatically performing the refresh operation on the first data object comprises automatically creating a replacement data object for the first data object using the particular data or a journal associated with the first data object, the journal including a record of each change to one or more portions of the first data after creation of the first data object, each change to the one or more portions of the first data mirroring each respective change to corresponding one or more portions of the particular data.

11. The method of claim 1 , wherein a record file is associated with the first data object and the second data object, the record file including a record of changes to one or more portions of the first data after creation of the first data object and changes to one or more portions of the second data after creation of the second data object, the changes to the one or more portions of the first and second data mirroring each respective change to corresponding one or more portions of the first and second data in the particular data object.

12. The method of claim 1 , wherein the refresh operation comprises one or more background processes of a database server having access to the particular data object, first data object, and second data object.

13. The method of claim 1 , wherein the refresh criteria is satisfied relative to the first data object when a number of invalid rows of the first data object exceeds a threshold.

14. One or more non-transitory storage media storing instructions which, when executed by one or more processors, cause:
maintaining a particular data object that contains particular data formatted different from column-major format, wherein the particular data includes first data and second data;
maintaining a first data object that contains the first data organized in the column-major format;
maintaining a second data object that contains the second data organized in the column-major format;
in response to changes being committed to the first data in the particular data object, invalidating one or more rows of the first data object;
in response to refresh criteria being satisfied relative to the first data object, automatically performing a refresh operation on the first data object independent of any refresh operation on the second data object;
in response to changes being committed to the second data in the particular data object, invalidating one or more rows of the second data object; and
in response to refresh criteria being satisfied relative to the second data object, automatically performing a refresh operation on the second data object independent of any refresh operation on the first data object.

15. The one or more non-transitory storage media of claim 14 , wherein a single set of journal extents is used to maintain an indication of which rows are invalid for both the first data object and the second data object.

16. The one or more non-transitory storage media of claim 14 , wherein maintaining the particular data object comprises maintaining the particular data object formatted in row-major format in a persistent storage, and wherein maintaining the first data object comprises maintaining the first data object in a volatile memory.

17. The one or more non-transitory storage media of claim 14 , wherein the particular data object comprises at least one of a table, a table partition, a table sub-partition, one or more segments, a set of segments, one or more extents, a set of extents, a set of block

Assignees

• Oracle Int Corp

Inventors

• Kamp Jesse
• Marwah Vineet
• Ganesh Amit
• Gleeson Michael
• Venkatachalam Maheswaran
• Holloway Allison
• Mukherjee Niloy
• Hase Sanket

Classifications

• G06F2212/313

  In storage device · CPC title

• G06F12/0815 Primary

  Cache consistency protocols · CPC title

• G06F17/30312

  Physics · mapped topic

• G06F17/30477

  Physics · mapped topic

• G06F3/064

  Management of blocks · CPC title