Assignment of data temperatures in a fragmented data set

Patent metadata

Field	Value
Publication number	US-9734173-B2
Application number	US-201313797785-A
Country	US
Kind code	B2
Filing date	Mar 12, 2013
Priority date	Mar 12, 2013
Publication date	Aug 15, 2017
Grant date	Aug 15, 2017

Abstract

A plurality of data records that comprise a data set can be stored in a plurality of main part fragments such that each main part fragment includes a subset of the set of data records. Each fragment of the plurality of main part fragments can be assigned a relative data temperature. A newly arrived data record for storage in the data set can be placed in a delta part, and a merge can be performed to add the newly arrived data record to a corresponding main part fragment. The performing of the merge can occur more quickly if the corresponding main part fragment has a higher relative data temperature than if the corresponding main part fragment has a lower relative data temperature.

First claim

What is claimed is:

1. A computer program product comprising a non-transitory machine-readable medium storing instructions that, when executed by at least one programmable processor, cause the at least one programmable processor to perform operations comprising:
storing, in a first main part fragment and a second main part fragment of a database, a plurality of data records that comprise a data set, the first main part fragment and the second main part fragment each comprising a subset of the set of data records;
assigning, to the first main part fragment and the second main part fragment, a respective relative data temperature, the first main part fragment being assigned a higher relative data temperature than the second main part fragment when the first main part fragment comprises data that arrived more recently than data comprising the second main part fragment;
placing, in a delta part of the database, a first newly arrived data record and a second newly arrived data record for storage in the data set; and
performing, based at least on the first main part fragment having the higher relative data temperature than the second main part fragment, a merge to add the first newly arrived data record to the first main part fragment before another merge is performed to add the second newly arrived data record to the second main part fragment.

2. A computer program product as in claim 1 , wherein the respective relative data temperature is based, at least in part, on an order of arrival of the data records in the data set.

3. A computer program product as in claim 1 , wherein the operations further comprise preferentially keeping the first main part fragment in memory relative to the second main part fragment when the relative data temperature of the first main part fragment is greater than the relative data temperature of the second main part fragment.

4. A computer program product as in claim 1 , wherein the assigning of the respective relative data temperature comprises determining the respective relative data temperature based at least on an implicit data temperature by timing of an arrival of the data in each of the first main part fragment and the second main part fragment.

5. A computer program product as in claim 1 , wherein the assigning of the respective relative data temperature comprises applying one or more access-based criteria.

6. A computer program product as in claim 1 , wherein the assigning of the respective relative data temperature comprises using a semantically-defined data temperature.

7. The computer program product of claim 1 , further comprising updating, based at least on an order of arrival of the first newly arrived data record and the second newly arrived data record, the respective relative data temperature of the first main part fragment and the second main part fragment.

8. A system, comprising:
at least one processor; and
a machine-readable medium storing instructions that, when executed by the at least one programmable processor, cause the at least one programmable processor to perform operations comprising:
storing, in a first main part fragment and a second main part fragment of a database, a plurality of data records that comprise a data set, the first main part fragment and the second main part fragment each comprising a subset of the set of data records;
assigning, to the first main part fragment and the second main part fragment, a respective relative data temperature, the first main part fragment being assigned a higher relative data temperature than the second main part fragment when the first main part fragment comprises data that arrived more recently than data comprising the second main part fragment;
placing, in a delta part of the database, a first newly arrived data record and a second newly arrived data record for storage in the data set; and
performing, based at least on the first main part fragment having the higher relative data temperature than the second main part fragment, a merge to add the first newly arrived data record to the first main part fragment before another merge is performed to add the second newly arrived data record to the second main part fragment.

9. A system as in claim 8 , wherein the respective relative data temperature is based, at least in part, on an order of arrival of the data records in the data set.

10. A system as in claim 8 , wherein the operations further comprise preferentially keeping the first main part fragment in memory relative to the second main part fragment when the relative data temperature of the first main part fragment is greater than the relative data temperature of the second main part fragment.

11. A system as in claim 8 , wherein the assigning of the respective relative data temperature comprises determining the respective relative data temperature based at least on an implicit data temperature by timing of an arrival of the data in each of the first main part fragment and the second main part fragment.

12. A system as in claim 8 , wherein the assigning of the respective relative data temperature comprises applying one or more access-based criteria.

13. A system as in claim 8 , wherein the assigning of the respective relative data temperature comprises using a semantically-defined data temperature.

14. A computer-implemented method, comprising:
storing, in a first main part fragment and a second main part fragment of a database, a plurality of data records that comprise a data set, the first main part fragment and the second main part fragment each comprising a subset of the set of data records;
assigning, to the first main part fragment and the second main part fragment, a respective relative data temperature, the first main part fragment being assigned a higher relative data temperature than the second main part fragment when the first main part fragment comprises data that arrived more recently than data comprising the second main part fragment;
placing, in a delta part of the database, a first newly arrived data record and a second newly arrived data record for storage in the data set; and
performing, based at least on the first main part fragment having the higher relative data temperature than the second main part fragment, a merge to add the first newly arrived data record to the first main part fragment before another merge is performed to add the second newly arrived data record to the second main part fragment.

15. A computer-implemented method as in claim 14 , wherein the respective relative data temperature is based, at least in part, on an order of arrival of the data records in the data set.

16. A computer-implemented method as in claim 14 , wherein the operations further comprise preferentially keeping the first main part fragment in memory relative to the second main part fragment when the relative data temperature of the first main part fragment is greater than the relative data temperature of the second main part fragment.

17. A computer-implemented method as in claim 14 , wherein the assigning of the respective relative data temperature comprises determining the respective relative data temperature based at least on an implicit data temperature by timing of an arrival of the data in each of the first main part fragment and the second main part fragment.

18. A computer-implemented method as in claim 14 , wherein the assigning of the respective relative data temperature comprises applying one or more access-based criteria.

19. A computer program product as in claim 14 , wherein the assigning of the respective relative dat

Assignees

• Schreter Ivan
• Thomsen Dirk
• Florendo Colin
• French Blaine
• Sap Se

Inventors

• Schreter Ivan
• Thomsen Dirk
• Florendo Colin
• French Blaine

Classifications

• G06F16/23

  Updating · CPC title

• G06F16/22 Primary

  Indexing; Data structures therefor; Storage structures · CPC title

• G06F17/30312 Primary

  Physics · mapped topic

• G06F17/30345

  Physics · mapped topic