Restoring partitioned database tables from backup

Patent metadata

Field	Value
Publication number	US-10025673-B1
Application number	US-201314032870-A
Country	US
Kind code	B1
Filing date	Sep 20, 2013
Priority date	Sep 20, 2013
Publication date	Jul 17, 2018
Grant date	Jul 17, 2018

Abstract

A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to restore a given table that was backed up in a remote storage system (e.g., key-value durable storage system), the service may create a new table, and may import a copy of each of the partitions of the given table from the remote storage system into the new table. The request to restore the table may specify a modified value for a configuration parameter for the table or for one of its partitions. The service may apply the new configuration parameter value to the table or its partitions during the restore operation. The new configuration parameter value may indicate an increase or decrease in storage capacity or throughput capacity, and its application may automatically trigger a partition split or move operation.

First claim

The invention claimed is:

1. A system, comprising:
one or more processors;
a memory coupled to the one or more processors; and
a plurality of storage nodes, each of which comprises one or more storage devices or logical storage volumes;
wherein the memory stores program instructions that when executed by the one or more processors cause the one or more processors to implement a distributed database service;
wherein the distributed database service maintains data for a table in one or more partitions, wherein to maintain the data in the one or more partitions, the distributed database service is configured to store two or more replicas of each of the one or more partitions on respective storage devices or logical storage volumes of respective ones of the plurality of storage nodes;
wherein the distributed database service is further configured to store one or more configuration parameter values that are associated with the table, wherein the one or more configuration parameter values specify one or more of: a provisioned storage capacity for the table, a provisioned storage capacity for one of the one or more partitions, a provisioned throughput capacity for the table, a provisioned throughput capacity for one of the one or more partitions, or an attribute by which items in the table are indexed;
wherein a request router component of the distributed database service is configured to:
receive a request to back up the table in a remote storage system;

wherein in response to the request to back up the table, an administrative component of the distributed database service is configured to upload a copy of each of the one or more partitions to the remote storage system;
wherein the request router component is further configured to receive a request to restore the table from the remote storage system, wherein the request specifies a value for one of the one or more configuration parameters that is different than the corresponding stored configuration parameter value; and
wherein in response to the request to restore the table, the administrative component is configured to:
create a new table into which the copies of the one or more partitions are to be restored;
import the copies of each of the one or more partitions from the remote storage system into the new table such that each of the imported partition copies is stored on a storage device or logical storage volume of one of the plurality of storage nodes; and
apply to the new table the value for the one of the one or more configuration parameters that was specified in the request to restore the table.

2. The system of claim 1 , wherein, subsequent to applying to the new table the value for the one of the one or more configuration parameters that was specified in the request to restore the table, the administrative component is further configured to:
update a state of the new table to indicate that it is available to receive, accept, and service read or write requests that are directed to the new table.

3. The system of claim 1 , wherein in response to applying to the new table the value for the one of the one or more configuration parameters that was specified in the request to restore the table, the administrative component is further configured to split at least one of the imported partition copies into two or more new partitions for the new table.

4. The system of claim 1 , wherein in response to applying to the new table the value for the one of the one or more configuration parameters that was specified in the request to restore the table, the administrative component is further configured to move at least one of the imported partition copies to a storage device or logical storage volume other than the storage device or logical storage volume on which it was stored when it was imported.

5. The system of claim 1 ,
wherein the remote storage system comprises a key-value durable storage system;
wherein the distributed database service is configured to generate a respective backup identifier for each of the one or more partitions; and
wherein the respective backup identifier for the each of the one or more partitions is usable as a key for accessing the copy of the partition in the key-value durable storage system subsequent to the copy of the partition being uploaded to the remote storage system.

6. A method, comprising:
performing by one or more computers:
receiving a request to restore a table from a remote storage system into which the table was backed up, wherein the remote storage system stores a copy of each of one or more partitions of the table that were uploaded to the remote storage system when the table was backed up, wherein the request specifies a value for a configuration parameter of the table that is different than the value of the configuration parameter of the table when it was backed up, and wherein the configuration parameter value specifies an amount of a provisioned resource or an indexing attribute; and
in response to said receiving:
creating a new table into which the copies of the one or more partitions of the table are to be restored;
importing the copies of each of the one or more partitions from the remote storage system into the new table; and
applying to the new table the value for the configuration parameter that was specified in the request to restore the table.

7. The method of claim 6 , wherein the request specifies a value for a configuration parameter of the table that represents an increase in provisioned storage capacity or throughput capacity for at least one partition of the table.

8. The method of claim 7 , further comprising, in response to the increase in provisioned storage capacity or throughput capacity, splitting or moving the at least one partition of the table.

9. The method of claim 6 , wherein the request specifies a value for a configuration parameter of the table that represents a decrease in storage capacity or throughput capacity for at least one partition of the table.

10. The method of claim 9 , further comprising, in response to the decrease in provisioned storage capacity or throughput capacity, merging two or more partitions of the table.

11. The method of claim 6 , wherein the request specifies that the table is to be restored in a destination region or availability zone that is different than a source region or availability zone in which the table was previously backed up.

12. The method of claim 11 , wherein the method further comprises, prior to said receiving the request to restore the table:
receiving a request to copy a backup from the source region or availability zone to the destination region or availability zone, wherein the request to copy comprises an identifier of a backup of the table that was created in the source region or availability zone when the table was previously backed up; and
in response to receiving the request to copy the backup, copying the backup of the table that was created in the source region or availability zone from the source region or availability zone to the remote storage system, wherein the remote storage system is located in the destination region or availability zone.

13. The method of claim 6 ,
wherein the method further comprises selecting storage resources on which to create the new table; and
wherein said importing the copies of each of the one or more partitions comprises storing the imported partition copies on the selected storage resources.

14. The method of claim 13 , further comprising, subsequent to said importing, creating metadata associated with the new table that reflect a mapping of the imported partition copies to the selected storage r

Assignees

• Amazon Tech Inc

Inventors

• Maccanti Maximiliano
• Rath Timothy Andrew
• Pokkunuri Rama Krishna Sandeep
• Vig Akshat
• Ng Clarence Wing Yin
• Copparam Srivaths Badrinath
• Thiruchi Loganathan Rajaprabhu
• Xiao Wei
• Stevenson William Alexander

Classifications

• G06F11/1458 Primary

  Management of the backup or restore process · CPC title

• G06F11/1466

  to make the backup process non-disruptive · CPC title

• G06F2201/80

  Database-specific techniques · CPC title

• G06F11/2094

  Redundant storage or storage space (G06F11/2056 takes precedence) · CPC title

• G06F11/1451 Primary

  by selection of backup contents · CPC title