Online restore to different topologies with custom data distribution

Patent metadata

Field	Value
Publication number	US-11818012-B2
Application number	US-202217810195-A
Country	US
Kind code	B2
Filing date	Jun 30, 2022
Priority date	Nov 26, 2021
Publication date	Nov 14, 2023
Grant date	Nov 14, 2023

Abstract

Online restore may be performed between databases with different topologies while applying a custom data distribution. A request to restore a database into a different topology of nodes may be received. A plan to move different portions of the database from a current topology to the new topology made using a general distribution scheme. The plan may be performed to move the different portions of the database into the new topology and the database made available for access using the new topology. A background process may be applied to modify the distribution of the database at the new topology to match a custom distribution scheme that was implemented at the current topology.

First claim

What is claimed is:

1. A system, comprising:
a plurality of computing devices, respectively comprising at least one processor and a memory that implement a database service of a provider network, wherein the database service is configured to:
receive a request to restore a manually managed database currently hosted across a first topology of a first plurality of nodes as a service managed database, wherein the restore of the manually managed database as a service managed database restores the manually managed database into a second plurality of nodes with a second topology different than the first topology of the first plurality of nodes, wherein the manually managed database is distributed across the first topology of nodes according to a custom distribution scheme;
generate a plan to map different portions of the manually managed database in the first topology to respective target locations in the second plurality of nodes according to the second topology using a general distribution scheme;
perform the plan to map the different portions of the manually managed database in the first topology to the respective target locations in the second plurality of nodes according to the second topology;
after performing the plan:
make the service managed database available for access using the second plurality of nodes; and
modify, as a background process, the distribution of the service managed database across the second topology of the second plurality of nodes to match the custom distribution scheme.

2. The system of claim 1 , wherein the database service is configured to encrypt the manually managed database as part of the performance of the plan to move the different portions of the manually managed database in the first topology to the respective target locations in the second plurality of nodes according to the second topology.

3. A method, comprising:
receiving a request to restore a database currently hosted across a first topology of a first plurality of nodes into a second plurality of nodes with a second topology different than the first topology of the first plurality of nodes, wherein the database is distributed across the first topology of nodes according to a custom distribution scheme;
generating a plan to map different portions of the database in the first topology to respective target locations in the second plurality of nodes according to the second topology using a general distribution scheme;
performing the plan to map the different portions of the database in the first topology to the respective target locations in the second plurality of nodes according to the second topology;
after performing the plan:
making the database available for access using the second plurality of nodes; and
modifying, as a background process, the distribution of the database across the second topology of the second plurality of nodes to match the custom distribution scheme.

4. The system of claim 1 , wherein the database service is configured to merge one or more portions of the manually managed database into the second topology of the second plurality of nodes as part of the performance of the plan to move the different portions of the manually managed database in the first topology to the respective target locations in the second plurality of nodes according to the second topology.

5. The system of claim 1 , wherein to modify the distribution of the service managed database across the second topology of the second plurality of nodes to match the custom distribution scheme, the database service is configured to create one or more shadow tables of the service managed database to apply the modifications to match the custom distribution scheme.

6. The method of claim 3 , wherein performing the plan comprises encrypting the database as part of moving the different portions of the database in the first topology to the respective target locations in the second plurality of nodes according to the second topology.

7. The method of claim 3 , wherein the plan merges one or more portions of the database in the second topology of the second plurality of nodes as part of the performance of the plan to move the different portions of the database in the first topology to the respective target locations in the second plurality of nodes according to the second topology.

8. The method of claim 3 , wherein modifying the distribution of the database across the second topology of the second plurality of nodes to match the custom distribution scheme comprises creating one or more shadow tables of the database to apply the modifications to match the custom distribution scheme and swapping to the one or more shadow tables after the one or more shadow tables are made consistent.

9. The method of claim 3 , wherein the second topology includes at least one of a greater number of nodes or slices per node than the first topology.

10. The method of claim 3 , wherein a first query is performed by the second plurality of nodes using a query plan that utilizes the general distribution scheme, and wherein a second query is performed by the second query of nodes after the distribution of the database is modified across the second topology of the second plurality of nodes to match the custom distribution scheme using the custom distribution scheme.

11. The method of claim 3 , wherein generating the plan comprises obtaining a manifest that describes the first topology and mapping the different portions of the database in the first topology to the respective target locations in the second plurality of nodes according to the second topology using a round-robin distribution scheme.

12. The method of claim 3 , wherein the custom distribution scheme is a distribution scheme applied using respectively specified keys for one or more tables of the database.

13. The method of claim 3 , wherein the first topology is associated with a manual management mode for the database offered by a database service hosting the database and wherein the second topology is associated with a serverless management mode offered by the database service.

14. One or more non-transitory, computer-readable storage media, storing program instructions that when executed on or across one or more computing devices cause the one or more computing devices to implement:
receiving a request to restore a database currently hosted across a first topology of a first plurality of nodes into a second plurality of nodes with a second topology different than the first topology of the first plurality of nodes, wherein the database is distributed across the first topology of nodes according to a custom distribution scheme;
generating a plan to map different portions of the database in the first topology to respective target locations in the second plurality of nodes according to the second topology using a general distribution scheme;
performing the plan to map the different portions of the database in the first topology to the respective target locations in the second plurality of nodes according to the second topology;
after performing the plan:
making the database available for access using the second plurality of nodes; and
modifying, as a background process, the distribution of the database across the second topology of the second plurality of nodes to match the custom distribution scheme.

15. The one or more non-transitory, computer-readable storage media of claim 14 , wherein the plan merges one or more portions of the database in the second topology of the second plurality of nodes as part of the performance of the plan to move the different portions of the database in the first topology to t

Assignees

• Amazon Tech Inc

Inventors

• Gudipati Krishna Chaitanya
• Wangoo Sanjay
• Nagel Fabian Oliver
• Pandis Ippokratis
• Soundararajan Gokul
• Subrahmanyan Aditya
• Sreekanthan Induja
• Xiao Yao
• Shah Ankil
• Zhang Yehan
• Zhang Siyi
• Narkhede Vaishali Ravindra
• Chainani Naresh

Classifications

• H04L41/12 Primary

  Discovery or management of network topologies · CPC title

• G06F11/1464

  for networked environments · CPC title

• G06F11/1469

  Backup restoration techniques · CPC title

• G06F2201/80

  Database-specific techniques · CPC title

• H04L41/0826

  for reduction of network costs (H04L41/0833 takes precedence) · CPC title