Data volume placement techniques

Patent metadata

Field	Value
Publication number	US-9823840-B1
Application number	US-201213466022-A
Country	US
Kind code	B1
Filing date	May 7, 2012
Priority date	May 7, 2012
Publication date	Nov 21, 2017
Grant date	Nov 21, 2017

Abstract

A storage management system monitors relationships between data sets stored on current implementation resources, such as a storage servers. The relationships may be used to determine whether a data set should be moved from a current implementation resource to an available implementation resource.

First claim

What is claimed is:

1. A computer-implemented method for managing storage, comprising:
under the control of one or more computer systems configured with executable instructions,
receiving information about a grouping relationship between a first storage volume stored on a physical storage of a storage server and a second storage volume stored on a physical storage of another storage server, the grouping relationship indicating a level of shared infrastructure for infrastructure shared by the storage server serving the first storage volume and the other storage server serving the second storage volume, wherein the physical storage of the storage server is local to the storage server and the physical storage of the other storage server is local to the other storage server and the physical storages of the storage server and the other storage server are separate from one another;
determining, based at least in part on the grouping relationship, at least one restriction for a placement decision for relocating the first storage volume to a new storage server, wherein the at least one restriction requires that after the first storage volume is relocated to the new server, the new storage server and the other storage server for the respective first and second storage volumes will have a lower level of shared infrastructure than the storage server and the other storage server currently storing the respective first and second storage volumes;
generating a placement decision identifying one or more available storage servers currently serving one or more other storage volumes from a set of available storage servers to serve the first storage volume that satisfies the at least one restriction, wherein the one or more available storage servers each comprise respective local physical storages that are separate from one another and separate from the physical storage of the storage server and separate from the separate physical storage of the other storage server; and
transferring the first storage volume to the one or more available storage servers identified in the placement decision, wherein transferring the first storage volume to the one or more available storage servers comprises moving data of the first storage volume from being stored on the physical storage of the storage server to being stored on the respective local physical storages of the one or more available storage servers identified in the placement decision.

2. The computer-implemented method of claim 1 , wherein the method further includes
receiving a client request for a placement of the first storage volume; and
wherein said generating a placement decision is in response to receiving the client request for the placement of the first storage volume.

3. The computer-implemented method of claim 1 , wherein transferring the first volume to the one or more available storage servers identified in the placement decision includes generating a workflow implementing the placement decision.

4. The computer-implemented method of claim 1 , wherein the grouping relationship is a storage virtualization relationship.

5. The computer-implemented method of claim 1 , the first storage volume and second storage volume have a mirroring relationship.

6. The computer-implemented method of claim 1 , wherein the first storage volume and second storage volume have a stripe relationship.

7. The computer implemented method of claim 1 , wherein the grouping relationship is based at least in part on a connection to a virtual machine having access to the first volume and the second volume.

8. A computer-implemented method for managing storage, comprising:
under the control of one or more computer systems configured with executable instructions,
determining, based at least in part on a relationship between a first volume stored at a storage server and a second volume stored at another storage server, at least one restriction for a placement decision for relocating the first volume to a new storage server, wherein the at least one restriction requires that after the first storage volume is relocated to the new server, the new storage server and the other storage server for the respective first and second storage volumes will have a lower level of shared infrastructure than the storage server and the other storage server currently storing the respective first and second storage volumes; and
generating a placement decision identifying one or more available storage servers currently serving one or more other volumes to serve the first volume that satisfies the at least one restriction, wherein the one or more available storage servers each comprise respective local physical storages that are separate from one another; and
transferring the first volume to the one or more identified available storage servers, wherein transferring the first volume to the one or more identified storage servers comprises moving data of the first volume from being stored at the storage server such that the first volume is stored in the respective local physical storages of the one or more identified available storage servers.

9. The computer-implemented method of claim 8 , wherein the method further includes generating a placement decision identifying one or more second available storage servers for the second volume that satisfies the at least one restriction.

10. The computer-implemented method of claim 9 , wherein the method further includes transferring the second volume to the one or more second available storage servers.

11. The computer-implemented method of claim 8 , wherein the at least one restriction includes matching a performance of underlying storage servers serving the first volume and the second volume.

12. The computer-implemented method of claim 8 , wherein the relationship is associated with a software application accessing the first volume and second volume.

13. A computer system for managing storage, comprising:
one or more processors; and
memory, including instructions executable by the one or more processors to cause the computer system to at least:
determine that a plurality of accesses to a set of related data sets match a relationship;
determine that a level of shared infrastructure for infrastructure shared by a storage server currently storing at least one data set of the related data sets and another storage server currently storing at least another data set of the related data sets is above a desired level of shared infrastructure;
generate, based on the determination, a placement decision for the set of related data sets identifying a new storage server to store the at least one data set, wherein the placement decision requires that after the at least one data set is transferred to the new storage server, the new storage server and the other storage server will have a lower level of shared infrastructure than the level of shared infrastructure for the storage server currently storing at least one data set of the related data sets and another storage server currently storing at least another data set; and
transfer the at least one data set of the set of related data sets to the new storage server, wherein to transfer the at least one data set to the new storage server, the at least one data set is moved from being stored in a local physical storage of the storage server to being stored in a local physical storage of the new storage server.

14. The computer system of claim 13 , wherein determining that one or more accesses to the set of related data sets matches a relationship further includes matching the relationship to a role.

15. The computer system of claim 14 , wherein the role

Assignees

• Brooker Marc J
• Richardson David R
• Certain Tate Andrew
• Holgers Tobias L
• Parthasarathy Madhuvanesh
• Amazon Tech Inc

Inventors

• Brooker Marc J
• Richardson David R
• Certain Tate Andrew
• Holgers Tobias L
• Parthasarathy Madhuvanesh

Classifications

• G06F3/0617 Primary

  in relation to availability · CPC title

• G06F3/0638

  Organizing or formatting or addressing of data · CPC title

• G06F3/06 Primary

  Digital input from, or digital output to, record carriers {, e.g. RAID, emulated record carriers or networked record carriers} · CPC title

• G06F7/16

  Combined merging and sorting · CPC title

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title