Transformation processing for objects between storage systems

Patent metadata

Field	Value
Publication number	US-10776322-B2
Application number	US-201715620892-A
Country	US
Kind code	B2
Filing date	Jun 13, 2017
Priority date	Dec 13, 2016
Publication date	Sep 15, 2020
Grant date	Sep 15, 2020

Abstract

A computer program product, system, and method for determining containers, within a secondary storage, to transform; determining users having access to the containers to transform; synchronizing storage configuration between the secondary storage and a primary storage; enumerating objects within the containers to transform; and adding object identifiers and object metadata for the enumerated objects to an object index within the primary storage.

First claim

What is claimed is:

1. A method for transformation processing between a primary storage system and a secondary storage system, the method comprising:
determining, by the primary storage system, containers within the secondary storage system to perform a transformation, the containers within the secondary storage system storing legacy data;
determining, by the primary storage system, users having access permissions to the containers subject to the transformation;
wherein the transformation includes:
synchronizing storage configuration between the secondary storage system and the primary storage system;
enumerating objects within the containers including querying the objects for corresponding object metadata; and
adding object identifiers and the object metadata for the enumerated objects to an object index within the primary storage system, the object index specifying a physical location in the secondary storage system where corresponding enumerated objects are stored; and

enabling access, by the primary storage system, to at least one of the objects stored on the secondary storage system, without migrating the at least one of the objects to the primary storage system, the access enabled by identifying a physical location of the at least one of the objects via a corresponding one of the object identifiers in the object index;
wherein enabling access to at least one of the objects includes processing input/output (IO) requests both during and after completion of the transformation, wherein during the transformation, the enabling access includes upon identifying that a request for an object in the secondary storage system has not yet been added to the object index, proxying, by the primary storage system, the request to the secondary storage system.

2. The method of claim 1 wherein determining users having access permissions to the containers includes determining users that have read or write access to one or more of the containers.

3. The method of claim 1 wherein synchronizing the storage configuration between the secondary storage system and the primary storage system includes synchronizing corresponding users and containers between the secondary storage system and the primary storage system.

4. The method of claim 1 wherein enumerating the objects within the containers includes:
generating a transformation user in the secondary storage system having access permissions to each of the containers; and
enumerating the objects within the containers using the transformation user.

5. The method of claim 1 further comprising:
receiving, as input at the primary storage system, a network address of the secondary storage system and credentials of one of the users in the secondary storage system having sufficient privileges to perform the transformation;
wherein the transformation commences in response to receiving the network address and the credentials.

6. A system for transformation processing between a primary storage system and a secondary storage system, the system comprising:
a processor;
a volatile memory; and
a non-volatile memory storing computer program code that when executed on the processor causes the processor to execute a process operable to perform the operations of:
determining, by the primary storage system, containers within the secondary storage system to perform a transformation, the containers within the secondary storage system storing legacy data;
determining, by the primary storage system, users having access permissions to the containers subject to the transformation;
wherein the transformation includes:
synchronizing storage configuration between the secondary storage system and the primary storage system;
enumerating objects within the containers including querying the objects for corresponding object metadata; and
adding object identifiers and the object metadata for the enumerated objects to an object index within the primary storage system, the object index specifying a physical location in the secondary storage system where corresponding enumerated objects are stored; and

enabling access, by the primary storage system, to at least one of the objects stored on the secondary storage system without migrating the at least one of the objects to the primary storage system, the access enabled by identifying a physical location of the at least one of the objects via a corresponding one of the object identifiers in the object index;
wherein enabling access to at least one of the objects includes processing input/output (IO) requests both during and after completion of the transformation, wherein during the transformation, the enabling access includes upon identifying that a request for an object in the secondary storage system has not yet been added to the object index, proxying, by the primary storage system, the request to the secondary storage system.

7. The system of claim 6 wherein determining users having access permissions to the containers includes determining users that have read or write access to one or more of the containers.

8. The system of claim 6 wherein synchronizing the storage configuration between the secondary storage system and the primary storage system includes synchronizing corresponding users and containers between the secondary storage system and the primary storage system.

9. The system of claim 6 wherein enumerating the objects within the containers includes:
generating a transformation user in the secondary storage system having access permissions to each of the containers; and
enumerating the objects within the containers using the transformation user.

10. The system of claim 6 wherein the computer program code that when executed on the processor causes the processor to execute a process further operable to perform the operations of:
receiving, as input at the primary storage system, a network address of the secondary storage system and credentials of one of the users in the secondary storage system having sufficient privileges to perform the transformation;
wherein the transformation commences in response to receiving the network address and the credentials.

11. A computer program product for transformation processing between a primary storage system and a secondary storage system, the computer program product tangibly embodied in a non-transitory computer-readable medium, the computer-readable medium storing program instructions that are executable to:
determine, by the primary storage system, containers within the secondary storage system to perform a transformation, the contains within the secondary storage system storing legacy data;
determine, by the primary storage system, users having access permissions to the containers subject to the transformation;
wherein the transformation includes:
synchronizing storage configuration between the secondary storage system and the primary storage system;
enumerating objects within the containers including querying the objects for corresponding object metadata; and
adding object identifiers and the object metadata for the enumerated objects to an object index within the primary storage system, the object index specifying a physical location in the secondary storage system where corresponding enumerated objects are stored; and

enabling access, by the primary storage system, to at least one of the objects stored on the secondary storage system without migrating the at least one of the objects to the primary storage system, the access enabled by identifying a physical location of the at least one of the objects via a corresponding one of the object identifiers in the object index;
wherein enabling access to at least one of the objects includes processing input/ou

Assignees

• Emc Ip Holding Co Llc

Inventors

• Danilov Mikhail
• Skripko Gregory
• Gutsalov Nikita
• Tchoub Ivan
• Fedorov Alexander
• Koyushev Sergey
• Gavrilova Maria

Classifications

• G06F16/1794 Primary

  Details of file format conversion · CPC title

• G06F16/258 Primary

  Data format conversion from or to a database · CPC title

• G06F16/289

  Object oriented databases · CPC title