Cloud object storage and versioning system

Patent metadata

Field	Value
Publication number	US-11829606-B2
Application number	US-202117345199-A
Country	US
Kind code	B2
Filing date	Jun 11, 2021
Priority date	Jun 12, 2020
Publication date	Nov 28, 2023
Grant date	Nov 28, 2023

Abstract

Systems and methods for cloud object storage and versioning are provided. In an example, a cloud object storage and versioning system (COSVS) coordinates insertion of metadata into a database and data into an object store in a compute infrastructure, the compute infrastructure including the database, the object store, a data source, and a client application interacting with the data source. The COSVS has an architecture comprising a client API layer confined to provide an interface to the client application to facilitate storing or restoring of items originally obtained from the data source, and query different versions of item content originally obtained from the data source; a deduplication layer to deduplicate item content and store items originally obtained from the data source devoid of external item metadata or semantic relations among items; and a packing layer confined to store and retrieve bytes of item or object content.

First claim

The invention claimed is:

1. A cloud object storage and versioning system (COSVS) to coordinate insertion of metadata into a database and data into an object store in a compute infrastructure, the compute infrastructure including the database, the object store, a data source, and a client application interacting with the data source, the COSVS comprising memory and one or more processors configured to implement:
a client API layer configured to provide an interface to the client application to facilitate storing or restoring of items originally obtained from the data source, and query different versions of item content originally obtained from the data source;
a deduplication layer configured to deduplicate item content and store items originally obtained from the data source devoid of external item metadata or semantic relations among items; and
a packing layer configured to store and retrieve bytes of item or object content, wherein the packing layer provides an interface for a key-value store of the deduplication layer, and wherein keys in the key-value store are assigned a meaning internally of the COSVS and are based at least in part on concatenation of content hashes from the deduplication layer with respective universally unique identifiers (UUIDs).

2. The COSVS of claim 1 , wherein the key-value store is for the client API layer, and wherein the keys in the key-value store have no semantic meaning externally of the COSVS.

3. The COSVS of claim 2 , wherein each key of the keys in the key-value store includes a universally unique identifier (UUID).

4. The COSVS of claim 1 , wherein the packing layer stores bytes of item or object content in packs, the packs based on a threshold item or object size, wherein items or objects below the threshold item or object size are packed together in a single pack, and wherein an item or object above the threshold item or object size is assigned to a pack by itself.

5. The COSVS of claim 1 , wherein the memory and the one or more processors are further configured to implement:
an intent logger to provide rollback functionality in an event of a malware event, system crash of the compute infrastructure, other application crash, or abort signal.

6. A method, at a cloud object storage and versioning system (COSVS), for coordinating insertion of metadata into a database and data into an object store in a compute infrastructure, the compute infrastructure including the database, the object store, a data source, and a client application interacting with the data source, the method comprising:
providing a client API layer for the COSVS, the client API layer configured to provide an interface to the client application to facilitate storing or restoring of items originally obtained from the data source, and query different versions of item content originally obtained from the data source;
providing a deduplication layer for the COSVS, the deduplication layer configured to deduplicate item content and store items originally obtained from the data source devoid of external item metadata or semantic relations among items; and
providing a packing layer for the COSVS, the packing layer configured to store and retrieve bytes of item or object content, wherein the packing layer provides an interface for a key-value store of the deduplication layer, and wherein keys in the key-value store are assigned a meaning internally of the COSVS and are based at least in part on concatenation of content hashes from the deduplication layer with respective universally unique identifiers (UUIDs).

7. The method of claim 6 , wherein the key-value store is for the client API layer, and wherein the keys in the key-value store have no semantic meaning externally of the COSVS.

8. The method of claim 7 , wherein each key of the keys in the key-value store includes a universally unique identifier (UUID).

9. The method of claim 6 , wherein the packing layer stores bytes of item or object content in packs, the packs based on a threshold item or object size, wherein items or objects below the threshold item or object size are packed together in a single pack, and wherein an item or object above the threshold item or object size is assigned to a pack by itself.

10. The method of claim 9 , further comprising:
providing an intent logger for the COSVS, the intent logger to provide rollback functionality in an event of a malware event, system crash of the compute infrastructure, other application crash, or abort signal.

11. A non-transitory machine-readable medium comprising instructions which, when read by a machine, causes the machine to perform operations, at a cloud object storage and versioning system (COSVS) for coordinating insertion of metadata into a database and data into an object store in a compute infrastructure, the compute infrastructure including the database, the object store, a data source, and a client application interacting with the data source, wherein the instructions, when read by the machine, cause the machine to:
provide a client API layer for the COSVS, the client API layer configured to provide an interface to the client application to facilitate storing or restoring of items originally obtained from the data source, and query different versions of item content originally obtained from the data source;
provide a deduplication layer for the COSVS, the deduplication layer configured to deduplicate item content and store items originally obtained from the data source devoid of external item metadata or semantic relations among items; and
provide a packing layer for the COSVS, the packing layer configured to store and retrieve bytes of item or object content, wherein the packing layer provides an interface for a key-value store of the deduplication layer, and wherein keys in the key-value store are assigned a meaning internally of the COSVS and are based at least in part on concatenation of content hashes from the deduplication layer with respective universally unique identifiers (UUIDs).

12. The non-transitory, machine-readable medium of claim 11 , wherein the key-value store is for the client API layer, and wherein the keys in the key-value store have no semantic meaning externally of the COSVS.

13. The non-transitory, machine-readable medium of claim 12 , wherein each key of the keys in the key-value store includes a universally unique identifier (UUID).

14. The non-transitory, machine-readable medium of claim 11 , wherein the packing layer stores bytes of item or object content in packs, the packs based on a threshold item or object size, wherein items or objects below the threshold item or object size are packed together in a single pack, and wherein an item or object above the threshold item or object size is assigned to a pack by itself.

15. The non-transitory, machine-readable medium of claim 11 , wherein the instructions, when read by the machine, cause the machine to:
provide an intent logger for the COSVS, the intent logger to provide rollback functionality in an event of a malware event, system crash of the compute infrastructure, other application crash, or abort signal.

Assignees

• Rubrik Inc

Inventors

• Derryberry Jonathan Carlyle
• Bavarian Mohammad
• Katuri Sai Kiran
• Honnungar Sagar Kashinath
• Shanker Harish Raman
• Vu Amelia
• Pandey Prateek
• Terei David Anthony
• Jain Vikas
• Madhavarapu Pradeep

Classifications

• G06F3/0619 Primary

  in relation to data integrity, e.g. data losses, bit errors · CPC title

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title

• G06F3/0641

  De-duplication techniques · CPC title

• G06F3/0659

  Command handling arrangements, e.g. command buffers, queues, command scheduling · CPC title

• G06F11/0772

  Means for error signaling, e.g. using interrupts, exception flags, dedicated error registers · CPC title