Fine-grained shared multi-tenant de-duplication system

Patent metadata

Field	Value
Publication number	US-11663196-B2
Application number	US-202117513342-A
Country	US
Kind code	B2
Filing date	Oct 28, 2021
Priority date	Sep 30, 2015
Publication date	May 30, 2023
Grant date	May 30, 2023

Abstract

In one example, a method includes receiving, at a cloud storage site, chunks that each take the form of a hash of a combination that includes two or more salts and a file object, and one of the salts is a retention salt shared by the chunks, monitoring a time period associated with the retention salt, when the time period has expired, removing the chunks that include the retention salt, and depositing the removed chunks in a deleted items cloud store.

First claim

What is claimed is:

1. A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:
receiving, at a cloud storage site, chunks that each take the form of a hash of a combination that comprises a plurality of salts and a file object, and one of the salts is a retention salt shared by the chunks, and another of the salts is a user-specific salt;
monitoring a time period associated with the retention salt;
when the time period has expired, removing the chunks that include the retention salt;
depositing the removed chunks in a deleted items cloud store;
traversing physical data chunks associated with the user, and the physical data chunks are associated with one or more salted user objects; and
determining an amount of backend storage capacity consumed by live objects associated with the user by totaling a size of live physical data chunks identified as a result of the traversing.

2. A non-transitory storage medium as recited in claim 1 , wherein removing and depositing the chunks is performed without the use of a copy-forward garbage collection process.

3. A non-transitory storage medium as recited in claim 1 , wherein receiving the chunks comprises receiving an object that includes the chunks, and removing and depositing the chunks comprises removing the object and depositing the object in the deleted items cloud store.

4. A non-transitory storage medium as recited in claim 1 , wherein the chunks are received at the cloud storage site as part of a tiering process in which the chunks are stored at the cloud storage site according to a particular priority of the chunks relative to other chunks that are, or will be, stored at the cloud storage site.

5. A non-transitory storage medium as recited in claim 1 , wherein the operations further comprise scrubbing chunks stored at the cloud storage site.

6. A non-transitory storage medium as recited in claim 1 , wherein the chunks are stored in a content salted deduplication domain at the cloud storage site.

7. A system, comprising:
one or more hardware processors; and
a non-transitory storage medium having stored therein instructions that are executable by the one or more hardware processors to perform operations comprising:
receiving, at a cloud storage site, chunks that each take the form of a hash of a combination that comprises a plurality of salts and a file object, and one of the salts is a retention salt shared by the chunks, and another of the salts is a user-specific salt;
monitoring a time period associated with the retention salt;
when the time period has expired, removing the chunks that include the retention salt;
depositing the removed chunks in a deleted items cloud store;
traversing physical data chunks associated with the user; and
determining an amount of backend storage capacity consumed by live objects associated with the user by totaling a size of live physical data chunks identified as a result of the traversing.

8. The system as recited in claim 7 , wherein removing and depositing the chunks is performed without the use of a copy-forward garbage collection process.

9. The system as recited in claim 7 , wherein receiving the chunks comprises receiving an object that includes the chunks, and removing and depositing the chunks comprises removing the object and depositing the object in the deleted items cloud store.

10. The system as recited in claim 7 , wherein the chunks are received at the cloud storage site as part of a tiering process in which the chunks are stored at the cloud storage site according to a particular priority of the chunks relative to other chunks that are, or will be, stored at the cloud storage site.

11. The system as recited in claim 7 , wherein the operations further comprise scrubbing chunks stored at the cloud storage site.

12. The system as recited in claim 7 , wherein the chunks are stored in a content salted deduplication domain at the cloud storage site.

13. The system as recited in claim 7 , wherein the physical data chunks that are traversed are associated with one or more salted user objects.

14. A method, comprising:
receiving, at a cloud storage site, chunks that each take the form of a hash of a combination that comprises a plurality of salts and a file object, and one of the salts is a retention salt shared by the chunks, and another of the salts is a user-specific salt;
monitoring a time period associated with the retention salt;
when the time period has expired, removing the chunks that include the retention salt;
depositing the removed chunks in a deleted items cloud store;
traversing physical data chunks associated with the user; and
determining an amount of backend storage capacity consumed by live objects associated with the user by totaling a size of live physical data chunks identified as a result of the traversing.

15. The method as recited in claim 14 , wherein removing and depositing the chunks is performed without the use of a copy-forward garbage collection process.

16. The method as recited in claim 14 , wherein receiving the chunks comprises receiving an object that includes the chunks, and removing and depositing the chunks comprises removing the object and depositing the object in the deleted items cloud store.

17. The method as recited in claim 14 , wherein the chunks are received at the cloud storage site as part of a tiering process in which the chunks are stored at the cloud storage site according to a particular priority of the chunks relative to other chunks that are, or will be, stored at the cloud storage site.

18. The method as recited in claim 14 , wherein the operations further comprise scrubbing chunks stored at the cloud storage site.

19. The method as recited in claim 14 , wherein the chunks are stored in a content salted deduplication domain at the cloud storage site.

20. The method as recited in claim 14 , wherein the physical data chunks that are traversed are associated with one or more salted user objects.

Assignees

• EMC IP Holding Company
• Emc Ip Holding Co Llc

Inventors

• Marelas Peter

Classifications

• G06F11/1453 Primary

  using de-duplication of the data · CPC title

• G06F16/2365 Primary

  Ensuring data consistency and integrity · CPC title

• G06F11/1456

  Hardware arrangements for backup · CPC title

• G06F16/2255

  Hash tables · CPC title

• G06F16/285

  Clustering or classification · CPC title