System and method for update of data and meta data via an enumerator

Patent metadata

Field	Value
Publication number	US-11514097-B2
Application number	US-201916588631-A
Country	US
Kind code	B2
Filing date	Sep 30, 2019
Priority date	Sep 30, 2019
Publication date	Nov 29, 2022
Grant date	Nov 29, 2022

Abstract

A data storage system includes storage and a global enumerator. The storage stores data chunks, object level metadata associated with portions of the data chunks, and chunk level metadata associated with respective data chunks. The global enumerator obtains an update request including a metadata characteristic and update data; in response to obtaining the update request: matches the metadata characteristic to at least one selected from a group consisting of a portion of the object level metadata and a portion of the chunk level metadata to identify an implicated metadata portion; and modifies, based on the update data, the implicated metadata portion.

First claim

What is claimed is:

1. A data storage system, comprising:
storage for storing: data chunks, object level metadata associated with portions of the data chunks, and chunk level metadata associated with respective data chunks; and
a global enumerator programmed to:
obtain an update request comprising a metadata characteristic and update data, wherein the update request comprises data control restrictions to be established;
in response to obtaining the update request:
match the metadata characteristic to at least one selected from a group consisting of a portion of the object level metadata and a portion of the chunk level metadata to identify an implicated metadata portion,
wherein, to match the metadata characteristic, the global enumerator is configured to:
identify a plurality of regions that each store at least a portion of the implicated metadata portion;
generate sub-requests for respective regions of the plurality of regions based on the update request;
distribute the sub-requests to regional enumerators in respective regions of the plurality of regions; and
aggregate responses to the sub-requests from the regional enumerators; and

modify, based on the update data, the implicated metadata portion in accordance with the data control restrictions,
wherein the implicated metadata portion comprises the portion of the object level metadata, wherein the update data comprises a classification for an object, a computing resource aggregation, and at least one data control restriction, wherein modifying, based on the update data, the implicated metadata portion comprises:
adding the classification and the at least one data control restriction to the portion of the object level metadata.

2. The data storage system of claim 1 , wherein the classification specifies a geographic location associated with the object corresponding to the portion of the object level metadata.

3. The data storage system of claim 1 , wherein the classification specifies a governmental restriction on the object corresponding to the portion of the object level metadata.

4. The data storage system of claim 1 , wherein the classification specifies a retention policy for the object corresponding to the portion of the object level metadata.

5. The data storage system of claim 1 , wherein the classification specifies an organization type that has rights in the object corresponding to the portion of the object level metadata.

6. The data storage system of claim 1 , wherein the at least one data control restriction specifies users that are authorized to modify the object corresponding to the portion of the object level metadata.

7. The data storage system of claim 1 , wherein the at least one data control restriction specifies that an audit trail is to be generated for the object corresponding to the portion of the object level metadata.

8. The data storage system of claim 7 , wherein the global enumerator is further programmed to:
obtain a modification for a first data chunk of the data chunks;
make a determination, based on the updated portion of the object level metadata, that the first data chunk is subject to the audit trail;
in response to the determination, generate a new data chunk based on the modification.

9. The data storage system of claim 8 , wherein the new data chunk is associated with a time stamp that specifies a time associated with when the new data chunk was generated.

10. The data storage system of claim 9 , wherein the first data chunk is associated with a second time stamp that specifies a time prior to the time associated with when the new data chunk was generated.

11. The data storage system of claim 1 , wherein the data chunks comprise:
client data; and
system metadata associated with the client data.

12. A method for managing a data storage system, comprising:
obtaining, by a global enumerator, an update request comprising a metadata characteristic and update data, wherein the update request comprises data control restrictions to be established;
in response to obtaining the update request:
matching, by the global enumerator, the metadata characteristic to at least one selected from a group consisting of a portion of object level metadata and a portion of chunk level metadata to identify an implicated metadata portion, wherein the object level metadata is associated with portions of data chunks and the chunk level metadata is associated with respective data chunks,
wherein matching the metadata characteristic comprises:
identifying a plurality of regions that each store at least a portion of the implicated metadata portion;
generating sub-requests for respective regions of the plurality of regions based on the update request;
distributing the sub-requests to regional enumerators in respective regions of the plurality of regions; and
aggregating responses to the sub-requests from the regional enumerators; and
modifying, based on the update data, the implicated metadata portion in accordance with the data control restrictions,
wherein the implicated metadata portion comprises the portion of the object level metadata, wherein the update data comprises a classification for an object, a computing resource aggregation, and at least one data control restriction, wherein modifying, based on the update data, the implicated metadata portion comprises:
adding the classification and the at least one data control restriction to the portion of the object level metadata.

13. The method of claim 12 , wherein the classification specifies a geographic location associated with the object corresponding to the portion of the object level metadata.

14. The method of claim 12 , wherein the classification specifies a governmental restriction on the object corresponding to the portion of the object level metadata.

15. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for managing a data storage system, the method comprising:
obtaining, by a global enumerator, an update request comprising a metadata characteristic and update data, wherein the update request comprises data control restrictions to be established;
in response to obtaining the update request:
matching, by the global enumerator, the metadata characteristic to at least one selected from a group consisting of a portion of object level metadata and a portion of chunk level metadata to identify an implicated metadata portion, wherein the object level metadata is associated with portions of data chunks and the chunk level metadata is associated with respective data chunks,
wherein matching the metadata characteristic comprises:
identifying a plurality of regions that each store at least a portion of the implicated metadata portion;
generating sub-requests for respective regions of the plurality of regions based on the update request;
distributing the sub-requests to regional enumerators in respective regions of the plurality of regions; and
aggregating responses to the sub-requests from the regional enumerators; and
modifying, based on the update data, the implicated metadata portion in accordance with the data control restrictions,
wherein the implicated metadata portion comprises the portion of the object level metadata, wherein the update data comprises a classification for an object, a computing resource aggregation, and at least one data control restriction, wherein modifying, based on the update data, the implicated metadata portion comprises:
adding the classification and the data control restriction to the porti

Assignees

• Dell Products Lp

Inventors

• Patel Dharmesh M
• Ali Rizwan
• Chaganti Ravikanth

Classifications

• G06F16/387

  using geographical or spatial information, e.g. location · CPC title

• G06F16/353 Primary

  into predefined classes · CPC title

• G06F16/334

  Query execution (filtering based on additional data G06F16/335) · CPC title

• G06F16/383

  using metadata automatically derived from the content · CPC title

• G06F11/1435 Primary

  using file system or storage system metadata · CPC title