Data retention handling for data object stores

Patent metadata

Field	Value
Publication number	US-11301419-B2
Application number	US-201815910837-A
Country	US
Kind code	B2
Filing date	Mar 2, 2018
Priority date	Mar 2, 2018
Publication date	Apr 12, 2022
Grant date	Apr 12, 2022

Abstract

Methods, systems, and devices for data retention handling are described. In some data storage systems, data objects are stored in a non-relational database schema. The system may support configurable data retention policies for different tenants, users, or applications. For example, a data store may receive retention requests, where the retention requests may specify deletion or exportation actions to perform on records contained within data objects. The data store may determine retention rules based on these retention requests, and may periodically or aperiodically evaluate the rules to determine active actions to perform. To improve the efficiency of the system, the data store may aggregate the active actions (e.g., according to the dataset to perform the actions on), and may generate work items corresponding to the aggregate actions. A work processor may retrieve these work items and may efficiently perform the data retention actions on datasets stored in the data object store.

First claim

What is claimed is:

1. A method for data processing at a data object store, comprising:
identifying a configurable data retention policy for one or more datasets stored in the data object store;
receiving a plurality of data retention requests associated with one or more actions for the one or more datasets, wherein each data retention request corresponds to an action to perform on at least one dataset, and wherein the one or more actions correspond to exporting or deleting data objects, data object records, or a combination thereof according to the configurable data retention policy;
evaluating the plurality of data retention requests to determine a tenant identifier indicating a dataset and a plurality active actions due to be performed on the dataset, wherein the plurality of active actions correspond to deprovisioning a tenant of the data object store corresponding to the tenant identifier;
consolidating the plurality of active actions into a first aggregate action and a second aggregate action, wherein the first aggregate action comprises a first set of active actions and the second aggregate action comprises a second set of active actions, wherein the first set of active actions correspond to a first action type to perform on the dataset and the second set of active actions correspond to a second action type to perform on the dataset;
generating a first consolidated work object for the first aggregate action and a second consolidated work object for the second aggregate action, wherein the first consolidated work object comprises a first work item type corresponding to the first action type, a second work item type corresponding to the second action type and a dataset identifier corresponding to the dataset;
marking the first consolidated work object and the second consolidated work object as unprocessed work objects, wherein the first consolidated work object is processed using a first work processor procedure and the second consolidated work object is processed using a second work processor procedure; and
transmitting an indication of the first consolidated work object and the second consolidated work object in response to a work processor retrieval request.

2. The method of claim 1 , wherein the data object store is associated with a metadata database, the method further comprising:
identifying a user identifier corresponding to the plurality of data retention requests; and
determining the one or more datasets according to metadata in the metadata database associated with the tenant identifier, the user identifier, or the combination thereof.

3. The method of claim 2 , wherein the plurality of data retention requests correspond to record deletion for a user of the tenant of the data object store corresponding to the user identifier.

4. The method of claim 1 , further comprising:
receiving, from a user device, the configurable data retention policy, wherein the configurable data retention policy is for the tenant or a user corresponding to the one or more datasets.

5. The method of claim 4 , wherein the configurable data retention policy overrides one or more global data retention policies for the data object store.

6. The method of claim 1 , further comprising:
receiving, from the work processor, an indication that the work processor processed the first consolidated work object and the second consolidated work object; and
marking the first consolidated work object and the second consolidated work object as processed work objects based at least in part on the indication received from the work processor.

7. The method of claim 1 , wherein evaluating the plurality of data retention requests to determine the set of active data retention requests associated with the plurality of active actions comprises:
identifying expiration timestamps, time-to-live (TTL) values, sequential TTL values, or a combination thereof for the plurality of data retention requests;
comparing a current timestamp to the identified expiration timestamps, TTL values, sequential TTL values, or the combination thereof; and
determining the plurality of active actions based at least in part on the comparing.

8. The method of claim 7 , wherein the work processor removes a set of data objects, a set of data object records, or a combination thereof from the dataset for each consolidated work object based at least in part on the first aggregate action and the current timestamp exceeding the identified expiration timestamps, TTL values, sequential TTL values, or the combination thereof.

9. The method of claim 1 , further comprising:
receiving, from the work processor, a set of data objects, data object records, or combination thereof corresponding to the first aggregate action;
extracting the set of data objects, data object records, or combination thereof; and
exporting, to a user device, a link to access the extracted set of data objects, data object records, or combination thereof.

10. The method of claim 1 , wherein receiving the plurality of data retention requests comprises:
periodically retrieving batches of data retention requests.

11. The method of claim 1 , further comprising:
receiving a plurality of work processor retrieval requests according to a work processor periodicity, wherein each work processor retrieval request of the plurality of work processor retrieval requests corresponds to a specific work item type.

12. The method of claim 1 , wherein the plurality of data retention requests are evaluated according to a dynamic or pre-determined periodicity.

13. The method of claim 1 , wherein the one or more datasets comprise data formatted in a non-relational database schema.

14. An apparatus for data processing at a data object store, comprising: a processor; memory in electronic communication with the processor; and
instructions stored in the memory and executable by the processor to cause the apparatus to:
identify a configurable data retention policy for one or more datasets stored in the data object store;
receive a plurality of data retention requests associated with one or more actions for the one or more datasets, wherein each data retention request corresponds to an action to perform on at least one dataset, and wherein the one or more actions correspond to exporting or deleting data objects, data object records, or a combination thereof according to the configurable data retention policy;
evaluate the plurality of data retention requests to determine a tenant identifier indicating a dataset and a plurality active actions due to be performed on the dataset, wherein the plurality of active actions correspond to deprovisioning a tenant of the data object store corresponding to the tenant identifier;
consolidate the plurality of active actions into a first aggregate action and a second aggregate action, wherein the first aggregate action comprises a first set of active actions and the second aggregate action comprises a second set of active actions, wherein the first set of active actions correspond to a first action type to perform on the dataset and the second set of active actions correspond to a second action type to perform on the dataset;
generate a first consolidated work object for the first aggregate action and a second consolidated work object for the second aggregate action, wherein the first consolidated work object comprises a first work item type corresponding to the first action type, a second work item type corresponding to the second action type and a dataset identifier corresponding to the dataset;
mark the first consolidated work object and the second consolidated work object as unprocessed work obj

Assignees

• Salesforce Com Inc

Inventors

• Liu Shu
• Shahkarami Eric
• Chan Yuk Hei
• Chen Ming-Yang
• Skucha Karl Ryszard
• Levine Eli
• Au Ka Chun

Classifications

• G06F16/21

  Design, administration or maintenance of databases · CPC title

• G06F16/125 Primary

  characterised by the use of retention policies (retention policies for HSM systems G06F16/185) · CPC title