Providing custom read consistency of a data object in a distributed storage system

Patent metadata

Field	Value
Publication number	US-11360955-B2
Application number	US-201815934353-A
Country	US
Kind code	B2
Filing date	Mar 23, 2018
Priority date	Mar 23, 2018
Publication date	Jun 14, 2022
Grant date	Jun 14, 2022

Abstract

In various example embodiments, a system and method for versioning data in an unstructured data store are presented. The method includes generating a first record in the unstructured data store based on a version of a second record in the unstructured data store. The method further includes initializing a parent version identifier of the first record based on the version of the second record. The method further includes comparing the parent version identifier of the first record to a version identifier of the second record. The method further includes determining whether the first record is consistent based on the comparison.

First claim

What is claimed is:

1. A method of versioning data in an unstructured data store, the method comprising:
generating a first record in the unstructured data store by augmenting data stored in a second record in the unstructured data store with additional data such that the first record includes both the data stored in the second record and the additional data that is not stored in the second record, the first record stored in a child node of the unstructured data store and the second record stored in a parent node of the unstructured data store;
in response to a request to retrieve the first record, determining whether the first record is not consistent with the second record by:
traversing the parent node and the child node in the unstructured data store;
comparing a parent version identifier associated with the first record stored in the child node to a version identifier associated with the second record stored in the parent node; and
determining that the first record is not consistent with the second record based on the parent version identifier associated with the first record stored in the child node not matching the version identifier associated with the second record stored in the parent node;
in response to determining that the first record is not consistent with the second record, retrieving a latest version of the second record, updating the first record stored in the child node by executing one or more operations using the retrieved latest version of the second record to generate an updated version of the first record, and updating the parent version identifier associated with the first record stored in the child node; and
providing data aggregated from the latest version of the second record and the updated version of the first record in reply to the request, wherein the first record is associated with the parent version identifier, a node version identifier, and an update criteria comprising one or more rules or conditions for triggering an update of the child node in response to a change in data managed by the parent node, and wherein the parent version identifier, the node version identifier, and the update criteria are stored in the child node.

2. The method of claim 1 , further comprising:
receiving a data update event broadcast from the second record to the first record: and
updating the first record in response to:
the determination that the first record is not consistent with the second record, and
a determination that the update criteria applied to the data update event is satisfied.

3. The method of claim 2 , further comprising updating the first record with data derived from the data currently stored in the second record and updating a version identifier of the first record to a current version identifier of the second record.

4. The method of claim 3 , wherein the data update event is broadcast by the second record to one or more child records in response to an update to the second record.

5. The method of claim 1 , further comprising refraining from updating the first record in response to a determination that the first record is consistent with the second record.

6. The method of claim 1 , further comprising:
determining that the first record is consistent with the second record by determining that the first record is updated with a most recent version of the second record that satisfies the update criteria.

7. The method of claim 1 , further comprising:
receiving, from a shared communication channel, a data update event indicating that the second record was updated;
applying the update criteria associated with the first record to the data update event;
updating the first record in response to determining that the update criteria is satisfied; and
transmitting a second data update event to a third record indicating that the first record was updated.

8. The method of claim 1 , wherein the determining whether the first record is not consistent with the second record comprises determining whether the second record was generated from a most recent version of the second record.

9. A system for versioning data in an unstructured data store, the system comprising:
at least one computing device comprising a hardware processor and a memory, the memory having computer executable instructions embedded therein, the computer executable instructions executable by the hardware processor to cause the computing device to:
generate a first record in the unstructured data store by augmenting data stored in a second record in the unstructured data store with additional data such that the first record includes both the data stored in the second record and the additional data that is not stored in the second record, the first record stored in a child node of the unstructured data store and the second record stored in a parent node of the unstructured data store;
initialize a parent version identifier of the first record based on a version identifier of the second record;
receive a data update message indicating that the data stored in the second record has changed;
apply an update criteria associated with the first record to the data update message;
set the parent version identifier of the first record to an updated version identifier of the second record when the update criteria is not satisfied; and
in response to a request to retrieve the first record, determine whether the first record is not consistent with the second record by:
traversing the parent node and the child node in the unstructured data store;
comparing the parent version identifier of the first record stored in the child node to a current version identifier of the second record stored in the parent node; and
determining that the first record is not consistent with the second record based on the parent version identifier associated with the first record stored in the child node not matching the current version identifier of the second record stored in the parent node;

in response to determining that the first record is not consistent with the second record, retrieving a latest version of the second record, updating the first record stored in the child node by executing one or more operations using the retrieved latest version of the second record to generate an updated version of the first record, and updating the parent version identifier associated with the first record stored in the child node: and
providing data aggregated from the latest version of the second record and the updated version of the first record in reply to the request, wherein the first record is associated with the parent version identifier, a node version identifier, and the update criteria, the update criteria comprising one or more rules or conditions for triggering an update of the child node in response to a change in data managed by the parent node, and wherein the parent version identifier, the node version identifier, and the update criteria are stored in the child node.

10. The system of claim 9 , wherein the computer executable instructions are further executable by the hardware processor to cause the computing device to update the first record in response to determining that the first record is not consistent with the second record.

11. The system of claim 10 , wherein the computer executable instructions are further executable by the hardware processor to cause the computing device to update the second record and to update the version identifier of the second record based on the updating of the first record.

12. The system of claim 11 , wherein the computer executable instructions are further executable by the hardware processor to cause the computing device to update a version identifier of

Assignees

• Ebay Inc

Inventors

• Hamilton Scot Fraser
• Patel Rekha
• Seethasridhar Satya
• Whyte Nicholas
• Arora Parikshit
• Sahter Snezana

Classifications

• G06F16/2329

  using versioning · CPC title

• G06F16/2365

  Ensuring data consistency and integrity · CPC title

• G06F16/219 Primary

  Managing data history or versioning (querying versioned data G06F16/2474; querying temporal data G06F16/2477) · CPC title

• G06F16/1873

  Versioning file systems, temporal file systems, e.g. file system supporting different historic versions of files · CPC title