Distributed transaction log

Patent metadata

Field	Value
Publication number	US-9830234-B2
Application number	US-201414469526-A
Country	US
Kind code	B2
Filing date	Aug 26, 2014
Priority date	Aug 26, 2013
Publication date	Nov 28, 2017
Grant date	Nov 28, 2017

Abstract

Embodiments of the disclosure provide techniques for updating a distributed transaction log on a previously offline resource object component using distributed transaction logs from active host computer nodes from separate RAID mirror configurations. Each component object maintains a journal (log) where distributed transactions are recorded. If a component object goes offline and subsequently returns (e.g., if the node hosting the component object reboots), the component object is marked as stale. To return the component object to an active state, a distributed resources module retrieves the journals from other resource component objects from other RAID configurations where the data is mirrored. The module filters corresponding data that is missing in the journal of the previously offline corresponding object and merges the filtered data to the journal.

First claim

We claim:

1. A method for updating a distributed transaction log of a previously offline resource component object in a distributed resources system, the method comprising:
updating the previously offline resource component object prior to allowing the previously offline resource component object to perform operations as part of the distributed resources system using distributed transaction logs of other resource component objects, wherein each resource component object corresponds to a data portion of a distributed storage system, and wherein the updating comprises:
retrieving distributed transaction logs from each of a plurality of active resource component objects, wherein each transaction log includes entries identifying actions performed on each resource component object, including actions directed to the previously offline resource component when offline, for each distributed transaction of the distributed resources system associated with one or more of the plurality of active resource component objects;
sending, in parallel, the distributed transaction logs to the previously offline resource component object;
filtering, from each distributed transaction log of one or more component objects, corresponding data missing from the distributed transaction log of the previously offline resource component object; and
merging the corresponding data to the distributed transaction log of the previously offline resource component object including applying any changes identified in the corresponding data to the previously offline resource component object.

2. The method of claim 1 , wherein the plurality of resource component objects are hosted on one or more host computer nodes in a cluster.

3. The method of claim 2 , wherein the previously offline resource component object is hosted on a previously offline host computer removed from the cluster.

4. The method of claim 3 , further comprising, returning the previously offline host computer to the cluster.

5. The method of claim 4 , further comprising, updating a configuration status in the node cluster.

6. The method of claim 2 , wherein the distributed resources system is a software-defined storage area network, and wherein the host computer nodes provide storage resources to client virtual machines.

7. The method of claim 1 , wherein active resource component objects correspond to a mirrored redundant array of independent disks (RAID) configuration.

8. The method of claim 2 wherein a distributed resource object consists of a plurality of recourse component objects.

9. A non-transitory computer-readable storage medium storing instructions, which, when executed on a processor, performs an operation for updating a distributed transaction log of a previously offline resource component object in a distributed resources system, the operation comprising:
updating the previously offline resource component object prior to allowing the previously offline resource component object to perform operations as part of the distributed resources system using distributed transaction logs of other resource component objects, wherein each resource component object corresponds to a data portion of a distributed storage system, and wherein the updating comprises:
retrieving distributed transaction logs from each of a plurality of active resource component objects, wherein each transaction log includes entries identifying actions performed on each resource component object, including actions directed to the previosly offline resource component when offline, for each distributed transaction of the distributed resources system associated with one or more of the plurality of active resource component objects;
sending, in parallel, the distributed transaction logs to the previously offline resource component object;
filtering, from each distributed transaction log of one or more component objects, corresponding data missing from the distributed transaction log of the previously offline resource component object; and
merging the corresponding data to the distributed transaction log of the previously offline resource component object including applying any changes identified in the corresponding data to the previously offline resource component object.

10. The computer-readable storage medium of claim 9 , wherein the active resource component objects is hosted on one or more host computer nodes in a cluster.

11. The computer-readable storage medium of claim 10 , wherein previously offline resource component object is hosted on a previously offline host computer removed from the cluster.

12. The computer-readable storage medium of claim 11 , wherein the operation further comprises, returning the previously offline host computer to the cluster.

13. The computer-readable storage medium of claim 12 , wherein the operation further comprises, updating a configuration status in the node cluster.

14. The computer-readable storage medium of claim 10 , wherein the distributed resources system is a software-defined storage area network, and wherein the host computer nodes provide storage resources to client virtual machines.

15. The computer-readable storage medium of claim 9 , wherein the active resource component objects corresponds to a mirrored redundant array of independent disks (RAID) configuration.

16. A system, comprising:
a processor; and
a memory hosting an application, which, when executed on the processor, performs an operation for updating a distributed transaction log of a previously offline resource component object in a distributed resources system, the operation comprising:
updating the previously offline resource component object prior to allowing the previously offline resource component object to perform operations as part of the distributed resources system using distributed transaction logs of other resource component objects, wherein each resource component object corresponds to a data portion of a distributed storage system, and wherein the updating comprises:
retrieving distributed transaction logs from each of a plurality of active resource component objects, wherein each transaction log includes entries identifying actions performed on each resource component object, including actions directed to the previously offline resoource component when offline, for each distributed transaction of the distributed resources system associated with one or more of the plurality of active resource component objects;
sending, in parallel, the distributed transaction logs to the previously offline resource component object;
filtering, from each distributed transaction log of one or more component objects, corresponding data missing from the distributed transaction log of the previously offline resource component object; and
merging the corresponding data to the distributed transaction log of the previously offline resource component object including applying any changes identified in the corresponding data to the previously offline resource component object.

17. The system of claim 16 , wherein the active resource component objects is hosted on one or more host computer nodes in a cluster.

18. The system of claim 17 , wherein previously offline resource component object is hosted on a previously offline host computer removed from the cluster.

19. The system of claim 18 , wherein the operation further comprises, returning the previously offline host computer to the duster.

20. The system of claim 19 , wherein the operation further comprises, updating a configuration status in the node clu

Assignees

• Vmware Inc

Inventors

• Earl William
• Karamanolis Christos
• Knauft Eric
• Renauld Pascal

Classifications

• G06F17/30171

  Physics · mapped topic

• G06F11/1471 Primary

  involving logging of persistent data for recovery · CPC title

• H04L67/1097

  for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS] · CPC title

• G06F17/30371

  Physics · mapped topic

• G06F2009/45579

  I/O management, e.g. providing access to device drivers or storage · CPC title