Performance during playback of logged data storage operations

Patent metadata

Field	Value
Publication number	US-10095415-B2
Application number	US-201615272154-A
Country	US
Kind code	B2
Filing date	Sep 21, 2016
Priority date	May 19, 2014
Publication date	Oct 9, 2018
Grant date	Oct 9, 2018

Abstract

Technology is disclosed for improving performance during playback of logged data storage operations. The technology can monitor a log to which data storage operations are written before data is committed to a volume; determine counts of various types of data storage operations; and when the counts exceed a specified threshold, cause the data storage operations to be committed to the volume. Some data storage operations can be coalesced during playback to further improve performance.

First claim

What is claimed is:

1. A non-transitory machine readable medium having stored thereon instructions for performing a method comprising machine executable code which when executed by at least one machine, causes the machine to:
monitor a log to which data storage operations are written before data is committed to a volume;
determine counts of various types of data storage operations; and
replay the data storage operations to be committed to the volume when the counts exceed a specified threshold, wherein the replay further comprises:
determine when for a subsequently received one of the data storage operations there is logged an adjacent prior one of the data storage operations; and
modify the adjacent prior one of the data storage operations to include data in the subsequently received one of the data storage operations when the determining indicates the subsequently received one of the data storage operations is logged adjacent the prior one of the data storage operations.

2. The medium of claim 1 , wherein the machine executable code when executed by the machine further causes the machine to specify a threshold such that committing the logged data storage operations will not exceed a specified period of time.

3. The medium of claim 1 , wherein for the modify the adjacent prior one of the data storage operations the machine executable code when executed by the machine further causes the machine to not modify during the replay the adjacent prior one of the data storage operations with the data in the subsequently received one of the data storage operations when there is more coalesced data from the modifying to be written than a message of a data communication protocol is capable of carrying.

4. The medium of claim 3 , wherein the data communication protocol is a part of a write anywhere file system specification.

5. A non-transitory machine readable medium having stored thereon instructions for performing a method comprising machine executable code which when executed by at least one machine, causes the machine to
receive at least a first data storage operation and a second data storage operation and storing the received data storage operations in a log before committing the data storage operations to a volume; and
determine when the second data storage operation, when replayed with the first data storage operation during a replay operation, would cause the replay operation to exceed a specified time duration; and
combine during the replay operation the first and second data storage operations, when the determining indicates that the second data storage operation, when replayed with the first data storage operation, would not cause the replay operation to exceed the specified time duration, wherein the first and second data storage operations affect adjacent storage areas.

6. The medium of claim 5 , wherein the machine executable code when executed by the machine further causes the machine to store the second data storage operation in a different log than the first data storage operation when the replay operation would exceed the specified time duration.

7. The medium of claim 5 , wherein the machine executable code when executed by the machine further causes the machine to lock a first storage area for writing and unlocking a second storage area when the data storage operations stored in the first storage area are committed to a volume.

8. The medium of claim 5 , wherein the machine executable code when executed by the machine further causes the machine to count various types of the data storage operations.

9. The medium of claim 5 , wherein the machine executable code when executed by the machine further causes the machine to separate the data storage operations that would otherwise cause a data storage message to be created that is larger than a maximum size for data storage messages.

10. The medium of claim 5 , wherein the machine executable code when executed by the machine further causes the machine to separate the data storage operations that are stored in different logs.

11. A non-transitory machine readable medium having stored thereon instructions for performing a method comprising machine executable code which when executed by at least one machine, causes the machine to:
monitor a log to which data storage operations are written before data is committed to a volume;
determine counts of various types of the data storage operations; and
cause the data storage operations to be committed to the volume when the counts exceed a specified threshold, wherein the causing further comprises:
employ a dependency hash to determine when to coalesce at least two of the data storage operations; and
coalesce the at least two of the data storage operations when indicated by the employed dependency hash.

12. The medium of claim 11 , wherein the coalescing the at least two of the data storage operations further comprises machine executable code when executed by the machine further causes the machine to coalesce the at least two data storage operations at a same level of the dependency hash when the at least two data storage operations store data to adjacent file block numbers unless the at least two data storage operations are in a collision chain.

13. The medium of claim 11 , wherein the machine executable code when executed by the machine further causes the machine to store file block number ranges associated with the data storage operations which are logged.

14. The medium of claim 13 , wherein the storing file block number ranges associated with the data storage operations which are logged further comprises machine executable code when executed by the machine further causes the machine to, further comprises storing, by the computing device, the file block number ranges in one or more dependency hashes.

Assignees

• Netapp Inc

Inventors

• Dalessandro Dennis
• Roush Ellard
• Brown Joseph

Classifications

• G06F12/1018

  involving hashing techniques, e.g. inverted page tables · CPC title

• G06F2201/81

  Threshold · CPC title

• G06F2201/88

  Monitoring involving counting · CPC title

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title

• G06F11/1441

  Resetting or repowering · CPC title