File system mode switching in a distributed storage service

Patent metadata

Field	Value
Publication number	US-10545927-B2
Application number	US-201615081651-A
Country	US
Kind code	B2
Filing date	Mar 25, 2016
Priority date	Mar 25, 2016
Publication date	Jan 28, 2020
Grant date	Jan 28, 2020

Abstract

A distributed file storage services (DFSS) that provides low latency (LL) and high throughput (HT) modes for file systems. A HT metadata subsystem (HTMS) may use a distributed transaction system for data and metadata reads and writes for file systems in HT mode. A LL metadata subsystem (LLMS) may process metadata requests for file systems in LL mode. For metadata read requests, the LLMS may locally cache at least some of the file system metadata. For metadata write requests, the LLMS may write entries to a journal and notify the access node after the entries are committed to the journal. Data reads and writes for file systems in LL mode may be handled similarly to data reads and writes for file systems in HT mode. A file system may be converted from LL to HT mode, or from HT to LL mode.

First claim

The invention claimed is:

1. A distributed storage service, comprising:
a plurality of computing devices that implement:
one or more low latency (LL) servers configured to support one or more of a plurality of file systems that are in LL mode, wherein the one or more LL servers are configured to:
determine write operations according to metadata requests received from one or more sources, wherein the metadata requests are based on file system requests directed to one or more of the file systems that are in LL mode;
write journal entries for the write operations that are based on the metadata requests to metadata journals for respective file systems; and
send notifications to respective ones of the sources indicating results of the metadata requests, wherein metadata write operations that are based on the metadata requests and are specified by the journal entries are committed in a storage system of the distributed storage service subsequent to sending the notifications that indicate the results of the metadata requests; and

a high throughput (HT) metadata subsystem configured to support one or more of the plurality of file systems that are in HT mode, wherein the HT metadata subsystem is configured to communicate with the storage system using distributed transactions to perform metadata operations indicated by other metadata requests received from one or more sources and to notify respective sources of the other metadata requests after completion of the transactions, wherein the other metadata requests are based on file system requests directed to one or more of the file systems that are in HT mode.

2. The distributed storage service as recited in claim 1 , wherein the one or more LL servers are further configured to:
determine read operations according to the metadata requests received from the one or more sources;
obtain metadata for at least one read operation from a local metadata cache; and
fetch metadata for at least one read operation from the storage system and store the fetched metadata to the local metadata cache.

3. The distributed storage service as recited in claim 1 , wherein the one or more sources include an access subsystem of the distributed storage service, wherein the access subsystem is configured to:
receive file system requests for the plurality of file systems;
for at least one file system request directed to a file system in LL mode, send a metadata request to an LL server for the respective file system; and
for at least one file system request directed to a file system in HT mode, send the metadata request to the HT metadata subsystem.

4. The distributed storage service as recited in claim 3 , wherein the access subsystem is further configured to, for file system requests directed to file system data in either mode:
communicate with the storage subsystem using distributed transactions to perform file system data operations indicated by the file system requests; and
notify respective clients after completion of the transactions.

5. The distributed storage service as recited in claim 3 ,
wherein the distributed storage service is configured to:
determine that a file system in HT mode is to be converted to LL mode;
convert the file system to LL mode; and
assign the file system to one of the one or more LL servers;

wherein the access subsystem is configured to:
send a metadata request for the file system in LL mode to one of the one or more LL servers;
receive a message from the LL server indicating that the LL server is not assigned to the file system; and
in response to the message, either send the metadata request to another one of the one or more LL servers or request the distributed storage service to assign the file system to another LL server.

6. The distributed storage service as recited in claim 1 , wherein the distributed storage service is configured to:
determine that a file system in LL mode is to be converted to HT mode;
stop journal writes to the metadata journal for the file system by a respective LL server;
flush content of the metadata journal to the storage subsystem; and
convert the file system to HT mode so that metadata requests for the file system are sent to the HT metadata subsystem.

7. A method, comprising:
performing, by a plurality of computing devices:
receiving requests for a plurality of file systems in a distributed storage service;
for at least one request directed to one of the file systems that is in high throughput (HT) mode:
communicating with a storage system of the distributed storage service using one or more distributed transactions to perform one or more operations indicated by the request; and
notifying a source of the request after completion of the one or more distributed transactions; and

for at least one other request directed to one of the file systems that is in low latency (LL) mode:
writing at least one journal entry specifying one or more write operations indicated by the other request to a metadata journal for the respective file system; and
notifying a source of the other request to indicate results of the one or more write operations indicated by the other request, wherein the one or more write operations specified by the at least one journal entry and indicated by the other request are committed in the storage system subsequent to the notification of the results of the one or more write operations indicated by the other request.

8. The method as recited in claim 7 , further comprising:
determining read operations according to the requests;
obtaining metadata for at least one read operation from a metadata cache; and
fetching metadata for at least one other read operation from the storage system and
storing the fetched metadata to the metadata cache.

9. The method as recited in claim 7 , further comprising:
receiving file system requests for the plurality of file systems;
for one or more of the file system requests:
determining a mode of the file system at which the file system request is targeted;
for file systems in a first mode, sending one or more requests to two or more of the plurality of computing devices that perform said communicating and said notifying; and
for file systems in a second mode, sending one or more requests to one of the plurality of computing devices that performs said writing and said notifying.

10. The method as recited in claim 9 , further comprising, for at least one file system request, communicating with the storage system to perform file system data operations indicated by the file system request.

11. The method as recited in claim 7 , wherein said communicating and notifying are performed by a metadata subsystem implemented by two or more of the plurality of computing devices for file systems in a first mode, and wherein said writing and notifying are performed by one or more metadata servers implemented by one or more of the plurality of computing devices for file systems in a second mode, the method further comprising:
determining that a file system in the first mode is to be converted to the second mode;
converting the file system to the second mode; and
assigning one of the metadata servers to the file system in the second mode.

12. The method as recited in claim 11 , further comprising the metadata server assigned to the file system:
reading metadata pages of the file system from the storage system, wherein the metadata pages includes slot ID fields; and
for at least one metadata page read from the storage system, writing a new slot ID to the slot ID field of the metadata page in the storage system to indicate that the metadata server owns the respective metadata page.

Assignees

• Amazon Tech Inc

Inventors

• Strauss Jacob A
• Luszcz Jocob David
• Jones Peter
• Frasca Michael Robert
• Charbonneau Neal John

Classifications

• G06F16/1865 Primary

  Transactional file systems · CPC title