Method and device for calling a distributed file system

Patent metadata

Field	Value
Publication number	US-10579595-B2
Application number	US-201715722840-A
Country	US
Kind code	B2
Filing date	Oct 2, 2017
Priority date	Jan 3, 2017
Publication date	Mar 3, 2020
Grant date	Mar 3, 2020

Abstract

The present application discloses a method and device for scheduling a distributed file system. A specific implementation of the method comprises: creating a new session based on a received session request from a user terminal; sending a first locking request to a manager of the distributed file system, the first locking request used for requesting locking a lease directory; sending a request for creating a new subdirectory in the lease directory to the manager in response to receiving a response of successful locking to the first locking request, the new subdirectory being named using an IP address and a port of the new session; and designating the new session as a primary session in response to receiving a response of successful new creation to the request for creating the new subdirectory.

First claim

What is claimed is:

1. A method for scheduling a distributed file system, the method comprising:
creating a new session based on a received session request from a user terminal;
sending a first locking request to a manager of the distributed file system, the first locking request used for requesting locking a lease directory;
sending a request for creating a new subdirectory in the lease directory to the manager in response to receiving a response of successful locking to the first locking request, the new subdirectory being named using an IP address and a port of the new session; and
designating the new session as a primary session in response to receiving a response of successful new creation to the request for creating the new subdirectory.

2. The method according to claim 1 , further comprising one or more of:
sending a request for updating a modification time of the lease directory to the manager periodically in a life span of the primary session; and
sending a request for deleting the subdirectory in the lease directory and unlocking the lease directory in response to a close of the primary session.

3. The method according to claim 1 , wherein the sending a request for creating a new subdirectory in the lease directory to the manager in response to receiving a response of successful locking to the first locking request comprises:
sending the first query request to the manager in response to receiving the response of successful locking to the first locking request, wherein the first query request is used for querying whether a subdirectory named after an IP address and a port of another session exists in the lease directory;
sending a delete request to the manager in response to receiving a response of existence to the first query request, wherein the delete request is used for deleting the subdirectory in the lease directory; and
sending the request for creating the new subdirectory in the lease directory to the manager in response to receiving a response of nonexistence to the first query request or receiving a response of successful deletion to the delete request.

4. The method according to claim 3 , further comprising:
examining whether a duration from the modification time to a current time is longer than a preset duration at an interval of a predetermined duration in response to receiving a response of failed locking to the first locking request;
sending a second locking request to the manager in response to the duration from the modification time to the current time being longer than the preset duration, wherein the second locking request is used for requesting locking the lease directory; and
sending the first query request to the manager in response to receiving a response of successful locking to the second locking request.

5. The method according to claim 4 , further comprising:
sending a second query request to the manager in response to receiving a response of failed locking to the second locking request, wherein the second query request is used for querying whether a subdirectory named after an IP address and a port of another session exists in the lease directory; and
examining whether a duration from the modification time to a current time is longer than a preset duration at an interval of a predetermined duration in response to receiving a response of existence to the second query request.

6. The method according to claim 5 , further comprising:
sending the first locking request for locking the lease directory to the manager of the distributed file system in response to receiving a response of nonexistence to the second query request.

7. The method according to claim 4 , further comprising one or more of:
examining whether a duration from the modification time to a current time is longer than a preset duration at an interval of a predetermined duration in response to receiving a response of failed new creation to the request for creating a new subdirectory;
examining whether a duration from the modification time to a current time is longer than a preset duration at an interval of a predetermined duration in response to receiving a response of failed deletion to the delete request; and
examining whether a duration from the modification time to a current time is longer than a preset duration at an interval of a predetermined duration in response to the duration from the modification time to the current time being not longer than the preset duration.

8. The method according to claim 1 , further comprising:
receiving a request for generating logs;
generating a log sequence number for each log of each data stream;
creating a new log file in response to switching the primary session or a size of the log file reaching a predetermined byte;
naming the created log file after a smallest log sequence number in the log file;
adding each of the log sequence number, lengths of the logs, check information and an IP address of a written session to header information of the created log file; and
adding each of the log into the created log file until the size of the log file reaches the predetermined byte.

9. The method according to claim 8 , further comprising:
receiving a request for generating a snapshot;
triggering the snapshot at an interval of a predetermined time; and
deleting a log file having all log sequence numbers being smaller than log sequence numbers in the snapshot.

10. The method according to claim 8 , further comprising:
receiving a request for replaying logs; and
replaying the logs according to the log sequence numbers.

11. A device for scheduling a distributed file system, the device comprising:
at least one processor; and
a memory storing instructions, which when executed by the at least one processor, cause the at least one processor to perform operations, the operations comprising:
creating a new session based on a received session request from a user terminal;
sending a first locking request to a manager of the distributed file system, the first locking request used for requesting locking a lease directory;
sending a request for creating a new subdirectory in the lease directory to the manager in response to receiving a response of successful locking to the first locking request, the new subdirectory being named using an IP address and a port of the new session; and
designating the new session as a primary session in response to receiving a response of successful new creation to the request for creating the new subdirectory.

12. The device according to claim 11 , the operations further comprising one or more of:
sending a request for updating a modification time of the lease directory to the manager periodically in a life span of the primary session; and
sending a request for deleting the subdirectory in the lease directory and unlocking the lease directory in response to a close of the primary session.

13. The device according to claim 11 , wherein the sending a request for creating a new subdirectory in the lease directory to the manager in response to receiving a response of successful locking to the first locking request comprises:
sending the first query request to the manager in response to receiving a response of successful locking to the first locking request, wherein the first query request is used for querying whether a subdirectory named using an IP address and a port of another session exists in the lease directory;
sending a delete request to the manager in response to receiving a response of existence to the first query request, wherein the delete request is used for deleting the subdirectory in the lease directory; and
sending the request for creating the n

Assignees

• Beijing Baidu Netcom Sci & Tec

Inventors

• Guo Bo
• Zhao Wen
• Hong Yunqi

Classifications

• G06F16/182

  Distributed file systems · CPC title

• G06F9/5083 Primary

  Techniques for rebalancing the load in a distributed system · CPC title

• G06F16/1774 Primary

  Locking methods, e.g. locking methods for file systems allowing shared and concurrent access to files · CPC title

• G06F16/162

  Delete operations (erasing in storage systems G06F3/0652) · CPC title

• G06F16/148

  File search processing · CPC title