Data processing method, cache node, collaboration controller, and system

Patent metadata

Field	Value
Publication number	US-9330004-B2
Application number	US-201314094148-A
Country	US
Kind code	B2
Filing date	Dec 2, 2013
Priority date	May 31, 2011
Publication date	May 3, 2016
Grant date	May 3, 2016

Abstract

The present invention provides a data processing method based on a cache node group for data caching, where each cache node in the group includes a local replacement-allowable data storage space for storing data accessed by a local client and a collaborative replacement-allowable data storage space for storing data content accessed by a non-local client. By using the data processing method to process data content stored in the local replacement-allowable data storage space and the collaborative replacement-allowable data storage space of the cache node, the clients can obtain data more accurately and directly during access to the cache node, thereby meeting different requirements for local optimization of the cache node.

First claim

What is claimed is:

1. A data processing method based on a cache node group for data caching, wherein each cache node in the group comprises a local replacement-allowable data storage space for storing data accessed by a local client and a collaborative replacement-allowable data storage space for storing data content accessed by a non-local client;
the method comprising:
searching, by an accessed cache node receiving a data request from a client, for data content corresponding to the data request;
querying a preset data content directory list when the data content is not found in a local replacement-allowable data storage space of the accessed cache node, wherein a mapping relationship between data content and corresponding cache nodes that store the data content is preset in the data content directory list;
according to the mapping relationship, determining a target cache node containing the data content among one or more other cache nodes in the cache node group; and
obtaining the data content from a collaborative replacement-allowable data storage space of the target cache node, and storing the data content to the local replacement-allowable data storage space of the accessed cache node, wherein when a number of times that the collaborative replacement-allowable data storage space is accessed is too great so that a utilization ratio of the link in which the cache node is located exceeds a preset link utilization ratio, the process of accessing the collaborative replacement-allowable data storage space, further comprises a process of transferring the data content in the collaborative replacement-allowable data storage space, which is specifically:
collecting statistics of N pieces of data content based on a descending order of access frequencies in the collaborative replacement-allowable data storage space of a currently accessed cache node, wherein the N pieces of data content are all data content whose access frequency values exceed a preset access frequency value;
sendinq a content list of the N pieces of data content to the collaboration controller;
receiving a transfer instruction from the collaboration controller, wherein the transfer instruction comprises a physical address of a target transfer cache node with a low link utilization ratio; and
according to the physical address, transferring the N pieces of data content to the collaborative replacement-allowable data storage space of the target transfer cache node with the low link utilization ratio.

2. The method according to claim 1 , wherein the process of querying the preset data content directory list is specifically querying the data content directory list preset by a collaboration controller.

3. The method according to claim 2 , wherein the process of determining the target cache node according to the mapping relationship comprises:
querying the mapping relationship between data content and corresponding cache nodes that store the data content, wherein the mapping relationship is set in the preset data content directory list; and
when the cache node corresponding to the data content requested by the client is found, using the cache node as the target cache node.

4. The method according to claim 3 , further comprising:
when the cache node corresponding to the data content requested by the client is not found, forwarding, to a content source server, the data request received from the client;
obtaining, from the content source server, the data content corresponding to the data request; and
storing the obtained data content to a collaborative replacement-allowable data storage space of the accessed cache node.

5. The method according to claim 4 , further comprising:
updating a directory list of data content stored in the collaborative replacement-allowable data storage space of the accessed cache node; and
sending the updated directory list to the collaboration controller.

6. The method according to claim 5 , wherein when a storage space of the collaborative replacement-allowable data storage space reaches a preset threshold, the process of storing the obtained data content to the collaborative replacement-allowable data storage space further comprises a process of replacing the data content in the collaborative replacement-allowable data storage space, which is:
reading the data content directory list in the collaborative replacement-allowable data storage space, and querying data content that is least frequently accessed by the non-local client as recorded in the directory list; and
replacing the data content that is least frequently accessed with the obtained data content.

7. The method according to claim 6 , further comprising:
reading the data content directory list in the local replacement-allowable data storage space, and querying the data content that is least frequently accessed by the local client as recorded in the directory list; and
adding and saving the replaced data content that is least frequently accessed in the collaborative replacement-allowable data storage space to the local replacement-allowable data storage space, when access time of the replaced data content that is least frequently accessed in the collaborative replacement-allowable data storage space is later than access time of the data content that is least frequently accessed in the local replacement-allowable data storage space and a storage space of the local replacement-allowable data storage space does not reach a preset threshold;
replacing the data content that is least frequently accessed in the local replacement-allowable data storage space with the replaced data content that is least frequently accessed in the collaborative replacement-allowable data storage space, when access time of the replaced data content that is least frequently accessed in the collaborative replacement-allowable data storage space is later than access time of the data content that is least frequently accessed in the local replacement-allowable data storage space and a storage space of the local replacement-allowable data storage space reaches a preset threshold.

8. The method according to claim 3 , wherein the process of obtaining the data content from the target cache node comprises:
forwarding, to the target cache node, the data request received by the accessed cache node from the client; and
receiving the data content that is corresponding to the data request and is returned by the target cache node and stored in the collaborative replacement-allowable data storage space of the target cache node.

9. The method according to claim 8 , wherein when a storage space of the local replacement-allowable data storage space reaches a preset threshold, the process of storing the obtained data content in the collaborative replacement-allowable data storage space of the target cache node to the local replacement-allowable data storage space of the accessed cache node further comprises a process of replacing the data content in the local replacement-allowable data storage space, which is:
reading the data content directory list in the local replacement-allowable data storage space, and querying data content that is least frequently accessed by the local client as recorded in the directory list; and
replacing the data content that is least frequently accessed by the local client with the data content obtained from the collaborative replacement-allowable data storage space of the target cache node.

10. The method according to claim 9 , further comprising:
reading a data content directory list in the collaborative replacement-allowable data storage space; and
when the data content directory list does not record the replaced data content in the local replacement-allowable data sto

Assignees

• Huawei Tech Co Ltd

Inventors

• Long Youshui

Classifications

• H04L67/568 Primary

  Storing data temporarily at an intermediate stage, e.g. caching · CPC title

• H04L29/08729

  Electricity · mapped topic

• G06F12/12

  Replacement control · CPC title

• H04L67/2852

  Electricity · mapped topic

• G06F12/0824 Primary

  Distributed directories, e.g. linked lists of caches · CPC title