Method, apparatus, and system for determining the existence of a data file

Patent metadata

Field	Value
Publication number	US-2017270133-A1
Application number	US-201515531850-A
Country	US
Kind code	A1
Filing date	Nov 26, 2015
Priority date	Dec 2, 2014
Publication date	Sep 21, 2017
Grant date	—

Abstract

Embodiments of the disclosure provide a method, apparatus, and system for determining the existence of a data file. The method includes: sending, by a first network node, a request to a second network node, the request including a first identifier of a data file; searching for, by the second network node, a local matching data file according to the first identifier of the data file; selecting a file block from the local matching data file, and acquiring a first position of the selected file block; and sending the first position to the first network node; selecting, by the first network node, a file block at a corresponding position from the data file according to the first position, and calculating a second characteristic value of the selected file block; and sending the second characteristic value of the file block to the second network node; and determining, by the second network node, whether the second characteristic value matches a third characteristic value of the selected file block in the local matching data file, and determining whether the data file exists based on the matching result.

First claim

1 - 26 . (canceled)

27 . A method comprising:
receiving, at a server device, a request for a data file from a client device, the request including a first identifier of the data file; identifying, at the server device, a local matching data file based on the first identifier of the data file; selecting, at the server device, a file block from the local matching data file at a first position in the local matching data file; obtaining, at the server device, a characteristic value of the file block; and determining, at the server device, whether the characteristic value matches a second characteristic value of the file block, and, if so, determining that the data file exists at the server device.

28 . The method of claim 27 wherein obtaining a characteristic value of the file block comprises transmitting the first position to the client device.

29 . The method of claim 28 wherein obtaining a characteristic value of the file block further comprises:
selecting, by the client device based on the first position, a corresponding file block from the data file;
calculating, at the client device, the characteristic value of the file block; and
receiving, at the server device, the characteristic value from the client device.

30 . The method of claim 27 further comprising transmitting, by the server device, an indication that the data file exists to the client device.

31 . The method of claim 27 wherein the request for a data file further includes a position of a file block in the data file and a second characteristic value corresponding to the file block at the first position, wherein acquiring a first position of the file block comprises extracting the position from the first identifier, and wherein obtaining a characteristic value of the file block comprises extracting the second characteristic value from the first identifier.

32 . The method of claim 27 , wherein the characteristic value comprises an MD5 or SHA value.

33 . The method of claim 27 , wherein the first position of the file block comprises a first position of the file block obtained by designation.

34 . The method of claim 27 , wherein the first position of the file block further comprises a first position of the file block obtained using a random algorithm.

35 . The method of claim 27 , wherein the first position of the file block comprises a starting position and an ending position of the file block in the data file, or a starting position and a length of the file block in the data file.

36 . An apparatus comprising:
one or more processors; and a non-transitory memory storing computer-executable instructions therein that, when executed by the processors, perform the operations of:
receiving, from a client device, a request for a data file, the request including a first identifier of the data file;
identifying a local matching data file based on the first identifier of the data file;
selecting a file block from the local matching data file at a first position in the data file;
obtaining a characteristic value of the file block; and
determining that the data file exists if the characteristic value matches a second characteristic value of the file block.

37 . The apparatus of claim 36 wherein the instructions further perform the operation of transmitting the first position to the client device after acquiring the first position of the file block.

38 . The apparatus of claim 36 wherein the instructions further perform the operation of transmitting an indication that the data file exists to the client device.

39 . The apparatus of claim 36 wherein the request for a data file further includes a position of a file block in the data file, and a second characteristic value corresponding to the file block at the first position, wherein acquiring a first position of the file block comprises extracting the position from the first identifier, and wherein obtaining a characteristic value of the file block comprises extracting the second characteristic value from the first identifier.

40 . The apparatus of claim 36 , wherein the characteristic value comprises an MD5 or SHA value.

41 . The apparatus of claim 36 , wherein the first position of the file block comprises a first position of the file block obtained by designation.

42 . The apparatus of claim 36 , wherein the first position of the file block further comprises a first position of the file block obtained using a random algorithm.

43 . The apparatus of claim 36 , wherein the first position of the file block comprises a starting position and an ending position of the file block in the data file, or a starting position and a length of the file block in the data file.

44 . An apparatus comprising:
one or more processors; and a non-transitory memory storing computer-executable instructions therein that, when executed by the processors, perform the operations of:
sending a request for a data file to a server, the request including a first identifier of the data file;
receiving a first position sent by the server;
selecting a file block at a corresponding position from the data file based on the first position;
calculating a second characteristic value of the selected file block; and
transmitting the second characteristic value to the server.

45 . The apparatus of claim 44 , wherein the instructions perform the operation of receiving information, returned by the server, indicating that the data file exists.

46 . A system comprising:
a client device, configured to:
send a request for a data file to a server device, the request including a first identifier of the data file,
select, according to a first position of a file block sent by the server device, a file block at a corresponding position from the data file to be transmitted,
calculate a second characteristic value of the selected file block, and
send the second characteristic value of the file block to the server device; and
the server device, configured to:
search for a local matching data file according to the first identifier of the data file in the request sent by the client device,
select a file block from the local matching data file, and acquire a first position of the selected file block,
send the first position to the client device, and
determine that the data file exists if the second characteristic value matches a third characteristic value of the selected file block.

Assignees

• Alibaba Group Holding Ltd

Inventors

• Wang Hanzhang

Classifications

• G06F17/30109 Primary

  Physics · mapped topic

• G06F17/30203

  Physics · mapped topic

• H04L67/42

  Electricity · mapped topic

• H04L67/06

  specially adapted for file transfer, e.g. file transfer protocol [FTP] · CPC title

• G06F16/152 Primary

  using file content signatures, e.g. hash values · CPC title