Secure hyper transfer of large files

Patent metadata

Field	Value
Publication number	US-10078638-B2
Application number	US-201615175767-A
Country	US
Kind code	B2
Filing date	Jun 7, 2016
Priority date	Jun 7, 2016
Publication date	Sep 18, 2018
Grant date	Sep 18, 2018

Abstract

A system is disclosed having at least one computing device configured to send a computer file across a network by segmenting the computer file into identifiable segments and sending the segments in parallel across the network. The segmenting can be initiated while the computer file is generated. In another embodiment, a computer program product is disclosed having program code stored on a computer-readable storage medium, which when executed by at least one computing device, causes the computing device to transfer a computer file across a computer network by segmenting the computer file into identifiable segments and sending the segments in parallel across the network. The segmenting can be initiated while the computer file is generated. In another embodiment, a method of transferring a computer file across a network is disclosed, the method including segmenting the computer file into identifiable segments and sending the segments in parallel across the network.

First claim

We claim:

1. A system comprising:
at least one computing device configured to send a computer file across a network from a first network file system to a second network file system by performing actions including:
segmenting the computer file into identifiable segments, the segmenting being initiated while the computer file is being generated into the first network file system; and
sending the segments in parallel across the network,
wherein segmenting is performed by a first hypertransfer transactor writing transaction control data into first control files, the transaction control data indicating that the computer file exists or is being generated and wherein the segmenting is initiated in response to invoking the first hypertransfer transactor or in response to the first hypertransfer transactor generating the computer file.

2. The system of claim 1 , wherein the system further comprises:
at least a second computing device configured to receive the computer file from across the network by performing actions including:
receiving the segments.

3. The system of claim 2 , wherein receiving the segments at the at least a second computing device further comprises:
determining hash information for the segments at the second computer network file system; and
verifying the segments received are the same as the segments sent by comparing the hash information for the segments at the second computer network file system with hash information determined at the first computer network file system.

4. The system of claim 3 , wherein as a result of verifying revealing that hash information for any particular segment at the second computer network file system is not the same as hash information for that particular segment at the first computer network file system, the particular segment is re-sent.

5. The system of claim 1 , wherein the at least one computing device is configured to receive file segments from a second computing device.

6. The system of claim 1 , wherein the first hypertransfer transactor is configured to be invoked by a first file-generating application generating the file into the first network file system.

7. The system of claim 1 , wherein segmenting includes a first hypertransfer controller reading the first control files to determine when the file is to be sent.

8. The system of claim 7 , wherein segmenting includes the first hypertransfer controller initiating a plurality of first hypertransfer agents, the plurality of first hypertransfer agents reading the first control files to determine segment size, each first hypertransfer agent updating the first control files to identify with a specific segment.

9. The system of claim 8 , wherein the first hypertransfer controller is configured to read operating instruction data from a first configuration file.

10. The system of claim 8 , wherein segmenting further includes launching the plurality of hypertransfer agents on a plurality of other systems, the systems all sharing the first network file system.

11. The system of claim 8 , wherein sending includes updating the at least one control file with file transfer progress data.

12. A computer program product comprising program code stored on a non-transitory computer-readable medium, which when executed by at least one computing device, causes the at least one computing device to transfer a computer file across a computer network by performing actions including:
segmenting the computer file into identifiable segments, the segmenting being initiated while the computer file is generated into the first network file system; and
sending the segments in parallel across the network,
wherein segmenting includes a first hypertransfer transactor writing transaction control data into first control files, the transaction control data indicating that the computer file exists or is being generated, and wherein segmenting further includes a first hypertransfer controller reading first control files to determine when a file is to be sent and initiating a plurality of first hypertransfer agents, the plurality of first hypertransfer agents reading the first control files to determine segment size, each first hypertransfer agent updating the first control files to identify with a specific segment.

13. The computer program product of claim 12 , wherein the actions further include hashing the file segments.

14. The computer program product of claim 12 , wherein the first hypertransfer transactor is configured to be invoked by a first file-generating application generating the file into the first network file system.

15. The computer program product of claim 12 , wherein segmenting further includes launching the plurality of hypertransfer agents on a plurality of systems, the systems all sharing the first network file system.

16. A method of transferring a computer file across a network, the computer file being segmented into identifiable segments while the computer file is generated into a first computer network file system, wherein the segmenting includes a first hypertransfer transactor writing transaction control data into first control files, the transaction control data indicating that the computer file exists or is being generated, the method comprising:
receiving the segments, sent in parallel across the network, at a second computer network file system,
determining hash information for the segments at the second computer network file system; and
verifying the segments received are the same as the segments sent by comparing the hash information for the segments at the second computer network file system with hash information determined at the first computer network file system.

17. The method of claim 16 , wherein the method further comprises:
segmenting the computer file into identifiable segments;
sending the segments in parallel across the network to the second computer network file system; and
resending segments whose hash information determined at the second computer network file system is different than the hash information determined at the first computer network file system.

18. The method of claim 17 , wherein the method further comprises sending the segments to a plurality of computer network file systems simultaneously.

Assignees

• Globalfoundries Inc

Inventors

• Loring Keith P
• Raisbeck Daniel B
• Paul John
• Davis Sean C
• Kumar Amit

Classifications

• G06F17/30097

  Physics · mapped topic

• G06F17/3007 Primary

  Physics · mapped topic

• H04L67/06 Primary

  specially adapted for file transfer, e.g. file transfer protocol [FTP] · CPC title

• H04L63/123

  received data contents, e.g. message integrity · CPC title

• G06F16/11 Primary

  File system administration, e.g. details of archiving or snapshots (error detection or correction of the data by redundancy in operations G06F11/14) · CPC title