Large file transfer...
 
Notifications
Clear all

Large file transfer - suggestions?

19 Posts
15 Users
0 Reactions
1,239 Views
(@cults14)
Reputable Member
Joined: 17 years ago
Posts: 367
Topic starter  

Hi

This is not a forensic question really, but we have a problem trying to transfer a large file (15GB) down a flaky comms line (2,000 miles from host to target) which tends to result in a corrupted transfer. Flaky, as in up and down like the proverbial.

File is a compressed backup of an SQL database. Assume that we can do nothing about the comms line.

Was wondering if any folks out there have encountered this and if so any suggestionss for building in fault recovery?

I wondered if using FTK Imager, creating a compressed custom AD1 image (with the option of encryption) in manageable chunks (say 100MB for arguments sake) would be a sensible option?

And then open and export from FTK Imager on the target system.

Any thoughts?

Cheers


   
Quote
(@ludlowboy)
Trusted Member
Joined: 15 years ago
Posts: 71
 

Sorry to be so low tech

Is there any reason why not cannot create an encrypted area on a thumb drive, copy your data into it and then courier /post it.?


   
ReplyQuote
(@cults14)
Reputable Member
Joined: 17 years ago
Posts: 367
Topic starter  

Ludlowboy - it may yet come to hand-carrying, but this is from Canada to US and we've had bad experience in the past of people/data/computers/disks/CDs/software being turned back by Homeland Security (

BTW - did you know that Ludlow is one of only for racecourses in UK which don't contain any of the characters "r a c e" in their name? )

Cheers


   
ReplyQuote
(@miket065)
Estimable Member
Joined: 21 years ago
Posts: 187
 

I think your concept of using FTK to "chunk" your data is the right solution.

mbt


   
ReplyQuote
(@woany)
Eminent Member
Joined: 16 years ago
Posts: 28
 

Could you use robocopy? (http//en.wikipedia.org/wiki/Robocopy)


   
ReplyQuote
PaulSanderson
(@paulsanderson)
Honorable Member
Joined: 19 years ago
Posts: 651
 

If acceptable encrypt it and put it on a P2P network such as bit torrent these networks are designed to deal with just that sort of issue.


   
ReplyQuote
4Rensics
(@4rensics)
Reputable Member
Joined: 16 years ago
Posts: 255
 

Terra copy is pretty good too, confirms all copies.

Also, if you are using FTK, could you not in the same premise split it into RAR files of XX chunks in size and they can then be unzipped into the one file at the other end?


   
ReplyQuote
(@cults14)
Reputable Member
Joined: 17 years ago
Posts: 367
Topic starter  

Thanks all for your suggestions.

PaulS - hadn't considered this so thanks

4Rensics - don't know Terra copy, will go have a look-see. Apparently we've tried 7Zip before and it works 99%, which clearly is a pain when the 1% makes you start over (

Thanks again everyone


   
ReplyQuote
(@jonstewart)
Eminent Member
Joined: 16 years ago
Posts: 47
 

This is a job for rsync. You can run rsync on both endpoints and kick off the copy. They will verify, via hashing, that the data received is the data that was sent. Rsync supports transport compression, and tunnels over ssh. If it gets aborted, just rereun–it will calculate hashes over what exists on the destination to be sure it's consistent with the source, and then transfer the needed data.

Also, rsync can work on a single file or on a directory of files recursively.

Jon


   
ReplyQuote
jaclaz
(@jaclaz)
Illustrious Member
Joined: 18 years ago
Posts: 5133
 

If you are going down the "split files" road, you can use .par files allright
http//www.techsono.com/faq/par.html
http//en.wikipedia.org/wiki/Parchive
that's what has been used on usenet to lessen the problems with wrong data transfer.

jaclaz


   
ReplyQuote
Page 1 / 2
Share: