Distributed Process...
 
Notifications
Clear all

Distributed Processing

6 Posts
5 Users
0 Likes
2,036 Views
KungFuAction
(@kungfuaction)
Posts: 109
Estimable Member
Topic starter
 

I just read that FTK has it, but do any other carving software support distributed processing?

Marc Yu
Pensacola Forensics

 
Posted : 24/07/2012 10:09 pm
Passmark
(@passmark)
Posts: 376
Reputable Member
 

For carving you are normally limited by disk speed.

So I am not sure if throwing more CPUs at the problem across a (relatively slow) network is of much benefit.

Modern PCs tend to have CPU cores and RAM to spare.

 
Posted : 26/07/2012 7:51 am
(@patrick4n6)
Posts: 650
Honorable Member
 

For carving you are normally limited by disk speed.

So I am not sure if throwing more CPUs at the problem across a (relatively slow) network is of much benefit.

Modern PCs tend to have CPU cores and RAM to spare.

I've watched 3 worker nodes and the main system max out their CPUs over gigabit ethernet on FTK3. Then you can go a bit further without much more money in your network with bonding. Put your sources on a good RAID and the CPU will be the bottleneck. Distributed processing does help. I've just built a great system with 5 servers (32xcores each) and 2xSAN to distribute processing for eDiscovery.

For the OP, X-Ways allows distributed processing, although last I saw it was less simple to do than FTK.

 
Posted : 26/07/2012 10:10 am
Passmark
(@passmark)
Posts: 376
Reputable Member
 

I can imagine this is the case for some ediscovery tasks, but the OP was asking about carving. If you maxing out 160 CPU cores and a Gigabit network carving a file from the disk then I think there is something very very wrong with the carving algorithm.

Also if you have to copy your entire disk image from, for example, a USB drive to a RAID system, then you might already waste 20 hours doing this (2TB drive with USB2). In the same time you could have finished the carving job from the original drive instead. Of course if there are lots of different tasks you want to do on the image besides carving, then it makes sense to move it to a fast drive first.

 
Posted : 26/07/2012 12:24 pm
minime2k9
(@minime2k9)
Posts: 481
Honorable Member
 

I can imagine this is the case for some ediscovery tasks, but the OP was asking about carving. If you maxing out 160 CPU cores and a Gigabit network carving a file from the disk then I think there is something very very wrong with the carving algorithm.

Also if you have to copy your entire disk image from, for example, a USB drive to a RAID system, then you might already waste 20 hours doing this (2TB drive with USB2). In the same time you could have finished the carving job from the original drive instead. Of course if there are lots of different tasks you want to do on the image besides carving, then it makes sense to move it to a fast drive first.

Going to throw my 2p in.
For carving most things, including pictures and internet history, you are going to max out at CPU first. Although this problem is confounded by the fact that most carving programs are not multi threaded and therefore only use a small percentage of the CPU anyways!
This is probably why it seems there is a lot of CPU spare as a maxed CPU may only account for 10% of the CPU's maximum power.
Also it will depend on the complexity of the carving algorithm, simple header and footer carving is less CPU intensive compared to say SQLite records or picture files.

 
Posted : 26/07/2012 1:21 pm
nightworker
(@nightworker)
Posts: 134
Estimable Member
 

maybe you can use a server like this
http//ptk.dflabs.com/PTKBrochure.pdf

 
Posted : 26/07/2012 2:37 pm
Share: