zero fill and checksum
Go to page 1, 2, 3 Next
| View previous topic :: View next topic |
| Author |
Message |
twjolson
Newbie

Joined: Dec 18, 2008
Posts: 36
Location: Minnesota
|
Posted: Mon Dec 21, 2009 10:21 pm Post subject: zero fill and checksum |
|
I'm playing around with doing a zero fill. I've done a 500 gig hard drive and a 2gig flashdrive. However, after I do the zero fill, the checksum doesn't add up to zero. The MD5 hash, for instance, returns a non-zero result. I was under the impression that a zero'ed out drive returns a zero hash. Looking at the disk with a hex editor confirms the drive was zero'ed out.
Assuming my information is wrong. How do you ensure the drive is all zero's, without having to pour through pages and pages of Zeros?
Thanks!
|
|
| Back to top |
|
 |
mscotgrove
Senior Member

Joined: Jan 01, 2009
Posts: 237
Location: Sussex, UK
|
Posted: Tue Dec 22, 2009 3:31 am Post subject: Re: zero fill and checksum |
|
An MD5 hash will be different for every length of file, even though the contents may all be zero. A CRC sumcheck will also produce different results.
The only sumcheck that will return zero is one that justs adds each byte to a number.
The only way to check that it is totals zeros is to add every byte into a long number, ie int64 to make sure it does not overflow. This number should be zero
|
|
| Back to top |
|
 |
twjolson
Newbie

Joined: Dec 18, 2008
Posts: 36
Location: Minnesota
|
Posted: Wed Dec 23, 2009 11:50 am Post subject: Re: zero fill and checksum |
|
So, how do you go about proving that in court?
Here is how I heard it. You image the drive, but after doing your examination on the image you want to start up the computer as the suspect did, same hardware and such. You can't just put the evidence drive in, so you do a copy of the image to a new, similiar drive. However, the defense might balk, how do you know that the new, similiar drive did not have old data on it, data that you are now using against their client.
I might have heard wrong, but my curiousity remains. How do you go about proving a zero filled drive is actually zero filled? A program or something?
|
|
| Back to top |
|
 |
Patrick4n6
Senior Member

Joined: Apr 11, 2009
Posts: 376
Location: Memphis, TN, USA
|
Posted: Wed Dec 23, 2009 12:08 pm Post subject: Re: zero fill and checksum |
|
Pretty much all the live forensics CDs out there implement a checksum that will return a string of zeros if your drive is wiped. Get one, validate its results against a known wiped drive, and then use it every time and you are fine.
_________________ Tony Patrick, B. Inf Tech, CFCE
www.patrickcomputerforensics.com |
|
| Back to top |
|
 |
ba2llb
Newbie

Joined: Nov 27, 2009
Posts: 35
Location: Canada
|
Posted: Wed Dec 23, 2009 12:25 pm Post subject: Re: zero fill and checksum |
|
| twjolson wrote: |
So, how do you go about proving that in court?
Here is how I heard it. You image the drive, but after doing your examination on the image you want to start up the computer as the suspect did, same hardware and such. You can't just put the evidence drive in, so you do a copy of the image to a new, similiar drive. However, the defense might balk, how do you know that the new, similiar drive did not have old data on it, data that you are now using against their client.
I might have heard wrong, but my curiousity remains. How do you go about proving a zero filled drive is actually zero filled? A program or something? |
Compression of the zeroed out storage device should produce maximum compression ratio and you can prove this for any given-sized storage media. On another note, the Secure Erase utility is fast and completely compliant with U.S. gov standards and practices.
|
|
| Back to top |
|
 |
4n6art
Member

Joined: Jan 10, 2008
Posts: 92
Location: USA
|
Posted: Wed Dec 23, 2009 3:23 pm Post subject: Re: zero fill and checksum |
|
If I am not mistaken...
A CRC32 check of the entire drive that is completely Zeros will yield a checksum of all Zeros.
I don't have my info in front of me but I seem to recall that may be the case. You may want to test it out. This is assuming that the drive has been zero-wiped and not reformatted after that.
Happy and safe holidays and New Year to everyone!
-=ART=-
|
|
| Back to top |
|
 |
armresl
Senior Member

Joined: Nov 04, 2004
Posts: 395
Location: Indiana
|
Posted: Wed Dec 23, 2009 4:57 pm Post subject: Re: zero fill and checksum |
|
If you are wanting to see things like the user did and aren't going the virtual route. Use Safeback and backfill.
Something that is easily forgotten is that any objection has to have foundation, someone can't object just to object. If there is an objection raised you can intelligently say you did xyz and why xyz was the best choice for your sceneraio.
Safeback is a great tool and rarely mentioned anymore, but as long as you get a hard drive which is close to the same size as the donor drive, you will be A O K.
| twjolson wrote: |
So, how do you go about proving that in court?
Here is how I heard it. You image the drive, but after doing your examination on the image you want to start up the computer as the suspect did, same hardware and such. You can't just put the evidence drive in, so you do a copy of the image to a new, similiar drive. However, the defense might balk, how do you know that the new, similiar drive did not have old data on it, data that you are now using against their client.
I might have heard wrong, but my curiousity remains. How do you go about proving a zero filled drive is actually zero filled? A program or something? |
_________________ Why order a taco when you can ask it politely?
We need to look out for the rights of others who can't look out for themselves... DRM |
|
| Back to top |
|
 |
mscotgrove
Senior Member

Joined: Jan 01, 2009
Posts: 237
Location: Sussex, UK
|
Posted: Wed Dec 23, 2009 6:02 pm Post subject: Re: zero fill and checksum |
|
"A CRC32 check of the entire drive that is completely Zeros will yield a checksum of all Zeros."
I am pretty certain that a CRC32 will not produce a sucheck of zero from data which is just zero. I am also pretty certain that the sumcheck will be different for each length of a zero filled file. The sumcheck starts with an XOR with a value such as 0x8005 (for CRC16) and this ripples through to be different with every byte
_________________ Michael Cotgrove
www.cnwrecovery.com
cnwrecovery.blogspot.com/
Last edited by mscotgrove on Thu Dec 24, 2009 10:58 am; edited 1 time in total |
|
| Back to top |
|
 |
jaclaz
Senior Member

Joined: Nov 16, 2007
Posts: 420
Location: Near Florence - Italy
|
Posted: Thu Dec 24, 2009 10:40 am Post subject: Re: zero fill and checksum |
|
I am not pretty  , but I am certain  :
en.wikipedia.org/wiki/...ancy_check
Checksums of a 512 bytes 00 filled file (tiny hexer):
| Code:: |
Sum of bytes:
00
CRC16 checksum:
BB41
CRC32 checksum:
B2AA7578
MD5 digest:
BF619EAC0CDF3F68D496EA9344137E8B |
Checksums of a 1024 bytes 00 filled file (tiny hexer):
| Code:: |
Sum of bytes:
00
CRC16 checksum:
D4BE
CRC32 checksum:
EFB5AF2E
MD5 digest:
0F343B0931126A20F133D67C2B018A3B |
jaclaz
|
|
| Back to top |
|
 |
pwakely
Newbie

Joined: Jun 09, 2009
Posts: 37
Location: UK
|
Posted: Mon Dec 28, 2009 6:08 am Post subject: Re: zero fill and checksum |
|
In my opinion CRCs are not ideal for verification of all-zero space, for two main reasons:
(1) while it is possible to select a CRC with properties that generate a zero result for all-zero data, they will do it for any length of data (so does not verify that the full data length has been examined)
(2) CRCs are easily manipulated (i.e. I could easily insert data into the middle of all zero space and simply add a few bytes of extra data to generate a zero CRC). Equally CRC-checked data itself is often designed to generate all-zero result for error checking.
My preferred method therefore is either a direct check (effective programming check of values at all locations are ==0), or if wanting to use tools for ease of use, then to perform a standard hash (MD5/SHA1/SHA256) and compare against the known result for a hash of an all-zero sequence of bytes of the same length as the data under consideration. The "known result" can be generated either by creation of a file of the required size of all-zero binary data and performing the hash on that file, or programatically.
Since I had a software method I wanted to test, I have created this as a simple windows utility, the "all-zero hash calculator" (am sure I should have thought of a snappier name...) which will provide the "known result" for any specified length of bytes, and included acceleration tables so that the result can be calculated in less than a second for any length up to 2TB. I have made this freely available here. Any feedback welcome as usual, and hope some people find it useful.
Phil.
_________________ Phil Wakely
Edenprime Systems Ltd
www.edenprime.com |
|
| Back to top |
|
 |
|
|
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum
|
| | | | |