Removing duplicates...
 
Notifications
Clear all

Removing duplicates in NetAnalysis

3 Posts
2 Users
0 Reactions
319 Views
4Rensics
(@4rensics)
Reputable Member
Joined: 16 years ago
Posts: 255
Topic starter  

Hello.

OK, going out on a long shot with this one…

I have managed to carve out 60,000 Safari PLISTS from a Mac Book for internet history. 60k is a lot. I checked by hash and they are all unique as expected (bloody unallocated!) However, when I have started loading them in to NetAnalysis v1.51 there are loads and loads of duplicate hits for the same URLs with exactly the same time, dates, adresses etc. And from 500 plists loaded I got 30,000 URLs. My math aint great, but averages will tell me to math it by 30,000 x 500 x 12 ? So that's a lot of work and a lot of duplicates.

Is there any way to get rid. Nothing is standing out on NetAnalysis and I can't give all my officers potentially [opens Calc…] 180,000,000 URLS to trawl through! (my math might be off a little) but you get the idea, its a unrealistic amount of work for potential chuffing www.facebook.com x 50,000!

Any ideas mucho appreciated people )

Thanks.


   
Quote
(@miket065)
Estimable Member
Joined: 21 years ago
Posts: 187
 

Netanalysis will run a SQL query; maybe a select distinct row or something similar?

Also, Netanalysis will do keyword searches. That won't necessarily eliminate the duplicates if they contain the keyword but should help you focus.


   
ReplyQuote
4Rensics
(@4rensics)
Reputable Member
Joined: 16 years ago
Posts: 255
Topic starter  

Oh SQL could be handy. Thanks.


   
ReplyQuote
Share: