Spidering/Web Crawl...
 
Notifications
Clear all

Spidering/Web Crawling Social Networking Sites

4 Posts
3 Users
0 Reactions
534 Views
 IanF
(@ianf)
Trusted Member
Joined: 17 years ago
Posts: 55
Topic starter  

All,

Does anyone have any tools/scripts in their arsenal which would be useful in either spidering or crawling certain common social networking sites for specific search terms or usernames ?

Thanks.


   
Quote
(@bithead)
Noble Member
Joined: 20 years ago
Posts: 1206
 

dtSearch. Desktop with Spider. Single seat $199 US


   
ReplyQuote
 IanF
(@ianf)
Trusted Member
Joined: 17 years ago
Posts: 55
Topic starter  

Thanks for the pointer BitHead.

I've downloaded an eval copy of dtSearch Desktop with Spider and it looks great as a general spidering and indexing tool but maybe I'm reading it wrong in relation to passing search terms through it into Facebook for example and just indexing all of the search results that return. I don't see that it is specific enough for this type of searching.

I have however only been looking at for the past couple of hours.

I appreciate that it will probably work great on a particular start point (eg a users home page).

Any usage pointers ?

Ta.


   
ReplyQuote
(@fuzed)
Trusted Member
Joined: 16 years ago
Posts: 93
 

I would google facebook forensics, theres some guidance out there on this, although I do not off hand know exactly how FB creates users profiles and information under that sub profile, maybe worth experimenting on your own profile if you have one?

If you tried to spider the whole of FB youd probably be there a very long time - dependant on what information came back…


   
ReplyQuote
Share: