Hi,
Has anyone got any experience with exporting all the contents from a publically accessible twitter profile?
The problem I'm having is that if the webpage is saved off as an HTML file, then all the collapsed replies are not captured. I've attempted to use HTTrack, but the same issue occurs.
I also looked into using the twitter API, however it does not provide a timeline that includes replies from other users.
Does anyone know of a way of producing the timeline and include the replies in a nice readable format?
Should anyone else have the same issue and need to capture a twitter timeline, I created a Ruby script which will produce a TSV file containing the users timeline, along with other useful information. No OAuth, or twitter account required to use this.
Source code is available at https://
Feel free to email me, if you need any assistance.
Haven't tried it yet, but it sounds very useful.
Thanks
If needed, I can convert it to EXE, just let me know.
If needed, I can convert it to EXE, just let me know.
That might be handy - thanks.
I should learn some Ruby at some point, but coming from Python all of those "end"s make me sad.
Useful script, thanks for sharing )
related to this, if anyone ever does a search warrant for twitter (which is SO much fun to do because they make the process easy), i wrote a parser that will take their return data and turn it into something usable.
if anyone needs it lemme know
If you're willing to pay for it, X1 Social Discovery does a very nice job of capturing twitter content and allows for keyword searching, geo-mapping, and can create various report types. The nice part about this tool is that it will automatically generate .png images of all webpages linked to by the collected tweets and download videos for youtube links found in tweets.
As asked for, the script has been converted to EXE and can be downloaded from https://
suggestions for additional features are always welcome
I'm demoing a product called X1 Social Discovery that does exactly that. They have a 14 day free trial.
http//
Social media has been very helpful in fraud cases we've worked on, and I'm hoping this product will make that process more efficient.