up vote 0 down vote favorite
share [g+] share [fb]

One of my favorite blogs/comics is closing down and I'd like to archive it. I contacted the authors but got no response. I'd like to know if there is an existing program that will crawl and archive the site.

I believe it is using WordPress 3.0 and ComicPress 2.7. The archiving doesnt need to be perfect. I just want the comic/main img, description and optionally the user comments below.

link|improve this question
77% accept rate
2  
this doesn't really have anything to do with WordPress - flagged as off-topic. The OP should look at archive.org which will probably have an archive of the site. – anu May 5 '11 at 12:43
@anu: archive.org doesnt archive images which is what i am asking to do. I'm trying to not write a wordpress crawler if possible – acidzombie24 May 5 '11 at 15:45
There are plenty of ready-made crawlers, httrack comes to mind. Anyway this has nothing to do with WP, since crawling and saving site is not WordPress-specific operation and site being WordPress-based is irrelevant. Try asking this on SuperUser (I guess) if you need more help. – Rarst♦ May 5 '11 at 20:23
@Rarst: None of them word which is why i asked here.... – acidzombie24 May 6 '11 at 1:36
@Rarst: Also have you tried httrack on a WP site? It got confused when i tried using it and after an hour it still didnt crawl any of the pages i wanted. Their image directories were open so i easily grabbed the pictures. I just need the text (which is why i think writing a bot wouldnt be out of the question if its this simple/specific) – acidzombie24 May 7 '11 at 6:44
feedback

closed as off topic by Bainternet♦, Rarst♦ May 5 '11 at 20:24

Questions on WordPress - Stack Exchange are expected to generally relate to WordPress, within the scope defined in the faq.

Browse other questions tagged or ask your own question.