I need a good web crawler

C

Calsa

I haven't had to crawl a web site in a while so I am wondering what people are using these days (that's free) to crawl web sites.
 
Probably have to be a bit more specific...

...with what scipts/progs you have at your disposal, not the URLs of the porn sites you're ripping.
 
My girlfriend just modified one to scour educational journal databases... but I have no idea what she used.

After she told me she did that, we had wild sex. A technological chick is wicked.

I know this doesn't help, but this is my experience with web crawlers. The end.
 
I hear this one is pretty good:

Spider_man_wall_crawl.jpg
 
You must log in or register to reply here.
Back
Top