View Single Post
Old September 27th, 2006, 18:02   #13
Drake's Avatar
Join Date: Dec 2001
Location: Montreal, QC
Again, concerning outside sources, I'm still boggled as to why nobody is setting up a robots.txt file to control what can be spidered/archived. All legit crawlers will look for and respect the robots.txt file (notably Goggle, which is the only one I know that will search out images)
Drake is offline   Reply With Quote