Bad site crawling softwareSo there's

Bad site crawling software

So there's some person who visits my site that just annoys me.  Whatever they use to visit my home page crawls it, ignoring the robots.txt for my site.  So, to whoever you are, your software bites.  Whenever you scan my page you go and vote for and against every single post on a page, which seems like it would take a heck of a lot longer then just loading the page by itself.

Pages

Powered by Movable Type 8.0.2

About this Entry

This page contains a single entry by Gregory published on March 5, 2002 2:34 PM.

QOTDVoltaire. "I may disagree with was the previous entry in this blog.

BRRRRRRDAMN is it cold out.  is the next entry in this blog.

Find recent content on the main index or look in the archives to find all content.