17th June, 2001
Fuck! Fucketty Fuck Fuck Fuck!
Sunday, 7:30 am in Archive
I’ve been indexed by another fucking spider, which is what sends the karma all crazy (<i>sometimes</i> it’s people, but generally it’s spiders, and yes; I can usually tell). I think I’ve fixed it all by hand, but I really need to find a better way to keep the bastard things off my site.- « Previous
- Next »
Comments
-
what’s a spider devi dee?
-
Er, a robot for a search engine. It goes through and grabs all the links it can find and bungs them into somewhere like <a href=”http://www.google.com” target=”_blank”>Google</a>. That’s why the page thinks it has “clicked” on every single link.
-
Ya’ll need the magic meta tag that tells the spiders to fuck off.

<br /><br />
<META NAME=”ROBOTS” CONTENT=”NO INDEX, NO FOLLOW”> -
Oops…sorry…didn’t know what this was going to do with HTML. Let’s try again:
<br /><br />
<br />
<META NAME=”ROBOTS” CONTENT=”NO INDEX, NO FOLLOW”> -
Oh wow. Thanks heaps.

-
i knew there was a meta tag that did it, i just couldn’t remember what it was :>