On a completely different topic, my blog hits are up to on average a thousand a week now. And if you’re NOT a techie like me you might want to skip this post.
Sometimes, I get spikes and lows, blah blah blah. That’s all good and well but a huge chunk of that is search engines crawling my site. I’m flattered the little bot buggers love me however, I do need to consider my bandwidth usage. I’m in no danger for the moment as my host gives me a fat amount. That said, knowing the net and how one odd key phrase can sometimes spark a wildfire of hits, I’m starting to get concerned.
So I ask you, my fellow bloggers, do you block or limit your bot crawls? (bot is short for crawler robot’s which is slang for search engines that use “crawler” programs to index the internet.) Google in particular seems to just LOVE my site. Of course, if you are using a free blogger site such as blogger.com, this doesn’t apply to you. I’m refering to bloggers who host their own blogs like me. I’m thinking I don’t want to block the bots completely but maybe limit their searches to once a week/month. That way, I still get visibility on the net w/o having my bandwidth taxed.
do a search on robots.txt
it’s a file that you keep in your web directory that will not allow certain types of bots to crawl your site, or at least that is how i think it is. i use it to keep bots out of my media file.
Whaddup Moby? All your hits are coming from me… I’m cyber-stalking you!!
My first stalker! YEAH!
Hell I still don’t know how to read all my blog stats… so I just let it go for now 🙂