Invasion of the Bots
Posted by Charlie Thu, 30 Aug 2007 21:43:00 GMT
I imagine that most people realize that search engines use bots, or spiders, to continually crawl across the web looking for new content. But I bet most people don't realize how pervasive bots really are.
Analyzing the MapBuzz web logs, 64 different bots visited our site in the last few week. And here are the top ten:
You can see they come visit quite often.