| 35 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 94174 | 5.64 GB | 31 Aug 2009 - 23:59 |
| Yahoo Slurp | 3459 | 329.59 MB | 31 Aug 2009 - 23:57 |
| twiceler | 7697 | 449.77 MB | 31 Aug 2009 - 23:27 |
| MSNBot | 664 | 44.97 MB | 31 Aug 2009 - 23:03 |
| Ask | 121 | 6.94 MB | 31 Aug 2009 - 20:45 |
| Yahoo-MMCrawler | 349 | 6.29 MB | 31 Aug 2009 - 20:20 |
| Unknown robot (identified by empty user agent string) | 1960 | 26.48 MB | 31 Aug 2009 - 16:54 |
| BaiDuSpider | 290 | 12.05 MB | 31 Aug 2009 - 13:29 |
| Yandex bot | 17 | 154.44 KB | 31 Aug 2009 - 13:22 |
| psbot | 644 | 9.84 MB | 31 Aug 2009 - 08:42 |
| Exabot | 12 | 156.35 KB | 31 Aug 2009 - 00:42 |
| CFNetwork | 19 | 83.76 MB | 31 Aug 2009 - 00:34 |
| Perl tool | 54 | 2.96 MB | 30 Aug 2009 - 19:53 |
| Vagabondo | 4124 | 218.19 MB | 30 Aug 2009 - 16:45 |
| SurveyBot | 1 | 9.08 KB | 30 Aug 2009 - 00:32 |
| Powermarks | 45 | 1.08 MB | 29 Aug 2009 - 10:29 |
| Unknown robot (identified by 'bot*') | 28 | 259.48 KB | 29 Aug 2009 - 03:52 |
| HTTrack off-line browser | 979 | 36.04 MB | 28 Aug 2009 - 23:12 |
| Alexa (IA Archiver) | 23 | 795.30 KB | 28 Aug 2009 - 20:51 |
| Python-urllib | 5 | 510.14 KB | 28 Aug 2009 - 14:55 |
| WGet tools | 3 | 110.01 KB | 27 Aug 2009 - 21:04 |
| Speedy Spider | 2 | 0 | 26 Aug 2009 - 18:06 |
| Java (Often spam bot) | 95 | 3.59 MB | 25 Aug 2009 - 16:35 |
| Unknown robot (identified by 'discovery') | 2 | 26.50 KB | 25 Aug 2009 - 16:29 |
| MSIECrawler | 23 | 529.66 KB | 25 Aug 2009 - 01:25 |
| Unknown robot (identified by 'robot') | 14 | 131.38 KB | 24 Aug 2009 - 22:02 |
| yacy | 1 | 9.08 KB | 24 Aug 2009 - 10:13 |
| BetaBot | 31 | 989.84 KB | 21 Aug 2009 - 14:52 |
| Unknown robot (identified by 'crawl') | 75 | 1.77 MB | 21 Aug 2009 - 12:27 |
| Nutch | 5 | 21.52 KB | 21 Aug 2009 - 08:50 |
| MJ12bot | 1493 | 96.64 MB | 18 Aug 2009 - 02:59 |
| FavOrg | 1 | 12.48 KB | 15 Aug 2009 - 21:06 |
| Turn It In | 13 | 918.59 KB | 11 Aug 2009 - 04:59 |
| Netcraft | 1 | 9.08 KB | 06 Aug 2009 - 20:13 |
| larbin | 1 | 9.08 KB | 03 Aug 2009 - 15:11 |