|
Top 30 of 36917 Total Sites |
|
# |
Hits |
Files |
kB F |
kB In |
kB Out |
Visits |
Hostname |
|
1 |
267923 |
13.56% |
255530 |
17.64% |
23842295 |
25.87% |
0 |
0.00% |
0 |
0.00% |
7 |
0.01% |
b3091082.crawl.yahoo.net |
2 |
45831 |
2.32% |
40417 |
2.79% |
1538277 |
1.67% |
0 |
0.00% |
0 |
0.00% |
7 |
0.01% |
spider40.yandex.ru |
3 |
37021 |
1.87% |
31121 |
2.15% |
1005216 |
1.09% |
0 |
0.00% |
0 |
0.00% |
84 |
0.07% |
spider13.yandex.ru |
4 |
31184 |
1.58% |
30701 |
2.12% |
1260623 |
1.37% |
0 |
0.00% |
0 |
0.00% |
257 |
0.21% |
crawl8.dotnetdotcom.org |
5 |
28587 |
1.45% |
28424 |
1.96% |
675122 |
0.73% |
0 |
0.00% |
0 |
0.00% |
4 |
0.00% |
aurora6.mail.ru |
6 |
26253 |
1.33% |
26192 |
1.81% |
7661333 |
8.31% |
0 |
0.00% |
0 |
0.00% |
361 |
0.30% |
crawl-17c.cuil.com |
7 |
22768 |
1.15% |
22753 |
1.57% |
768407 |
0.83% |
0 |
0.00% |
0 |
0.00% |
45 |
0.04% |
cr21.wap.search.re3.yahoo.com |
8 |
22408 |
1.13% |
22393 |
1.55% |
1257579 |
1.36% |
0 |
0.00% |
0 |
0.00% |
86 |
0.07% |
natcrawlbloc05-37.net.m1.fti.net |
9 |
22263 |
1.13% |
22234 |
1.54% |
818950 |
0.89% |
0 |
0.00% |
0 |
0.00% |
54 |
0.04% |
natcrawlbloc04-15.net.s1.fti.net |
10 |
22087 |
1.12% |
22066 |
1.52% |
349884 |
0.38% |
0 |
0.00% |
0 |
0.00% |
95 |
0.08% |
natcrawlbloc04-16.net.s1.fti.net |
11 |
22020 |
1.11% |
22017 |
1.52% |
1259519 |
1.37% |
0 |
0.00% |
0 |
0.00% |
72 |
0.06% |
natcrawlbloc05-36.net.m1.fti.net |
12 |
21716 |
1.10% |
21702 |
1.50% |
759979 |
0.82% |
0 |
0.00% |
0 |
0.00% |
102 |
0.08% |
natcrawlbloc05-35.net.m1.fti.net |
13 |
21482 |
1.09% |
13556 |
0.94% |
1484752 |
1.61% |
0 |
0.00% |
0 |
0.00% |
276 |
0.23% |
llf531259.crawl.yahoo.net |
14 |
21411 |
1.08% |
21386 |
1.48% |
392386 |
0.43% |
0 |
0.00% |
0 |
0.00% |
99 |
0.08% |
natcrawlbloc05.net.m1.fti.net |
15 |
20983 |
1.06% |
20961 |
1.45% |
896975 |
0.97% |
0 |
0.00% |
0 |
0.00% |
52 |
0.04% |
natcrawlbloc02-175.net.b1.fti.net |
16 |
20854 |
1.06% |
20844 |
1.44% |
937697 |
1.02% |
0 |
0.00% |
0 |
0.00% |
56 |
0.05% |
natcrawlbloc04-14.net.s1.fti.net |
17 |
20784 |
1.05% |
20752 |
1.43% |
876479 |
0.95% |
0 |
0.00% |
0 |
0.00% |
62 |
0.05% |
natcrawlbloc03-34.net.m1.fti.net |
18 |
20750 |
1.05% |
20727 |
1.43% |
877158 |
0.95% |
0 |
0.00% |
0 |
0.00% |
50 |
0.04% |
natcrawlbloc01.net.m1.fti.net |
19 |
20627 |
1.04% |
20609 |
1.42% |
712350 |
0.77% |
0 |
0.00% |
0 |
0.00% |
58 |
0.05% |
natcrawlbloc01-29.net.m1.fti.net |
20 |
20501 |
1.04% |
20471 |
1.41% |
813821 |
0.88% |
0 |
0.00% |
0 |
0.00% |
71 |
0.06% |
natcrawlbloc03.net.m1.fti.net |
21 |
20360 |
1.03% |
20352 |
1.41% |
835528 |
0.91% |
0 |
0.00% |
0 |
0.00% |
48 |
0.04% |
natcrawlbloc02-174.net.b1.fti.net |
22 |
20351 |
1.03% |
20334 |
1.40% |
923232 |
1.00% |
0 |
0.00% |
0 |
0.00% |
43 |
0.04% |
natcrawlbloc02-176.net.b1.fti.net |
23 |
20280 |
1.03% |
20262 |
1.40% |
902681 |
0.98% |
0 |
0.00% |
0 |
0.00% |
53 |
0.04% |
natcrawlbloc02-173.net.b1.fti.net |
24 |
20112 |
1.02% |
20082 |
1.39% |
866969 |
0.94% |
0 |
0.00% |
0 |
0.00% |
44 |
0.04% |
natcrawlbloc04-13.net.s1.fti.net |
25 |
20044 |
1.01% |
20011 |
1.38% |
852516 |
0.92% |
0 |
0.00% |
0 |
0.00% |
52 |
0.04% |
natcrawlbloc03-33.net.m1.fti.net |
26 |
19527 |
0.99% |
19507 |
1.35% |
862568 |
0.94% |
0 |
0.00% |
0 |
0.00% |
42 |
0.03% |
natcrawlbloc01-30.net.m1.fti.net |
27 |
19078 |
0.97% |
19057 |
1.32% |
849898 |
0.92% |
0 |
0.00% |
0 |
0.00% |
43 |
0.04% |
natcrawlbloc01-31.net.m1.fti.net |
28 |
18872 |
0.96% |
18288 |
1.26% |
394575 |
0.43% |
0 |
0.00% |
0 |
0.00% |
8 |
0.01% |
crawl-10c.cuil.com |
29 |
18451 |
0.93% |
18431 |
1.27% |
831164 |
0.90% |
0 |
0.00% |
0 |
0.00% |
35 |
0.03% |
natcrawlbloc03-32.net.m1.fti.net |
30 |
13880 |
0.70% |
13851 |
0.96% |
3468012 |
3.76% |
0 |
0.00% |
0 |
0.00% |
22 |
0.02% |
crawl-15c.cuil.com |
|
|
Top 30 of 514 Total User Agents |
|
# |
Hits |
User Agent |
|
1 |
769064 |
38.93% |
msnbot/2.0b (+http://search.msn.com/msnbot.htm) |
2 |
507465 |
25.69% |
Mozilla/5 |
3 |
291530 |
14.76% |
Yahoo! Slurp/3 |
4 |
90211 |
4.57% |
Win16 |
5 |
70227 |
3.55% |
ftp |
6 |
47050 |
2.38% |
MJ12bot/v1 |
7 |
40713 |
2.06% |
MSIE 6 |
8 |
38553 |
1.95% |
DotBot/1 |
9 |
28591 |
1.45% |
Mail.Ru/1.0 |
10 |
22774 |
1.15% |
YahooS |
11 |
10740 |
0.54% |
Wget* |
12 |
7218 |
0.37% |
Exabot/3 |
13 |
6321 |
0.32% |
MSIE 5 |
14 |
6112 |
0.31% |
MSIE 7 |
15 |
5001 |
0.25% |
Ocelli/1.4 (http://www.globalspec.com/Ocelli) |
16 |
4707 |
0.24% |
MSIE 8 |
17 |
4409 |
0.22% |
Mozilla/4 |
18 |
2951 |
0.15% |
W3C-checklink/4.1 [4.14] libwww-perl/5.805 |
19 |
1891 |
0.10% |
Opera 9 |
20 |
915 |
0.05% |
GingerCrawler/1.0 (Language Assistant for Dyslexics; www.gingersoftware.com/crawler_agent.htm; support at ginger software dot |
21 |
759 |
0.04% |
Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/) |
22 |
647 |
0.03% |
TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html) |
23 |
634 |
0.03% |
MLBot (www.metadatalabs.com/mlbot) |
24 |
619 |
0.03% |
ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com) |
25 |
497 |
0.03% |
Baiduspider+(+http://www.baidu.com/search/spider.htm) |
26 |
448 |
0.02% |
Ask Jeeves/Teoma |
27 |
361 |
0.02% |
Safari5531.9 CFNetwork/438.14 Darwin/9.8.0 (i386) (iMac8%2C1) |
28 |
344 |
0.02% |
Java/1.4.2_13 |
29 |
342 |
0.02% |
lftp/3.7.15 |
30 |
314 |
0.02% |
Java/1.6.0_16 |
|