|
Top 30 of 32919 Total Sites |
|
# |
Hits |
Files |
kB F |
kB In |
kB Out |
Visits |
Hostname |
|
1 |
172175 |
9.69% |
164322 |
11.58% |
13432898 |
13.41% |
0 |
0.00% |
0 |
0.00% |
1 |
0.00% |
b3091082.crawl.yahoo.net |
2 |
80647 |
4.54% |
79567 |
5.61% |
3626151 |
3.62% |
0 |
0.00% |
0 |
0.00% |
235 |
0.20% |
crawl6.dotnetdotcom.org |
3 |
79857 |
4.50% |
77331 |
5.45% |
5480500 |
5.47% |
0 |
0.00% |
0 |
0.00% |
2 |
0.00% |
b3091211.crawl.yahoo.net |
4 |
50365 |
2.84% |
48817 |
3.44% |
3722952 |
3.72% |
0 |
0.00% |
0 |
0.00% |
2 |
0.00% |
b3091335.crawl.yahoo.net |
5 |
31878 |
1.79% |
31834 |
2.24% |
6729507 |
6.72% |
0 |
0.00% |
0 |
0.00% |
337 |
0.28% |
crawl-17c.cuil.com |
6 |
31716 |
1.79% |
11266 |
0.79% |
478838 |
0.48% |
0 |
0.00% |
0 |
0.00% |
54 |
0.05% |
spider13.yandex.ru |
7 |
21799 |
1.23% |
21447 |
1.51% |
895891 |
0.89% |
0 |
0.00% |
0 |
0.00% |
120 |
0.10% |
crawl8.dotnetdotcom.org |
8 |
21402 |
1.21% |
20099 |
1.42% |
1562525 |
1.56% |
0 |
0.00% |
0 |
0.00% |
1 |
0.00% |
b3091031.crawl.yahoo.net |
9 |
19737 |
1.11% |
19711 |
1.39% |
2374462 |
2.37% |
0 |
0.00% |
0 |
0.00% |
57 |
0.05% |
crawl-10c.cuil.com |
10 |
19172 |
1.08% |
19144 |
1.35% |
4398004 |
4.39% |
0 |
0.00% |
0 |
0.00% |
110 |
0.09% |
crawl-15c.cuil.com |
11 |
17728 |
1.00% |
17709 |
1.25% |
381059 |
0.38% |
0 |
0.00% |
0 |
0.00% |
67 |
0.06% |
natcrawlbloc05.net.m1.fti.net |
12 |
17615 |
0.99% |
17593 |
1.24% |
610725 |
0.61% |
0 |
0.00% |
0 |
0.00% |
59 |
0.05% |
natcrawlbloc05-35.net.m1.fti.net |
13 |
17613 |
0.99% |
17597 |
1.24% |
923747 |
0.92% |
0 |
0.00% |
0 |
0.00% |
46 |
0.04% |
natcrawlbloc05-36.net.m1.fti.net |
14 |
17213 |
0.97% |
17196 |
1.21% |
885557 |
0.88% |
0 |
0.00% |
0 |
0.00% |
48 |
0.04% |
natcrawlbloc05-37.net.m1.fti.net |
15 |
17035 |
0.96% |
17009 |
1.20% |
690504 |
0.69% |
0 |
0.00% |
0 |
0.00% |
52 |
0.04% |
natcrawlbloc04-15.net.s1.fti.net |
16 |
17010 |
0.96% |
16993 |
1.20% |
319583 |
0.32% |
0 |
0.00% |
0 |
0.00% |
66 |
0.06% |
natcrawlbloc04-16.net.s1.fti.net |
17 |
16616 |
0.94% |
16588 |
1.17% |
773218 |
0.77% |
0 |
0.00% |
0 |
0.00% |
42 |
0.04% |
natcrawlbloc03-34.net.m1.fti.net |
18 |
16564 |
0.93% |
16548 |
1.17% |
782541 |
0.78% |
0 |
0.00% |
0 |
0.00% |
46 |
0.04% |
natcrawlbloc02-175.net.b1.fti.net |
19 |
16501 |
0.93% |
16482 |
1.16% |
757139 |
0.76% |
0 |
0.00% |
0 |
0.00% |
37 |
0.03% |
natcrawlbloc01.net.m1.fti.net |
20 |
16481 |
0.93% |
16473 |
1.16% |
801421 |
0.80% |
0 |
0.00% |
0 |
0.00% |
43 |
0.04% |
natcrawlbloc04-14.net.s1.fti.net |
21 |
16382 |
0.92% |
16371 |
1.15% |
607474 |
0.61% |
0 |
0.00% |
0 |
0.00% |
36 |
0.03% |
natcrawlbloc01-29.net.m1.fti.net |
22 |
16358 |
0.92% |
16334 |
1.15% |
709025 |
0.71% |
0 |
0.00% |
0 |
0.00% |
39 |
0.03% |
natcrawlbloc03.net.m1.fti.net |
23 |
16275 |
0.92% |
16257 |
1.15% |
807518 |
0.81% |
0 |
0.00% |
0 |
0.00% |
40 |
0.03% |
natcrawlbloc02-176.net.b1.fti.net |
24 |
16100 |
0.91% |
16071 |
1.13% |
740425 |
0.74% |
0 |
0.00% |
0 |
0.00% |
45 |
0.04% |
natcrawlbloc03-33.net.m1.fti.net |
25 |
16095 |
0.91% |
16087 |
1.13% |
698657 |
0.70% |
0 |
0.00% |
0 |
0.00% |
45 |
0.04% |
natcrawlbloc02-174.net.b1.fti.net |
26 |
16019 |
0.90% |
16006 |
1.13% |
774164 |
0.77% |
0 |
0.00% |
0 |
0.00% |
42 |
0.04% |
natcrawlbloc02-173.net.b1.fti.net |
27 |
15760 |
0.89% |
15744 |
1.11% |
728641 |
0.73% |
0 |
0.00% |
0 |
0.00% |
39 |
0.03% |
natcrawlbloc01-30.net.m1.fti.net |
28 |
15649 |
0.88% |
15625 |
1.10% |
725589 |
0.72% |
0 |
0.00% |
0 |
0.00% |
40 |
0.03% |
natcrawlbloc01-31.net.m1.fti.net |
29 |
15450 |
0.87% |
15431 |
1.09% |
722230 |
0.72% |
0 |
0.00% |
0 |
0.00% |
37 |
0.03% |
natcrawlbloc04-13.net.s1.fti.net |
30 |
14787 |
0.83% |
14777 |
1.04% |
692071 |
0.69% |
0 |
0.00% |
0 |
0.00% |
27 |
0.02% |
natcrawlbloc03-32.net.m1.fti.net |
|
|
Top 30 of 595 Total User Agents |
|
# |
Hits |
User Agent |
|
1 |
629597 |
35.45% |
msnbot/2.0b (+http://search.msn.com/msnbot.htm) |
2 |
436384 |
24.57% |
Mozilla/5 |
3 |
341760 |
19.24% |
Yahoo! Slurp/3 |
4 |
116772 |
6.58% |
DotBot/1 |
5 |
84428 |
4.75% |
MJ12bot/v1 |
6 |
42966 |
2.42% |
ftp |
7 |
36124 |
2.03% |
MSIE 6 |
8 |
31967 |
1.80% |
Win16 |
9 |
7878 |
0.44% |
MSIE 5 |
10 |
6822 |
0.38% |
MSIE 7 |
11 |
5692 |
0.32% |
MSIE 8 |
12 |
4599 |
0.26% |
Exabot/3 |
13 |
4072 |
0.23% |
Mail.Ru/1.0 |
14 |
2975 |
0.17% |
W3C-checklink/4.1 [4.14] libwww-perl/5.805 |
15 |
2440 |
0.14% |
Opera 9 |
16 |
1920 |
0.11% |
Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/) |
17 |
894 |
0.05% |
Baiduspider+(+http://www.baidu.com/search/spider.htm) |
18 |
627 |
0.04% |
Ask Jeeves/Teoma |
19 |
616 |
0.03% |
MLBot (www.metadatalabs.com/mlbot) |
20 |
563 |
0.03% |
GingerCrawler/1.0 (Language Assistant for Dyslexics; www.gingersoftware.com/crawler_agent.htm; support at ginger software dot |
21 |
517 |
0.03% |
msnbot-media/1.1 (+http://search.msn.com/msnbot.htm) |
22 |
449 |
0.03% |
ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com) |
23 |
407 |
0.02% |
Win32 |
24 |
390 |
0.02% |
Safari/6531.21.10 CFNetwork/454.5 Darwin/10.2.0 (i386) (Macmini3%2C1) |
25 |
388 |
0.02% |
Opera 8 |
26 |
364 |
0.02% |
Microsoft URL Control - 6.01.9782 |
27 |
350 |
0.02% |
lftp/3.7.15 |
28 |
329 |
0.02% |
Java/1.6.0_17 |
29 |
328 |
0.02% |
Wget* |
30 |
315 |
0.02% |
TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html) |
|