Robots |
1 | 202 | 17.57 | YandexBot/3.0 |
2 | 192 | 16.70 | MJ12bot/v1.4.7 |
3 | 155 | 13.48 | compatible Mozilla/5.0 |
4 | 86 | 7.48 | linkdexbot/2.0 |
5 | 85 | 7.39 | Googlebot/2.1 |
6 | 83 | 7.22 | bingbot/2.0 |
7 | 66 | 5.74 | MJ12bot/v1.4.8 |
8 | 53 | 4.61 | SemrushBot/1.2~bl |
9 | 47 | 4.09 | DotBot/1.1 |
10 | 40 | 3.48 | AhrefsBot/5.2 |
11 | 39 | 3.39 | Baiduspider/2.0 |
12 | 20 | 1.74 | SeznamBot/3.2 |
13 | 11 | 0.96 | - |
14 | 10 | 0.87 | Firefox/2.0.0.6 |
15 | 8 | 0.70 | spbot/5.0.3 |
16 | 8 | 0.70 | PiplBot (+http://www.pipl.com/bot/) |
17 | 7 | 0.61 | Sogou web spider/4.0(+http://www.sogou.c... |
18 | 6 | 0.52 | Yahoo! Slurp |
19 | 6 | 0.52 | SafeDNSBot (https://www.safedns.com/sear... |
20 | 6 | 0.52 | SiteExplorer/1.1b |
21 | 4 | 0.35 | Python-urllib/1.17 |
22 | 4 | 0.35 | MBCrawler/1.0 (https://monitorbacklinks.... |
23 | 2 | 0.17 | null |
24 | 2 | 0.17 | Linux x86_64 |
25 | 2 | 0.17 | MSIE 5.01 |
26 | 2 | 0.17 | Go-http-client/1.1 |
27 | 2 | 0.17 | GrapeshotCrawler/2.0 |
28 | 2 | 0.17 | Quick-Crawler (+https://www.scrapinghub.... |