A little script that crawls the web. It only reads HTML pages and ignore any other format. It then follows the links and store the "Server" field.
So far, the script crawled 15256817 sites (based on "Host" field, not unique IPs). My database is of course much smaller than Netcraft.
Sorry for the inconvenience. Please note that this script does not do anything intrusive or dangerous. As it crawls the web in "width first", it should not come back to your site before a long time. Maybe never. If this really annoys you, drop me an e-mail (in French or in English) and I'll add your IPs or sites to a blacklist.
Here are the ten most common servers, all versions included (e.g. IIS is IIS 3 to 6, Apache is Apache 1 or 2...)
| Web server | % |
| Apache | 72.43 |
| Microsoft-IIS | 19.16 |
| Oversee | 1.38 |
| GFE | 1.06 |
| nginx | 0.86 |
| lighttpd | 0.47 |
| Sun-ONE-Web-Server | 0.46 |
| Tipic | 0.43 |
| Zeus | 0.28 |
| NOYB | 0.21 |
Here are the fifty most common "Server" fields
| Server field | % |
| Apache | 25.70 |
| Microsoft-IIS/6.0 | 14.58 |
| Microsoft-IIS/5.0 | 4.31 |
| Apache/2.0.52 (Red Hat) | 3.22 |
| Apache/1.3.33 (Debian GNU/Linux) PHP/4.3.10-18 | 1.72 |
| Apache/1.3.33 (Unix) | 1.40 |
| Oversee Webserver v1.3.18 | 1.36 |
| Apache/2.0.46 (Red Hat) | 1.27 |
| GFE/1.3 | 1.06 |
| Apache/2.0.52 (CentOS) | 0.91 |
| Apache/1.3.37 (Unix) | 0.77 |
| Apache/2.0.51 (Fedora) | 0.71 |
| Apache/2.0.40 (Red Hat Linux) | 0.67 |
| Apache/2.0.53 (Unix) PHP/5.0.4 | 0.58 |
| Apache/1.3.37 (Unix) mod_ssl/2.8.28 OpenSSL/0.9.7d PHP/4.4.4 FrontPage/5.0.2.2510 | 0.55 |
| Apache/2.0.54 (Fedora) | 0.54 |
| Apache/2.0.54 (Debian GNU/Linux) DAV/2 SVN/1.1.4 mod_jk2/2.0.4 PHP/4.3.10-16 mod_perl/1.999.21 Perl/v5.8.4 | 0.53 |
| Apache/1.3.37 (Unix) mod_auth_passthrough/1.8 mod_log_bytes/1.2 mod_bwlimited/1.4 FrontPage/5.0.2.2635.SR1.2 mod_ssl/2.8.28 OpenSSL/0.9.7a PHP-CGI/0.1b | 0.48 |
| Apache/1.3.37 (Unix) mod_auth_passthrough/1.8 mod_log_bytes/1.2 mod_bwlimited/1.4 PHP/4.4.4 FrontPage/5.0.2.2635.SR1.2 mod_ssl/2.8.28 OpenSSL/0.9.7a | 0.44 |
| Tipic Web Server ;-) 0.9.c | 0.43 |
| Apache/1.3.33 (Unix) PHP/4.3.10 | 0.41 |
| Apache/1.3.37 (Unix) PHP/4.4.4 | 0.40 |
| Apache/1.3.31 (Unix) | 0.36 |
| Apache/1.3.37 | 0.33 |
| Apache/2.0.53 (Fedora) | 0.32 |
| Apache-Coyote/1.1 | 0.29 |
| Apache/1.3.33 (Debian GNU/Linux) PHP/4.4.0-0.dotdeb.0 | 0.27 |
| Apache/1.3.37 (Unix) mod_throttle/3.1.2 DAV/1.0.3 mod_fastcgi/2.4.2 mod_gzip/1.3.26.1a PHP/4.4.4 mod_ssl/2.8.22 OpenSSL/0.9.7e | 0.27 |
| Apache/1.3.37 (Unix) mod_fastcgi/2.4.2 mod_auth_passthrough/1.8 mod_log_bytes/1.2 mod_bwlimited/1.4 FrontPage/5.0.2.2635.SR1.2 mod_ssl/2.8.28 OpenSSL/0.9.7a PHP-CGI/0.1b | 0.27 |
| Apache/1.3.34 (Unix) | 0.26 |
| Sun-ONE-Web-Server/6.1 | 0.24 |
| Apache/1.3.37 (Unix) mod_fastcgi/2.4.2 mod_auth_passthrough/1.8 mod_log_bytes/1.2 mod_bwlimited/1.4 FrontPage/5.0.2.2635.SR1.2 mod_ssl/2.8.28 OpenSSL/0.9.7a | 0.24 |
| Apache/1.3.33 (Unix) PHP/4.3.11 | 0.23 |
| Apache/1.3.34 (Unix) PHP/4.4.2 | 0.23 |
| Apache/2.2.2 (Fedora) | 0.22 |
| nginx/0.4.13 | 0.21 |
| Apache/2.0.53 (Linux/SUSE) | 0.21 |
| NOYB | 0.21 |
| Apache/1.3.31 (Unix) PHP/4.3.8 | 0.20 |
| Apache/2.0.50 (Fedora) | 0.20 |
| Apache/1.3.33 (Debian GNU/Linux) PHP/4.3.10-16 | 0.20 |
| lighttpd/1.4.13 | 0.20 |
| LiteSpeed | 0.18 |
| Apache/1.3.37 (Unix) PHP/4.4.4 mod_throttle/3.1.2 mod_gzip/1.3.19.1a mod_fastcgi/2.4.2 mod_ssl/2.8.28 OpenSSL/0.9.8d | 0.18 |
| Apache/2.0.54 (Unix) | 0.18 |
| Microsoft-IIS/4.0 | 0.17 |
| Apache/1.3.33 (Unix) mod_auth_passthrough/1.8 mod_log_bytes/1.2 mod_bwlimited/1.4 PHP/4.3.11 FrontPage/5.0.2.2635 mod_ssl/2.8.22 OpenSSL/0.9.7a | 0.16 |
| Apache/2.0.59 (CentOS) | 0.16 |
| Apache/2.0.54 | 0.16 |
| Apache/1.3.31 (Unix) mod_python/2.7.10 Python/2.2.2 mod_webapp/1.2.0-dev mod_perl/1.29 mod_throttle/3.1.2 PHP/4.3.8 FrontPage/5.0.2.2510 mod_ssl/2.8.18 OpenSSL/0.9.7d | 0.16 |