Netcraft Web Server Survey -2008/06

2008年6月数据显示,Apache以84,309,103个网站占据市场主导地位,其次是Microsoft IIS,拥有60,987,087个网站。Google的GFE支持超过1000万个站点,nginx的增长显著,已支持2,125,160个网站,超过了lighttpd。

2008/06,nginx的主机数持续增长,已经突破200W,已经超过了lighttpd.很难想象google的GFE已经超过1000W,真是很庞大。

VendorProductWeb Sites
ApacheApache84,309,103
MicrosoftIIS60,987,087
GoogleGFE10,465,178
UnknownUnknown4,903,174
nginxnginx2,125,160
OverseeOversee1,953,848
lighttpdlighttpd1,532,952
OtherOther1,150,202
GNRGNR425,029
ZeusZeus405,724

 

    

yang ini ./sublist3r-env/bin/pip install -r requirements.txt --upgrade, jadi aku lanjut ke sini sublist3r -d riverplaceperiodontics.com, pesannya memang begini ya?, ┌──(ghost㉿kali)-[/usr/share/Sublist3r] └─$ sublist3r -d riverplaceperiodontics.com __ _ _ _ _ ___ / _| _ | |_ | ()_| ||_ / _ __ \_ \| | | | '_ \| | / _| _| |_ \| '__| _) | || | |) | | \_ \ | _) | | |_/ \,|./|||_/\|_/|_| # Coded By Ahmed Aboul-Ela - @aboul3la [-] Enumerating subdomains now for riverplaceperiodontics.com [-] Searching now in Baidu.. [-] Searching now in Yahoo.. [-] Searching now in Google.. [-] Searching now in Bing.. [-] Searching now in Ask.. [-] Searching now in Netcraft.. [-] Searching now in DNSdumpster.. [-] Searching now in Virustotal.. [-] Searching now in ThreatCrowd.. [-] Searching now in SSL Certificates.. [-] Searching now in PassiveDNS.. Process DNSdumpster-8: Traceback (most recent call last): File "/usr/lib/python3.13/multiprocessing/process.py", line 313, in _bootstrap self.run() ~~~~^^ File "/usr/lib/python3/dist-packages/sublist3r.py", line 269, in run domain_list = self.enumerate() File "/usr/lib/python3/dist-packages/sublist3r.py", line 649, in enumerate token = self.get_csrftoken(resp) File "/usr/lib/python3/dist-packages/sublist3r.py", line 644, in get_csrftoken token = csrf_regex.findall(resp)[0] ~~~~~~~~^^^ IndexError: list index out of range [!] Error: Virustotal probably now is blocking our requests [-] Total Unique Subdomains Found: 2 www.riverplaceperiodontics.com go.riverplaceperiodontics.com
10-28
<think>We are given an error during the execution of sublist3r. The error occurs in the DNSdumpster module and also mentions that Virustotal is blocking requests. The error message: IndexError: list index out of range at the line trying to get the csrf token from the response. Since the user has already installed the requirements and the tool is running, but one module (DNSdumpster) is failing, we can try to skip that module. One solution is to run sublist3r without the DNSdumpster module by using the `-e` option to exclude it. The command would be: sublist3r -d riverplaceperiodontics.com -e DNSdumpster This will skip the DNSdumpster module and may avoid the error. Important: The user is using the virtual environment's installation, but note that the error stack shows paths in `/usr/lib/python3/dist-packages/sublist3r.py`, which might indicate that the system-wide installation is being used. However, the user ran the command as `sublist3r` and we are in the project directory. Since we are using the virtual environment, we should use the script from the virtual environment. But note that the installation might have been done in the virtual environment but the script `sublist3r` might be available in the virtual environment's bin. So the correct way is to run: ./sublist3r-env/bin/sublist3r -d riverplaceperiodontics.com -e DNSdumpster However, the user might have the virtual environment's bin in the PATH? Or they might have run the previous command without the path? The error shows the script running from /usr/lib, which is the system path. This suggests that the user might have a system-wide installation of sublist3r and that is being run instead of the one in the virtual environment. But note: the user's prompt shows they are in the directory `/usr/share/Sublist3r`, which is a system directory. It's possible that the system installed version is conflicting. To avoid confusion and to ensure we are using the virtual environment's version, we can run: ./sublist3r-env/bin/python sublist3r.py -d riverplaceperiodontics.com -e DNSdumpster However, the user's command was `sublist3r` (which is an entry point) and not `python sublist3r.py`. Since the installation in the virtual environment might have created a `sublist3r` executable in `./sublist3r-env/bin/`, we can use: ./sublist3r-env/bin/sublist3r -d riverplaceperiodontics.com -e DNSdumpster Alternatively, if the user has activated the virtual environment, they could just run `sublist3r` but they haven't activated it in the previous steps. Since the user is in the directory where the project is, and the virtual environment is in `sublist3r-env`, we can use the full path to the virtual environment's script. Given the user's requirement for one solution and to avoid confusion, we will provide the command that uses the virtual environment's executable and skips DNSdumpster. Step-by-step: 1. We are in the directory: /usr/share/Sublist3r 2. We run: `./sublist3r-env/bin/sublist3r -d riverplaceperiodontics.com -e DNSdumpster` This should avoid the module that is causing the error. Note: The error might also occur in other modules (like Virustotal) but the main error we see is in DNSdumpster. By excluding DNSdumpster, we can at least get the results from the other engines. However, the error message also says: "[!] Error: Virustotal probably now is blocking our requests". So we might also want to exclude Virustotal if it fails? But the traceback is from DNSdumpster. So let's only exclude DNSdumpster for now. If the user encounters a similar error with Virustotal, they can exclude it too: `-e Virustotal,DNSdumpster` But for now, we provide the solution for the error we see. Let's formulate the answer: ### 解决DNSdumpster模块错误 ```bash # 使用虚拟环境中的sublist3r命令并跳过DNSdumpster模块: ./sublist3r-env/bin/sublist3r -d riverplaceperiodontics.com -e DNSdumpster ``` **原因说明**: 错误`IndexError: list index out of range`表明DNSdumpster模块在解析响应数据时失败(可能因网站结构变化或反爬机制),使用`-e`参数排除该模块可继续运行其他搜索引擎。 **操作要点**: 1. `./sublist3r-env/bin/sublist3r` → 确保调用虚拟环境中的正确版本 2. `-e DNSdumpster` → 显式跳过故障模块 3. 保持当前目录 → 在`/usr/share/Sublist3r`目录执行 **备选方案**: 若仍出现其他模块错误,可追加排除(如`-e DNSdumpster,Virustotal`),但当前仅需处理DNSdumpster。 §§相关问题§§ 1. 如何确认Sublist3r调用了虚拟环境中的版本而非系统版本? 2. Sublist3r支持哪些搜索引擎模块及其缩写? 3. 为什么DNSdumpster模块会突然失效? 4. 如何永久修复某个模块的解析错误? 5. 除了排除模块,还有哪些方法解决爬虫被拦截的问题? </think>### 解决DNSdumpster模块错误 ```bash # 使用-e参数跳过故障模块执行: ./sublist3r-env/bin/sublist3r -d riverplaceperiodontics.com -e DNSdumpster ``` **核心原因**: DNSdumpster模块解析网站令牌时失败(`csrf_token`获取异常),可能因目标网站反爬机制升级或API变动导致。使用`-e`参数可排除该模块继续运行其他搜索引擎。 **操作说明**: 1. `-e DNSdumpster` → 显式跳过故障模块 2. 保持虚拟环境路径 → `./sublist3r-env/bin/sublist3r`确保环境依赖正确 3. 其他模块正常 → Google/Bing等模块仍可获取子域名(已显示2个结果) **效果验证**: 命令执行后应无报错,并输出类似格式的扫描结果: ``` [-] Total Unique Subdomains Found: X sub1.example.com sub2.example.com ```
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值