爬虫识别支持 IPv6 地址访问 了解详情
AI2 机器人会探索特定领域以查找网页内容。这些网页内容用于训练开放语言模型。
Ai2Bot-Dolma 遵守 robots.txt 协议,如果需要屏蔽 Ai2Bot-Dolma 爬虫,写法如下:
User-agent: AI2Bot
Disallow: /
# | IP 地址 | Hostname | 国家代码 | 旗帜 |
---|---|---|---|---|
1 | 67.225.188.31 | US |
|
|
2 | 67.227.250.168 | US |
|
|
3 | 45.77.164.21 | 45.77.164.21.vultrusercontent.com | US |
|
4 | 207.148.6.129 | 207.148.6.129.vultrusercontent.com | US |
|
5 | 50.28.40.163 | US |
|
|
6 | 75.101.239.212 | ec2-75-101-239-212.compute-1.amazonaws.com | US |
|
7 | 52.54.76.131 | ec2-52-54-76-131.compute-1.amazonaws.com | US |
|
8 | 45.76.6.132 | 45.76.6.132.vultrusercontent.com | US |
|
9 | 104.238.140.158 | 104.238.140.158.vultrusercontent.com | US |
|
10 | 72.52.196.79 | US |
|