全球主机交流论坛

标题: 屏蔽垃圾蜘蛛 [打印本页]

---

作者: 轻功水上漂    时间: 2024-6-2 17:47
标题: 屏蔽垃圾蜘蛛
在网上找了下，这个比较全了吧？

(www.seokicks.de|YYSpider|Mattermost|Discord|CCBot|RepoLookoutBot|FBexternalhit|serpstatbot|Pinterestbot|SurdotlyBot|DataForSeoBot|DigExt|HttpClient|MJ12bot|heritrix|EasouSpider|Ezooms|FlightDeckReports|Linguee Bot|Web-Crawler|WellKnownBot|Yellowbrandprotectionbot|ev-crawler|NE Crawler|Facebot|GrapeshotCrawler|SemrushBot|DotBot|MegaIndex.ru|MauiBot|AhrefsBot|MJ12bot|BLEXBot|HubSpot Crawler|CriteoBot|Web-Crawler|web-crawlers|DataForSeoBot|YaK|Mail.RU_Bot|Barkrowler|crawler|SEOkicks-Robot|vxiaotou-spider|telegram|dingtalk|推特bot|DuckDuckGo|applebot|webprosbot|AwarioBot|Amazonbot|AmazonAdBot|YouBot/)


各位大佬还有添加的吗？

---

作者: jekyll    时间: 2024-6-2 18:54
DuckDuckGo

---

作者: youth    时间: 2024-6-2 18:59
Ahrefs Bot

---

作者: 轻功水上漂    时间: 2024-6-2 19:05
添加了

---

欢迎光临 全球主机交流论坛 (https://fd.vvwvv.eu.org/)

Powered by Discuz! X3.4