我的服务器弱，经常被蜘蛛爬死

闲聊无标签

 0  1435

Max 潜伏站长 2023-02-08 10:57:21

Lv：5级

都是些不正常的蜘蛛

百度一个也不来

User-agent: *
Disallow: /admin
Disallow: /user-*
Disallow: /serach-*
User-agent: SemrushBot
Disallow: /
User-agent: DotBot
Disallow: /
User-agent: MegaIndex.ru
Disallow: /
User-agent: MauiBot
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: BLEXBot
Disallow: /
User-agent: Barkrowler
Disallow: /
User-agent: Mail.RU_Bot
Disallow: /
User-agent: ZoominfoBot
Disallow: /
User-agent: SeznamBot
Disallow: /
User-agent: ExtLinksBot
Disallow: /
User-agent: aiHitBot
Disallow: /
User-agent: Researchscan
Disallow: /
User-agent: DnyzBot
Disallow: /
User-agent: spbot
Disallow: /

楼主签名：

回帖

回复列表

更多回复