# 允许主流AI爬虫，但设置访问频率限制
User-agent: GPTBot
Allow: /
Crawl-delay: 5

User-agent: Google-Extended
Allow: /
Crawl-delay: 3

User-agent: *
Allow: /
Crawl-delay: 10