2023年，看看别人专业的SEO网站的robots.txt是怎么写的？
如下：
User-agent: * Disallow: /user/*/* Disallow: /wp-admin/ Disallow: /checkout/ Disallow: /category/uncategorized* Disallow: /author/admin/page/* Disallow: /author/wuyou Disallow: /*?* Disallow: /?=* Disallow: /tugao Disallow: /author/* Disallow: /page/* Disallow: /50.html Disallow: /62.html Disallow: /63.html Disallow: /tougao Disallow: /wen Disallow: /account Disallow: /members Disallow: /user Disallow: /liuyan Disallow: /special/suanfa Disallow: /article/ Disallow: /newuser Disallow: /*/*/feed Disallow: /news/ Disallow: /okx Disallow: /bian User-agent:Bingbot Disallow: /*/*/feed Disallow: /*?* Disallow: /?=* Disallow: /category/uncategorized* Disallow: /author/admin/page/* Disallow: /author/wuyou Disallow: /*?* Disallow: /newuser Disallow: /tag/*/feed Disallow: /*/*/*.html/feed User-agent:Baiduspeder Disallow: /*/amp User-agent:Googlebot Allow: /*.js Allow: /*.css Allow: /*.jpg& Allow: /*.png& Disallow: /*/*/feed Disallow: /tougao Disallow: /wen Disallow: /account Disallow: /members Disallow: /user Disallow: /user/*/* Disallow: /wp-admin/ Disallow: /checkout/ Disallow: /category/uncategorized* Disallow: /author/admin/page/* Disallow: /author/wuyou Disallow: /*?* Disallow: /*/*/feed Disallow: /newuser 小伙伴们懂了吗？专业的SEO，百度 谷歌 必应 都要加代码！
原创文章，作者：SONIC SEO，如若转载，请注明出处：https://www.seo388.com/2023-robots-txt/
微信扫一扫 
支付宝扫一扫 
