2023年,看看别人专业的SEO网站的robots.txt是怎么写的?
如下:
User-agent: * Disallow: /user/*/* Disallow: /wp-admin/ Disallow: /checkout/ Disallow: /category/uncategorized* Disallow: /author/admin/page/* Disallow: /author/wuyou Disallow: /*?* Disallow: /?=* Disallow: /tugao Disallow: /author/* Disallow: /page/* Disallow: /50.html Disallow: /62.html Disallow: /63.html Disallow: /tougao Disallow: /wen Disallow: /account Disallow: /members Disallow: /user Disallow: /liuyan Disallow: /special/suanfa Disallow: /article/ Disallow: /newuser Disallow: /*/*/feed Disallow: /news/ Disallow: /okx Disallow: /bian User-agent:Bingbot Disallow: /*/*/feed Disallow: /*?* Disallow: /?=* Disallow: /category/uncategorized* Disallow: /author/admin/page/* Disallow: /author/wuyou Disallow: /*?* Disallow: /newuser Disallow: /tag/*/feed Disallow: /*/*/*.html/feed User-agent:Baiduspeder Disallow: /*/amp User-agent:Googlebot Allow: /*.js Allow: /*.css Allow: /*.jpg& Allow: /*.png& Disallow: /*/*/feed Disallow: /tougao Disallow: /wen Disallow: /account Disallow: /members Disallow: /user Disallow: /user/*/* Disallow: /wp-admin/ Disallow: /checkout/ Disallow: /category/uncategorized* Disallow: /author/admin/page/* Disallow: /author/wuyou Disallow: /*?* Disallow: /*/*/feed Disallow: /newuser 小伙伴们懂了吗?专业的SEO,百度 谷歌 必应 都要加代码!

原创文章,作者:SONIC SEO,如若转载,请注明出处:https://www.seo388.com/2023-robots-txt/