大网数据广告活动
网站运营与故障问答

Getting Robots.txt Not Found 404 Error on Google Search Console

· 52CE 我爱测

I have created robots.txt in my root directory and when I navigate to my website address like https://example.ca/robots.txt I am able to see the rules User-agent:* Disallow: /captcha/ Disallow: /mailing/ Disallow: /assets/ Allow:…

问题原文

原帖链接 · Behseini · CC BY-SA 4.0

I have created robots.txt in my root directory and when I navigate to my website address like https://example.ca/robots.txt I am able to see the rules

User-agent:*
Disallow: /captcha/
Disallow: /mailing/
Disallow: /assets/

Allow: /

Sitemap: https://domain.ca/sitemap.xml
Sitemap: http://domain.ca/sitemap.xml

But when I want to test the file in Google robots.txt Tester

I am getting this error

I am however able to test the file at bottom of the page or see the live robots.txt

but still getting 404 error when entering to the page!

已采纳解答

原帖链接 · Quitxotic · CC BY-SA 4.0

Can take up to 24 hours, the robot tester seems to a bit flakey after just putting your file up. Good thing at least is that you're not getting a BLOCKED response from the tester.

https://developers.google.com/search/docs/advanced/robots/submit-updated-robots-txt

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Webmasters Stack Exchange
适用范围
以原帖系统、软件版本与发布日期为准(2022-05-11)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 4.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。