大网数据广告活动
网站运营与故障问答

Disallow directory at root only, and not elsewhere using robots.txt

· 52CE 我爱测

I need to exclude anything that contains /page/ but only at root: Disallowed: example.com/page/1 Allowed: example.com/category/page/1 How to safely write this in robots.txt ?

问题原文

原帖链接 · Robert Brax · CC BY-SA 4.0

I need to exclude anything that contains /page/ but only at root:

Disallowed: example.com/page/1

Allowed: example.com/category/page/1

How to safely write this in robots.txt?

已采纳解答

原帖链接 · Rounin · CC BY-SA 4.0

You almost have it.

This is the correct syntax:

User-agent: *
Disallow: /page

Explanation:

The Disallow: directive is relative-to-root.

So the very first / in that directive indicates the root folder of your website.

Consequently, the directive Disallow: /page will disallow:

/page/alpha/
/page/beta/
/page/gamma/

but it won't disallow:

/aleph/page/
/bet/page/
/gimel/page/

because the latter three paths don't begin with /page/.

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Webmasters Stack Exchange
适用范围
以原帖系统、软件版本与发布日期为准(2020-04-26)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 4.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。