问题原文
原帖链接 · arathra · CC BY-SA 4.0
I'm fairly new to robots.txt but have the basics. My first problem is that I'd like to disallow all the translated pages, except in the help file.
So I have this:
Disallow: /de/
But I want, at the same time, to ALLOW one subfolder of the translations, namely:
Allow: /de/help/
How can I show this in robots.txt?
已采纳解答
原帖链接 · Henry Visotski · CC BY-SA 4.0
You would have to explicitly allow the subfolder you want crawled, while disallowing the rest of the folder. So something like:
User-agent: *
Allow: /de/help/
Disallow: /de/
This will tell all search engines that you're allowing this one subfolder (and anything in it, including other subfolders - you're allowing a path, essentially) but otherwise disallowing everything else in this folder. Best to include the Allow directive above Disallow.
On the subject of robots.txt, more info from Google here.
摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。
