问题原文
原帖链接 · AGamePlayer · CC BY-SA 3.0
Say I have a domain example.com
And it has a subdomain sub.example.com
And another subdomain internal.example.com
I have some links on example.com and sub.example.com for Google to crawl. But I don't want Google to fetch anything on internal.example.com
What should I do in this case?
已采纳解答
原帖链接 · HBalyan · CC BY-SA 3.0
Here is link to Google's documentation about the validity of URLs robots.txt as per its location.
Do you have any links from the main domain or the other sub-domain to internal.domain.com?
If not then Google, in general, would not see your sub-domain on its own. I would still recommend to block it via the robots.txt file if they have never been exposed in past. If, by any chance URLs from internal.example.com have been exposed to Google then use Robots-Meta Tag to declare these pages non-indexable and no-follow.
摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。
