大网数据广告活动
网站运营与故障问答

How did Google crawler view my password-protected pages?

· 52CE 我爱测

I have a site that is login-blocked/password-protected where Googlebot crawling has worked for 1+years and suddenly stopped. I am trying to figure out how this could have happened. It is a large site with a large code base. I kno…

问题原文

原帖链接 · James L. · CC BY-SA 4.0

I have a site that is login-blocked/password-protected where Googlebot crawling has worked for 1+years and suddenly stopped.

I am trying to figure out how this could have happened. It is a large site with a large code base. I know about 1 year ago I verified that URL-live-test was properly rendering pages with all details as I was investigating a rendering issue in the public sister site and validated that this one was working properly.

As far as I know there was never any code to serve one version of the site to crawlers and another to users.

已采纳解答

原帖链接 · Rohit Gupta · CC BY-SA 4.0

If the pages were password protected, yet accessible to the crawlers, then you were probably serving different pages to the two. The timing tells you something. It happened when you confirmed that it was working and when started your sister site.

The primary suspect is that something has changed in your code (that did not get tested). You did a live test a year ago. Do it again. Prove to yourself that the crawlers are seeing a fully rendered page.

The second suspect is that the pages are regarded as a duplicate of the sister site. Explore the reports in Google Search Console to confirm the reason.

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Webmasters Stack Exchange
适用范围
以原帖系统、软件版本与发布日期为准(2023-02-24)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 4.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。