大网数据广告活动
网站运营与故障问答

301 and no-index tag don't work

· 52CE 我爱测

Almost 3 months ago I've put no-index tag to about 3,000 pages on my website and 301 redirect (which is permanent redirect) for almost 15,000 pages. (The all site is about 50,000 pages) And yet as for today, all of these pages ar…

问题原文

原帖链接 · YardenST · CC BY-SA 3.0

Almost 3 months ago I've put no-index tag to about 3,000 pages on my website and 301 redirect (which is permanent redirect) for almost 15,000 pages. (The all site is about 50,000 pages)

And yet as for today, all of these pages are still appearing in google index.

I've also updated the sitemap.

What can cause it? any advice?


example of no-index page: http://www.carz.co.il/review/8186

example of 301 redirect page:http://www.carz.co.il/gen/491/overview/2010/

All other pages are exactly the same (same meta tags, HTTP response etc..)

according to Google webmaster tools there are about 4000 pages crawled per day.

社区高分解答

原帖链接 · Mike -- No longer here · CC BY-SA 3.0

I'm going to have to say google is too slow.

Your best bet is to go into Google search console, access your domain within it, then select the gear icon and then site settings, then for crawl rate, select "Limit Google's maximum crawl rate" and select the biggest crawl value by moving the slider all the way to the right. Then google will make up to 2+ requests per second. If you're lucky it might even allow you to choose 10 requests per second.

When you allow Google to make maximum requests, then it will scan your pages faster and find the no-index tags much faster than before and the waiting time for results will likely be lower.

In either case, I suggest waiting about a day for results. Here's the math that explains it.

  3000 ... You applied a no-index tag to 3000 pages.
+15000 ... You applied a 301 redirect to 15000 pages.
------
 18000 ... Total modified pages
 / 0.2 ... (divide by google's default scan rate of 0.2 pages per second)
------
 72000 ... 72,000 seconds waiting time which is 1,200 minutes or 20 hours.

Now if you crank up the setting to 10 requests per second and google does 10 requests per second, then here's your new math for the waiting time for results:

  3000 ... You applied a no-index tag to 3000 pages.
+15000 ... You applied a 301 redirect to 15000 pages.
------
 18000 ... Total modified pages
 /  10 ... (10 requests per second)
------
  1800 ... 1,800 seconds waiting time which is only 30 minutes.

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Webmasters Stack Exchange
适用范围
以原帖系统、软件版本与发布日期为准(2016-05-08)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 3.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。