大网数据广告活动
网站运营与故障问答

Google Search Console is making up URLs which don't exist in my Sitemap and then complains that these pages have error

· 52CE 我爱测

I am working on an e-commerce website. I used to have a sitemap with category Ids, something like: <url> <loc>https://my-domain.com/home/browse/2/45/139</loc> <changefreq>daily</changefreq> </url> <url> <loc>https://my-domain.com…

问题原文

原帖链接 · Hooman Bahreini · CC BY-SA 4.0

I am working on an e-commerce website. I used to have a sitemap with category Ids, something like:

<url>
    <loc>https://my-domain.com/home/browse/2/45/139</loc>
    <changefreq>daily</changefreq>
</url>
<url>
    <loc>https://my-domain.com/home/browse/5/60/160</loc>
    <changefreq>daily</changefreq>
</url>

In the above site map 2/45/139 represents a category:

fashion/women/tops-and-shirts

and 5/60/160 represents a different category:

sports/team-sports/football

Around 3 months ago, I decided to change my website's sitemap and use the category names instead of category Ids, so the new site map looks like this:

<url>
    <loc>https://my-domain.com/home/browse/fashion/women/tops-and-shirts</loc>
    <changefreq>daily</changefreq>
</url>
<url>
    <loc>https://my-domain.com/home/browse/sports/team-sports/football</loc>
    <changefreq>daily</changefreq>
</url>

I have submitted the new sitemap to Google months ago and everything is working... but every time I go to Google Search Console, I see Google is showing me errors about pages with old sitemap structure... or Google is adding random parameters to the url, e.g. page=59 and then complains that this page has error... it returns error because it does not exist!

How can I resolve these errors?

已采纳解答

原帖链接 · closetnoc · CC BY-SA 4.0

You have a misconception of what a sitemap is.

The sitemap is used to audit the site crawl by the search engine bot. The sitemap and crawling a site are two different and independent things. Google will continue to crawl your site independently of any sitemap. The sitemap will be used to audit/see if Google is able to properly crawl your site. For example, if pages are found in your sitemap and Google has not seen the page, Google may add the page to the fetch queue to be included.

The converse is not true. If a page is not found in the sitemap, Google will not remove it from it's index. Why? Because Google found it by crawling the site.

What you seem to believe is the sitemap is the be all - end all authority that Google uses to know what pages exist on any particular site. This is not the case. The crawl is. The sitemap only helps Google know whether they can properly crawl your site and, if not, what pages Google are missing that should be added to the fetch queue.

Your expectation, that Google will no longer try to access pages because these pages are no longer in your sitemap, is incorrect. Sitemaps are cached and only checked periodically. Why? Because it is an audit process.

You do have a real problem you need to solve.

You are returning a 500 error for pages that are not being found. This is bad. Your site should be returning a 404 Not Found error. The 500 error is a system error and Google will treat the condition as temporary. If your site returned a 404 error, Google will still continue to try the page for a number of tries over a period of time until it decides the page no longer exists. If at all possible, you want to issue a 410 Removed error for pages that you have removed. If this is too much work or not possible, the 404 will amount to the same thing over time.

You do need to fix your 500 error.

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Webmasters Stack Exchange
适用范围
以原帖系统、软件版本与发布日期为准(2019-10-24)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 4.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。