大网数据广告活动
网站运营与故障问答

Googlebots request types

· 52CE 我爱测

Does Google's bot send HEAD requests as well as GET requests? I wondering about this because I'm running a Tornado application that does not support HEAD request and I have a lot of 404 errors in Google Search Console. To verify …

问题原文

原帖链接 · a_b · CC BY-SA 3.0

Does Google's bot send HEAD requests as well as GET requests?

I wondering about this because I'm running a Tornado application that does not support HEAD request and I have a lot of 404 errors in Google Search Console.

To verify that the Tornado application is not accepting HEAD requests I do:

curl -I example.com/this-url-exists

HTTP/1.1 404 Not Found
Date: Thu, 10 Mar 2016 08:49:07 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 7520
Connection: close
X-Ua-Compatible: IE=edge,chrome=1
Server: TornadoServer/4.2.1

I suspect that the Googlebots are doing the same for some of the crawling.

Can this be right?

已采纳解答

原帖链接 · MrWhite · CC BY-SA 3.0

I'm pretty sure Googlebot does not send HEAD requests - at least not with respect to crawling and indexing a website.

My access logs from January and February 2016 show no HEAD requests from the Googlebot.

Even if Googlebot did use HEAD requests I would be very surprised if these resulted in a 404 error in Google Search Console. Google should only report a 404 error on a failed GET request.

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Webmasters Stack Exchange
适用范围
以原帖系统、软件版本与发布日期为准(2016-03-10)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 3.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。