大网数据广告活动
网站运营与故障问答

How to parse Apache access log for 404s not from bots?

· 52CE 我爱测

The regex is easy for 404s in a typical Apache log: grep ' 404 ' access_log But many are coming from bots, which I don't care about. I'm looking for actual people hitting 404s. So I'm trying to negate the term 'bot', which comes …

问题原文

原帖链接 · jphansen · CC BY-SA 4.0

The regex is easy for 404s in a typical Apache log:

grep ' 404 ' access_log

But many are coming from bots, which I don't care about. I'm looking for actual people hitting 404s. So I'm trying to negate the term 'bot', which comes later in the line, but nothing's working. Any ideas?

已采纳解答

原帖链接 · Steve · CC BY-SA 4.0

This can be done using the -v (for --invert-match) option of grep:

grep -v "excluded_word" access_log | grep ' 404 '

grep -v "excluded_word" access_log will return all the lines that don't have the unwanted word and then it is piped to grep ' 404 ' to list only lines with that pattern.

Since an access_log can be pretty big, a faster way is to use awk

awk '/404/ && !/bot/' access_log will find 404 and but not bot

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Webmasters Stack Exchange
适用范围
以原帖系统、软件版本与发布日期为准(2020-06-15)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 4.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。