大网数据广告活动
网站运营与故障问答

Why am I getting bot hits from compute-1.amazonaws.com?

· 52CE 我爱测

I have a WordPress website with AWS on use, namely the Cloudfront service, to serve CSS, images and JS from the cloud. Lately, I noticed a lot of hits from bots coming from : IP: 54.236.71.87 Hostname: ec2-54-236-71-87.compute-1.…

问题原文

原帖链接 · Aurélien Pierre · CC BY-SA 3.0

I have a WordPress website with AWS on use, namely the Cloudfront service, to serve CSS, images and JS from the cloud.

Lately, I noticed a lot of hits from bots coming from :

  • IP: 54.236.71.87 Hostname: ec2-54-236-71-87.compute-1.amazonaws.com
  • IP: 54.147.229.75 Hostname: ec2-54-147-229-75.compute-1.amazonaws.com
  • IP: 34.207.96.105 Hostname: ec2-34-207-96-105.compute-1.amazonaws.com
  • IP: 52.202.239.36 Hostname: ec2-52-202-239-36.compute-1.amazonaws.com
  • IP: 34.203.222.34 Hostname: ec2-34-203-222-34.compute-1.amazonaws.com
  • ...

Goeip trace them to Ashburn, USA. They crawl all the RSS feeds of my website (posts, categories), almost every minute, coming from https://www.google.com/.

Their user-agent are a bit random :

Browser: undefined
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9a3pre) Gecko/20070330

or :

Browser: Chrome version 0.0 running on MacOSX
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_2) AppleWebKit/537.17 (KHTML, like Gecko) Chrome/24.0.1309.0 Safari/537.17

or :

Browser: undefined
Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.13; ) Gecko/20101203

How can I find out what they want ? Are they related to the cache generation for Cloudfront ?

I wonder because in the last 9 days, more than half of the bandwidth of my hosting has been consumed by unidentified bots.

已采纳解答

原帖链接 · Jonathon Sim · CC BY-SA 3.0

These look to me like bots/crawlers running on EC2 instances, rather than anything to do with Cloudfront. AWS publish a list of IP ranges used by Cloudfront here : https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/LocationsOfEdgeServers.html

They're probably harvesting content or email addresses, looking for vulnerable apps, open comment forms where they can post comment spam, or something else not to your benefit. Sadly it's not uncommon for a lot of your traffic to come from bots like this.

You might want to block those IP addresses in the security group for your instance or ELB. If those IP's are hitting your origin servers rather than coming through cloudfront, and you only use cloudfront to access those servers, you might consider using something like this which blocks everything except the cloudfront IPs https://github.com/awslabs/aws-cloudfront-samples/tree/master/update_security_groups_lambda

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Webmasters Stack Exchange
适用范围
以原帖系统、软件版本与发布日期为准(2018-01-09)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 3.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。