大网数据广告活动
网站运营与故障问答

Prevent Google from thinking my own bot is faking traffic on my website

· 52CE 我爱测

I have a large website which I want to be visited by my own bot early on the morning, every day (for caching purpose). I want my bot visits 10,000 pages per day. My natural traffic is about 5000 pages per day. So I am worried tha…

问题原文

原帖链接 · ordiminnie · CC BY-SA 4.0

I have a large website which I want to be visited by my own bot early on the morning, every day (for caching purpose). I want my bot visits 10,000 pages per day.

My natural traffic is about 5000 pages per day. So I am worried that Google thinks I am faking traffic in order to manipulate the numbers, reputation or anything SEO-related.

The bot and the website will share the same IP so Google will understand easily that both are connected.

  • Do you think my bot will get me into trouble from Google?
  • If so, how could I prevent it?

社区高分解答

原帖链接 · Stephen Ostermiller · CC BY-SA 4.0

Google has no way of knowing when you hit your own site with your own bot. Google can't see anything that happens on your server.

Even if you use Google Analytics, your bot won't show up in it. Google Analytics relies on client side JavaScript to record hits. Most bots don't execute JavaScript. If your bot does execute JS, you should be able to configure it not to hit www.google-analytics.com so that it doesn't execute the GA snippet. Alternately you could configure your web site not to include the GA tracking snippet when your bot hits.

Even if hits do show up in Google Analytics, Google says that it doesn't use GA data for ranking purposes.

Even if Google saw your bot hits in a place that it could use them for ranking purposes, it is unlikely that they would effect your rankings. Sites get crawled by bots all the time. In fact, more than half of all web traffic is bots, not actual users. There would be no reason for Google to adjust rankings based on whether or not a site is getting hit by a bot. I would just make sure that your bot uses a user-agent header that clearly identifies it as a bot.

The only way that this crawling could effect your SEO is indirectly. If this crawling were to slow down your site significantly to the point that users were getting frustrated, Google could notice that and adjust your rankings because of perceived performance problems or poor usability.

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Webmasters Stack Exchange
适用范围
以原帖系统、软件版本与发布日期为准(2021-10-11)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 4.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。