大网数据广告活动
网站运营与故障问答

Do web crawlers/spiders index azure web sites?

· 52CE 我爱测

For somebody who wants their web site to be as discoverable as possible (and who doesn't?), are Microsoft's Azure web sites (azurewebsites.net) a feasible domain to host sites? I have a site that is both on an azurewebsites.net a…

问题原文

原帖链接 · B. Clay Shannon-B. Crow Raven · CC BY-SA 3.0

For somebody who wants their web site to be as discoverable as possible (and who doesn't?), are Microsoft's Azure web sites (azurewebsites.net) a feasible domain to host sites?

I have a site that is both on an azurewebsites.net and hosted under a completely different name by discountasp.net

Both of these sites are exactly the same, except for the URL; whenever I update the code, I republish the site to/in both places. So obviosuly, they both have the same H1 and H2 elements.

Searching for the value/content in my H1 tag, I find my .com site listed #3 on google and #2 on both Bing and Yahoo; OTOH, my azurewebsites.net site doesn't show up on the first page at all, in any of them.

This makes me wonder if azurewebsites.net should only be used for Web API hosting and such-like, not for generic/commercial "public" sites. Are my conclusions valid?

已采纳解答

原帖链接 · Binarysurf · CC BY-SA 3.0

So, are your websites exactly the same? same content, same html? and the only difference is domain and hosting?

Spiders will crawl any website as long as it is public, and no rules inside robots.txt or metatags explicitly tell them to keep out of the site.

Your problem is due to duplicate content, to Googlebot's eyes, one of your sites is copying content from another site and it doesn't like that, it will give credit to the site it thinks first published that content but will take into account authority, ranking, longevity and it will disregard or it will even penalize the site that's duplicating content.

From Google Webmaster Tools help:

Google tries hard to index and show pages with distinct information. This filtering means, for instance, that if your site has a "regular" and "printer" version of each article, and neither of these is blocked with a noindex meta tag, we'll choose one of them to list. In the rare cases in which Google perceives that duplicate content may be shown with intent to manipulate our rankings and deceive our users, we'll also make appropriate adjustments in the indexing and ranking of the sites involved. As a result, the ranking of the site may suffer, or the site might be removed entirely from the Google index, in which case it will no longer appear in search results.

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Webmasters Stack Exchange
适用范围
以原帖系统、软件版本与发布日期为准(2013-10-23)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 3.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。