大网数据广告活动
网站运营与故障问答

Firebase hosting, sitemaps and robots.txt

· 52CE 我爱测

i tried searching on internet about this question and how Firebase handle indexing and how owner of the content running on Firebase hosting can influence crawling by Google bot. Personally, i am running website built with Polymer…

问题原文

原帖链接 · maro_vargovcik · CC BY-SA 3.0

i tried searching on internet about this question and how Firebase handle indexing and how owner of the content running on Firebase hosting can influence crawling by Google bot.

Personally, i am running website built with Polymer + Firebase as backend (so basically SPA) with like 150 visitors per week and my website has common navigation with 5 links:

  • /price-list
  • /contact
  • /projects
  • /about-us
  • /home

Also projects page has nested

  • /projects/interior
  • /projects/architecture

Google indexed my website far more than it should and currently results like this appear when googling

/projects/interior/[[id]]/[[name-of-interior-project]]

So back to my question: How can i influence Google bot to forbid crawling specific sites? It is enough to just upload robots.txt or sitemap file along with other files like i would normally do with common hosting?

Thanks!

已采纳解答

原帖链接 · Maadinsh · CC BY-SA 3.0

Yes, you can block access to specific urls with robots.txt rule. If the page has real, unique url and google is indexing it, it doesn't matter that it's a SPA and by default links are loaded without page refresh.

Disallow: /projects/interior/

should match /projects/interior/[id]/[name] but not /projects/interior

You can test robots.txt rules with Google Search Console to be sure.

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Webmasters Stack Exchange
适用范围
以原帖系统、软件版本与发布日期为准(2017-05-15)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 3.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。