问题原文
原帖链接 · brillout · CC BY-SA 4.0
With the rise of HTML Streaming (e.g. React 18 Streaming), I'm wondering how crawlers handle HTML streams.
Most importantly, do crawlers wait until the stream has ended?
How does the Google crawler handle this? Google does mention streaming here but it doesn't say how the Google crawler handles HTML streams.
How about other crawlers (DuckDuckGo, Bing, Facebook, Twitter, etc.)? I'd assume that crawlers would wait until the HTML streams end, am I safe with that assumption?
HTML streaming could lead to SEO optimized pages with a fast TTFB. That's a big deal.
社区高分解答
原帖链接 · Harshal Patil · CC BY-SA 4.0
Currently, as of 2021, Streaming SSR combined with partial hydration is not fully materialized. So the exact impact is unknown. But in general, streaming HTML is not a new thing. It has been there since a long time. Streaming HTML is just being implemented with modern SSR using React, Solid.js, etc.
As far as the search engines are concerned, the reduction in TTFB definitely adds to improving the page/content ranking but it won't impact the ability to properly crawl the web page. It would behave like any other crawling. In fact, modern crawlers are smart enough to even crawl the CSR HTML.
Streaming is about getting that extra juice out of the door. Also, you are right that crawlers wait until the HTML stream ends with sensible timeouts. Long running stream would penalize the ranking.
摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。
