Multi-sitemap discovery¶
Flowpane searches multiple sources:
- robots.txt — parse all
Sitemap:directives - Standard locations —
/sitemap.xmland/sitemap_index.xml - Platform-specific — based on detected platform
- Index expansion — child sitemaps fetched and analysed
Deduplication by URL (first discovery wins). Safety: 5s timeout per fetch, max 50 children per index.