User-agent: * Allow: / Disallow: /api/ Disallow: /_partials/ Disallow: /car-museums/_data/ Disallow: /clubs/data/ Sitemap: https://rumbleseat.com/sitemap.xml Sitemap: https://rumbleseat.com/sitemap-clubs.xml # Crawl-delay for aggressive (but polite) SEO crawlers — directory is 10k+ pages User-agent: AhrefsBot Crawl-delay: 10 User-agent: SemrushBot Crawl-delay: 10