# Reaper League — p445 # # Everything is crawlable; the sitemap is the useful part of this file. A single # page app serves a near-empty HTML shell, so a crawler landing on / has no # links to follow until it renders JavaScript. The sitemap tells it directly # which pages exist instead of hoping it discovers them. User-agent: * Allow: / # Nothing here is secret, but these are per-user or token URLs with no value in # an index — and a crawler spending its budget on them is budget not spent on # the pages that matter. Disallow: /share/ Disallow: /join/ Disallow: /claim/ Disallow: /reset-password Disallow: /delete-account Sitemap: https://reaperleague.com/sitemap.xml