# --- Allow helpful AI crawlers to discover your public pages --- User-agent: GPTBot Allow: * User-agent: Googlebot Allow: / # Controls *training* use of content by some Google systems User-agent: Google-Extended Allow: / # Perplexity search crawler (not foundation model training per their docs) User-agent: PerplexityBot Allow: / Sitemap: https://promptvaults.net/sitemap.xml