User-agent: *
Allow: /

# AI Agent crawler optimizations
LLM-Guide: /llms.txt
AI-Feed: /ai-feed.json
Sitemap: /sitemap.xml