# Website Sitemap # Crawlers Setup User-agent: * Crawl-delay: 10 # Paths (no clean URLs) Disallow: /*.php$ Disallow: /*?SID= Disallow: /rss* Disallow: /*PHPSESSID