# Robots.txt for achteraf.com # Optimized for SEO indexing User-agent: Googlebot Allow: / Crawl-delay: 1 User-agent: Bingbot Allow: / Crawl-delay: 2 User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: LinkedInBot Allow: / User-agent: Slurp Allow: / Crawl-delay: 2 User-agent: DuckDuckBot Allow: / User-agent: * Allow: / Crawl-delay: 5 # Sitemap location Sitemap: https://achteraf.com/sitemap.xml # Disallow non-essential paths Disallow: /admin/ Disallow: /api/