# Block aggressive SEO audit tools (They crawl every image/file) User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / # Allow all other "good" bots (Google, Bing, etc.) User-agent: * Disallow: Sitemap: https://www.subtle.co/sitemap.xml