User-Agent: * Disallow: /api/ Disallow: /comment/ Disallow: /goto/ Disallow: /ozbapi/ Disallow: /privatemsg/ Disallow: /search/ Disallow: /user/login User-Agent: AhrefsBot Disallow: / User-Agent: dotbot Disallow: / User-Agent: Superfeedr Disallow: /