# www.robotstxt.org/ User-agent: ClaudeBot Disallow: / User-agent: SemanticScholarBot Disallow: / User-agent: FriendlyCrawler Disallow: / User-agent: simplecrawler Disallow: / User-agent: BLEXBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: PetalBot Disallow: / User-agent: dotbot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Bingbot Disallow: / User-agent: barkrowler Disallow: / User-agent: Yandex Disallow: / User-agent: Bytespider Disallow: / User-agent: Amazonbot Disallow: / User-agent: * Allow: /