User-agent: anthropic-ai Disallow: / ‍User-agent: Claude-Web Disallow: / User-agent: ClaudeBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: barkrowler Disallow: / User-agent: AhrefsBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: facebookexternalhit/1.1 Disallow: / # # User-agent: Googlebot User-agent: Googlebot-Image User-agent: Mediapartners-Google User-agent: Googlebot-Mobile User-agent: Googlebot-News User-agent: Googlebot-Video User-agent: Storebot-Google User-agent: AdsBot-Google # User-agent: msnbot User-agent: msnbot-media User-agent: bingbot User-agent: adisxbot # User-agent: Slurp User-agent: Yahoo-Blogs User-agent: Yahoo-MMCrawler # User-agent: * # Disallow: /101101/ Disallow: /adds/ Disallow: /aspnet_client/ Disallow: /assets/ Disallow: /bruce/ Disallow: /cart/ Disallow: /ccs95123/ Disallow: /Connections/ Disallow: /css/ Disallow: /drivers/ Disallow: /eadvert/ Disallow: /eanbc/ Disallow: /esl/ Disallow: /imagecache/ Disallow: /inc/ Disallow: /john/ Disallow: /kbcadmin/ Disallow: /kbcadminz/ Disallow: /keyboardco/ Disallow: /mysql_asp_test/ Disallow: /new/ Disallow: /quirkyquail/ Disallow: /room/ Disallow: /spot-light/ Disallow: /tetx/ Disallow: /trade/ Disallow: /tradez/ Disallow: /UCInc/ Disallow: /uk/ #