# robots.txt — المركز الوطني لتعزيز الصحة النفسية (ncmh.org.sa) # # IMPORTANT: robots.txt is only honored at the domain root. # This file must be deployed at https://ncmh.org.sa/robots.txt # (i.e. public_html/robots.txt on the server). User-agent: * Allow: / Disallow: /admin Disallow: /admin/ Disallow: /newsletter/preview/ Disallow: /ncmh-api-v2/ Disallow: /ncmh-api/ # AI crawlers — explicitly welcome on the public site User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: GoogleAgent-Mariner User-agent: Meta-ExternalAgent User-agent: Meta-ExternalFetcher User-agent: Applebot-Extended User-agent: CCBot User-agent: Amazonbot User-agent: DuckAssistBot User-agent: MistralAI-User User-agent: cohere-ai User-agent: AI2Bot Allow: / Disallow: /admin Disallow: /newsletter/preview/ Sitemap: https://ncmh.org.sa/sitemap.xml