# ---- Major Search Engines ---- User-agent: Googlebot Allow: / User-agent: ChatGPT-user Allow: / User-agent: ClaudeBot Allow: / User-agent: Gemini-Deep-Research Allow: / User-agent: Bingbot Allow: / # ---- OpenAI ---- User-agent: OAI-SearchBot Allow: / User-agent: GPTBot Allow: / # ---- Google AI ---- User-agent: Google-Extended Allow: / # ---- Perplexity ---- User-agent: PerplexityBot Allow: / # ---- Meta AI ---- User-agent: Meta-ExternalAgent Allow: / User-agent: Meta-ExternalFetcher Allow: / # ---- Common Crawl ---- User-agent: CCBot Allow: / # ---- Apple ---- User-agent: Applebot-Extended Allow: / # ---- Amazon ---- User-agent: Amazonbot Allow: / # ---- All other crawlers ---- User-agent: * Disallow: Sitemap: https://shivtekspechemi.com/sitemap_index.xml # --------------------------- # END YOAST BLOCK