User-agent: * Allow: /social_instagram/ Sitemap: http://botshare.ai/sitemap.xml ############## # custom # ############## User-agent: * Allow: / Allow: /web/image/ Allow: /web/assets/ Allow: /web/content/ Disallow: /web/ Disallow: /odoo/ Disallow: /my/ Disallow: /shop/cart Disallow: /shop/checkout Disallow: /contactus-thank-you Disallow: /profile/ Disallow: /website/info Disallow: /slides Disallow: /helpdesk Disallow: /profile Disallow: /terms$ Disallow: /shop Disallow: /internship-step-2 User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / Sitemap: https://botshare.ai/sitemap-https.xml Sitemap: https://botshare.ai/sitemap.xml