User-agent: * Allow: / Disallow: /admin Disallow: /admin/ Disallow: /dashboard Disallow: /settings Disallow: /chat Disallow: /wallet Disallow: /my-listings Disallow: /my-deals Disallow: /payment-status Disallow: /kyc Disallow: /notification-settings Disallow: /invoices Disallow: /profile Disallow: /referral Disallow: /wishlist Disallow: /*?ref=* User-agent: Googlebot Allow: / Disallow: /admin User-agent: Bingbot Allow: / Disallow: /admin User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / # ───────────────────────────────────────────── # AI search engines & answer engines — explicitly allowed # ───────────────────────────────────────────── # OpenAI — ChatGPT Search index User-agent: OAI-SearchBot Allow: / Disallow: /admin Disallow: /chat Disallow: /wallet # OpenAI — model training / content crawler User-agent: GPTBot Allow: / Disallow: /admin Disallow: /chat Disallow: /wallet # OpenAI — live browsing on user request User-agent: ChatGPT-User Allow: / Disallow: /admin # Perplexity User-agent: PerplexityBot Allow: / Disallow: /admin User-agent: Perplexity-User Allow: / Disallow: /admin # Google — Gemini / AI Overviews grounding User-agent: Google-Extended Allow: / Disallow: /admin # Anthropic — Claude User-agent: ClaudeBot Allow: / Disallow: /admin User-agent: Claude-User Allow: / Disallow: /admin User-agent: Claude-SearchBot Allow: / Disallow: /admin # Apple Intelligence User-agent: Applebot Allow: / Disallow: /admin User-agent: Applebot-Extended Allow: / Disallow: /admin # Meta AI User-agent: meta-externalagent Allow: / Disallow: /admin # Common Crawl (feeds many AI datasets) User-agent: CCBot Allow: / Disallow: /admin # Amazon / You.com / Mistral / Cohere User-agent: Amazonbot Allow: / User-agent: YouBot Allow: / User-agent: MistralAI-User Allow: / User-agent: cohere-ai Allow: / Sitemap: https://omnifluxs.com/sitemap.xml Host: https://omnifluxs.com