# Anga — robots.txt (SEO + AI crawlers) # All major search and AI crawlers that identify with a dedicated User-agent still match # User-agent: * unless they have their own block elsewhere; this file uses one rule set for everyone. # # Machine-readable site summary for tools that support it: https://anga.ae/llms.txt # If your dashboard URL is not /admin/, update Disallow (see ADMIN_DIR in .env). User-agent: * Allow: / Disallow: /admin/ Disallow: /install/ Disallow: /vendor/ # Absolute URL required for Sitemap. Change the host if your canonical domain differs. Sitemap: https://anga.ae/sitemap.xml