User-agent: * Allow: / Disallow: /admin Disallow: /admin/ Disallow: /application/ Disallow: /system/ # Googlebot specific optimizations User-agent: Googlebot Allow: / Disallow: /admin/ # Bingbot specific optimizations User-agent: Bingbot Allow: / Disallow: /admin/ # Sitemap locations Sitemap: https://news.bd-market.xyz/sitemap.xml Sitemap: https://bd-market.xyz/sitemap.xml