Allow all user agents (web crawlers) User-agent: * Allow: / Allow search engines to crawl everything except certain directories Disallow: /admin/ Disallow: /login/ Allow crawling of images and assets (e.g., CSS, JS) Allow: /images/ Allow: /assets/ Allow: /css/ Allow: /js/ Sitemap: https://inditirth.com/sitemap.xml