# =========================== # General Access Rules # =========================== User-agent: * Allow: / # =========================== # Googlebot Rules # =========================== User-agent: Googlebot Disallow: /wp-admin/ Disallow: /wp-content/ Allow: /wp-content/uploads/ Disallow: /feed/ Disallow: /tag/ Disallow: /_api/ Disallow: /_serverless/ Disallow: /inquiry-form Disallow: /general-5 disallow: /page/6 disallow: /author/ Disallow: /?source=magpietravel Disallow: /?ref Disallow: /? # =========================== # Google Ads Bots Optimization # =========================== User-agent: AdsBot-Google Disallow: /_api/ Disallow: /_partials/ Disallow: /pro-gallery-webapp/v1/galleries/ User-agent: AdsBot-Google-Mobile Disallow: /_api/ Disallow: /_partials/ Disallow: /pro-gallery-webapp/v1/galleries/ # =========================== # PetalBot - Completely Blocked # =========================== User-agent: PetalBot Disallow: / # =========================== # Crawl Delay for Aggressive Bots # =========================== User-agent: dotbot Crawl-delay: 10 User-agent: AhrefsBot Crawl-delay: 10 # =========================== # Sitemap Location # =========================== Sitemap: https://www.soultravelling.in/sitemap.xml