User-agent: * Allow: / # /thank-you/ and /privacy/ are NOT disallowed on purpose. They carry noindex # (meta tag + X-Robots-Tag in _headers), and a crawler blocked by robots.txt # never fetches the page, so it never sees the noindex — the bare URL can then # be indexed from any link pointing at it. Disallow: /api/ Sitemap: https://londonconcretecutting.com/sitemap-index.xml