User-agent: * Allow: / # POST-only form endpoints; nothing crawlable lives here. Disallow: /api/ # CMS admin UI; auth-gated, nothing to index. Disallow: /keystatic # Legacy taxonomy URLs from the previous site (including raw-space variants # like /blog/tag/how to). They 404 and waste crawl budget. Disallow: /blog/tag/ Disallow: /blog/category/ # NOTE: /lead-magnets/ is deliberately NOT disallowed. Those PDFs carry an # X-Robots-Tag noindex header (_headers), and Google must be able to crawl # them to see it. Disallowing would leave leaked URLs indexable title-only. Sitemap: https://www.robynashleyweddings.com/sitemap.xml