Indexability: Do Not Accidentally Hide the Page From Search
A page can look perfect and still stay invisible if indexing directives block it.
Launch reviews should always confirm the page is allowed to be discovered.
What It Is
Indexability refers to whether crawlers are allowed to store the page in search indexes. Tags like noindex and some response headers can block that.
<meta name="robots" content="index,follow">
Why It Matters
- A noindex page cannot earn visibility in normal search results.
- Blocking directives often survive from staging by mistake.
- AI and search discovery are harder when the page is intentionally hidden.
Best Practices
- Use
index,followor omit restrictive directives on public launch pages. - Check both HTML meta robots tags and
X-Robots-Tagheaders. - Review staging and production separately.
Common Mistakes
- Leaving
noindexon production pages. - Blocking important routes in robots settings by accident.
- Assuming the page is indexable just because it loads.
Quick Checklist
- No blocking robots directive.
- No restrictive header on the final response.
- Launch pages intended for discovery remain indexable.
Final Takeaway
Visibility starts with permission. Make sure the page is allowed to exist in the index.