Before you start
Why it matters
Crawl access alone does not make a page eligible for indexing.
Do it step by step
- 1
Choose the homepage and your most important public page types.
- 2
Inspect HTTP status, robots meta tags, and X-Robots-Tag headers.
- 3
Use Search Console URL Inspection to compare Google’s view.
- 4
Remove accidental noindex rules from pages you want indexed; leave private pages protected.
Example
A public service page should return 200 and have no accidental noindex directive.
Check your work
URL Inspection reports the selected page as eligible to be indexed, or gives a specific issue to resolve.
Complete when
Every chosen page type has been checked and accidental indexing blocks have been fixed.
Prompt for an AI coding agent
Use this with an agent that can inspect your project. Account and external actions remain yours to complete.
Inspect my existing website project before editing. Check indexing controls on important pages. Choose the homepage and your most important public page types. Inspect HTTP status, robots meta tags, and X-Robots-Tag headers. Use Search Console URL Inspection to compare Google’s view. Remove accidental noindex rules from pages you want indexed; leave private pages protected. Keep the existing framework and design conventions. Verify the result with the project's checks and by inspecting the rendered page or response. Explain any manual account, hosting, or Search Console steps I must do myself.
Tools and references
Reviewed 2026-11-04