Website Audit Tool
Home / Noindex Checker
Finding-specific pages

Noindex checker for pages blocked from indexing.

Find pages that contain noindex directives and verify whether those exclusions are intentional.

Opens the crawler with this URL prefilled. Review crawl settings before starting. No payment card required during beta.

Free during betaURL-level evidencePrivate history after signupScheduled monitoring

What this check finds

This page focuses on noindex directives in crawl context. The crawler records the fetched URL, response status, discovery source when available, metadata, redirect outcome, and history signals that explain why a finding appears.

Use the check to review pages blocked from indexing by robots metadata. The goal is not just to report a problem, but to show the URL-level evidence needed to decide whether the issue is intentional, accidental, fixed, or still unresolved.

Noindex CheckerCompleted
Visited704
Indexable619
Errors20
Warnings8
FindingSeverityEvidence
Noindex pagesWarningRobots directive and URL
Accidental exclusionsErrorImportant URL with noindex
Indexability changesInfoNew, resolved, persistent

Why this check matters

Confirm intentional exclusions

Separate expected noindex pages from pages that should be indexable.

Review metadata evidence

See whether the directive comes from robots meta or related crawl signals.

Monitor changes

Detect new noindex pages after deployments or CMS edits.

How to fix and verify it

  1. Run a focused crawl. Start with the affected website or section and keep settings consistent for follow-up comparisons.
  2. Inspect the evidence. Review affected URLs, source pages, HTTP statuses, metadata values, and crawl lineage before making changes.
  3. Apply the smallest safe fix. Update the page, template, route, redirect rule, canonical tag, or internal link that caused the finding.
  4. Rerun the audit. Confirm that the finding is resolved and did not create a new issue elsewhere.

When to monitor it

Small technical issues become expensive when they remain invisible. For noindex directives, a repeatable crawl helps distinguish a one-time anomaly from a persistent problem caused by templates, redirects, routes, metadata, or content changes.

Start with the concrete evidence: affected URL, source page, HTTP status, metadata value, redirect target, or comparison row. After the fix is made, run another crawl with comparable settings to confirm the finding is resolved.

Frequently asked questions

What does this page check?

It checks pages blocked from indexing by robots metadata and presents the result as summary counts plus URL-level evidence. That makes the audit useful for deciding what to fix and for verifying the result in a later crawl.

Will the audit start immediately after I enter a URL?

No. The URL is transferred to the crawler seed field so you can review scope, limits, redirects, and sitemap policy before starting.

Can this be monitored over time?

Yes. Registered users can create scheduled audits and review whether findings are new, resolved, or still unresolved across completed crawls.

Is this only for SEO?

No. The same findings are useful for site maintenance, release validation, migration checks, and general quality assurance.

Related audit pages

Run a free audit and check noindex directives.

Enter a website URL and inspect noindex directives with URL-level evidence in the live crawler.

Opens the crawler with this URL prefilled. Review crawl settings before starting. No payment card required during beta.