AEO ENGINE FREE TOOL
Free Noindex Checker and Noindex Tag Test
Who this tool is for: Built for SEO teams, founders, agencies, developers, and CMS owners who need to diagnose why a page disappeared from search, why Google Search Console reports noindex, or whether a launch/migration accidentally shipped index-blocking directives.
What this tool measures
- Robots meta tag detection for robots, googlebot, bingbot, and googlebot-news directives
- X-Robots-Tag header detection for server, CDN, middleware, and plugin-level noindex rules
- robots.txt crawl-block warning when crawlers may not be able to discover changed noindex directives
- Canonical URL extraction for indexability context
- 0-100 indexability score with source-specific issue flags
- Plain-English CMS, CDN, server, and template remediation guidance
- AI-search citation readiness caveats for Google, ChatGPT, Grok, Claude, Gemini, and Google AI Overview
- Copy-paste website widget with AEO Engine attribution
How it works
- Enter a public page URL
- The checker fetches the URL and captures available HTML, status, and headers
- It parses robots meta tags and X-Robots-Tag headers for noindex directives
- It checks robots.txt for crawl rules that can hide noindex changes from crawlers
- Review the indexability score and source-specific fix list
Why it matters for AI search and revenue
Noindex is useful for private, duplicate, thin, and staging pages. It becomes expensive when it leaks onto money pages, pillar guides, public tools, comparison pages, or source pages that should be discoverable. In AEO work, indexability is also the floor under entity clarity, schema, citations, and answer-ready content: pages that cannot be crawled or indexed are weaker candidates for durable search visibility and AI-answer citation workflows.
How AEO Engine executes beyond the tool
AEO Engine fixes the broader visibility system behind the noindex finding: CMS template drift, CDN and server headers, robots.txt crawl policy, canonical and sitemap hygiene, schema coverage, and answer-ready content. The public tool diagnoses one URL; managed AEO execution audits and repairs the site-wide system.
Use cases and examples
- Check whether a WordPress, Shopify, Webflow, or headless page still carries a launch-time noindex directive
- Find a hidden X-Robots-Tag header when the page source looks clean but Search Console reports noindex
- Confirm that robots.txt is not preventing crawlers from seeing an updated robots meta tag
- Audit public tools, service pages, comparison pages, and guides before publishing or indexing
- Use the widget on SEO checklists, CMS support docs, agency resource pages, and developer QA guides
Comparison and alternatives
Generic noindex tools usually stop at binary pass/fail. AEO Engine adds a search and AI-visibility lens: source-specific directive reporting, robots.txt crawl caveats, canonical context, an indexability score, related technical SEO checks, and a managed execution bridge when noindex is one symptom of a larger crawlability problem.
FAQ
What does a noindex checker test?
A noindex checker tests whether a page exposes a robots meta tag or X-Robots-Tag HTTP header that tells supported search crawlers not to include the URL in search results.
Can noindex appear outside the page source?
Yes. A page can look indexable in HTML while a server, CDN, middleware layer, or plugin sends an X-Robots-Tag header with noindex. That is why the checker separates HTML directives from HTTP headers.
Why does robots.txt matter for a noindex diagnosis?
If robots.txt blocks the URL, crawlers may never fetch the page to see an updated robots meta tag or X-Robots-Tag header. A crawl block can hide the fact that you removed a noindex directive.
Should I use noindex or robots.txt to hide pages?
Use noindex (meta or header) to prevent indexing of pages that are crawlable. Use robots.txt Disallow to prevent crawling of paths you do not want fetched at all. For pages that should never appear in search, a noindex directive is the clearer signal once the page has been crawled.
Can a page be noindexed but still appear in AI answers?
It is possible. Some AI systems synthesize answers from multiple crawled sources and may reference a domain even if a specific page carries noindex. However, a noindex page is a weak candidate for direct citation and should not be relied on for AI visibility.
Next step
Run a free noindex checker to test robots meta tags, X-Robots-Tag headers, robots.txt crawl access, canonical URL, and AI-search indexability risks.