Meta robots in source
Inspect the signal in the rendered page.
Practical guide · Free in Chrome
How to Check Robots Meta and X-Robots-Tag Together
Search Toolbox helps you read every indexability directive from both markup and response headers, directly on the live page. The goal is one intentional, testable indexability policy per template, without hiding the evidence behind one overall score.
technical SEOs, platform teams and release owners
Learn SEO / GEO the practical way
Audit a page, tab by tab.
A guided route from first observation to verification. Open the lesson to learn the method, or jump to its tool and inspect the active page.
- Step 01
Open the page and establish the baseline
Start on the live URL and record the final URL, HTTP response and indexability.
- Step 02
Check Overview, metadata and canonical
Resolve noindex, title, description, robots and canonical conflicts first.
- Step 03
Audit headings, links and images
Read the hierarchy, follow internal anchors and fix repeated image-template errors.
- Step 04
Validate schema and entity relationships
Inspect the rendered JSON-LD graph, required properties and conflicting entities.
- Step 05
Verify hreflang and localized URLs
Test reciprocity, language codes, canonicals and HTTP status across the cluster.
- Step 06
Trace redirects and URL variants
Follow every hop and confirm the final URL is indexable and self-canonical.
- Step 07
Understand SSR, CSR and the rendering risk
Learn what the server sends, what JavaScript adds and which differences deserve investigation.
- Step 08
Investigate source HTML and rendered DOM if needed
Use this deeper check only when simpler panels reveal a JavaScript-related contradiction.
- Step 09
Prioritize, export, fix and retest
Turn evidence into an ordered plan, change one thing, then rerun the same checks.
What you can verify
Meta robots after render
Compare source code with the browser output.
X-Robots-Tag headers
Find contradictions that block indexation.
Crawler-specific directives
Export evidence your team can act on.
The observable problem
Removing a noindex meta tag does nothing when the CDN still sends X-Robots-Tag: noindex.
The useful outcome
one intentional, testable indexability policy per template
The note written after the third coffee
“Robots directives are small enough to hide in one line and powerful enough to cancel a launch. Always compare the HTML meta tag with the HTTP header; surprises enjoy living between the two.”
Evidence on the real page
robots meta and X-Robots-Tag checker
A verifiable workflow, not a decorative score
Open the real page
Check the robots meta and X-Robots-Tag checker in the real session, staging environment or localhost — preferably the troublesome page, not the perfectly groomed demo.
Inspect the evidence
Check meta robots in source, meta robots after render, x-robots-tag headers, crawler-specific directives and connect signals that contradict each other.
Fix and retest
Aim for one intentional, testable indexability policy per template. Change one rule at a time, then repeat the exact same check so you know what actually moved.
What this page does not pretend to do
For the robots meta and X-Robots-Tag checker, Search Toolbox inspects the active URL deeply. It is not a full-site crawler, backlink platform or rank tracker. Test several URLs when the issue comes from a template.
Frequently asked questions
What does the robots meta and X-Robots-Tag checker check?
It covers meta robots in source, meta robots after render, x-robots-tag headers, crawler-specific directives to deliver one intentional, testable indexability policy per template.
Is the robots meta and X-Robots-Tag checker free?
Manual checks for the robots meta and X-Robots-Tag checker are included in the 60+ free tools. Only the optional contextual SEO Expert uses credits.
Does it work on staging and localhost?
Yes. The robots meta and X-Robots-Tag checker check runs on the page you are viewing, including logged-in sessions and non-public environments.
Is it a full SEO crawler?
For the robots meta and X-Robots-Tag checker, Search Toolbox inspects the active URL deeply. It is not a full-site crawler, backlink platform or rank tracker. Test several URLs when the issue comes from a template.
Verify it on your own page.
Manual checks for the robots meta and X-Robots-Tag checker are included in the 60+ free tools. Only the optional contextual SEO Expert uses credits.