Home/Free Tools/Noindex Checker

Free Noindex Checker

Check any URL for noindex. We test the meta robots tag, the googlebot meta tag, the X-Robots-Tag response header, and robots.txt crawl rules, and show you the exact directive we find.

What We Check

Meta Robots Tag

We scan the page HTML for a noindex directive in the meta robots tag and show you the exact tag we found.

Googlebot Meta Tag

Some pages block only Google with a googlebot-specific meta tag. We check for that variant separately.

X-Robots-Tag Header

Noindex can also be sent as an HTTP response header, invisible in the HTML. We inspect the live response headers.

Robots.txt Crawl Rules

We check whether robots.txt disallows the URL. That blocks crawling, not indexing, and we report it as a separate signal.

Understanding Noindex

Noindex is a directive that tells search engines not to include a page in their search results. It can be set in two places: a meta robots tag in the page HTML (<meta name="robots" content="noindex">) or an X-Robots-Tag HTTP response header sent by the server. Either one is enough to keep a page out of Google. This tool fetches your URL and checks both, plus the googlebot-specific meta tag variant.

Noindex vs. Robots.txt Disallow

They are different mechanisms and people mix them up constantly. Noindex says "you may crawl this page, but do not show it in results". A robots.txt disallow says "do not crawl this page at all" and says nothing about indexing. A disallowed URL can still appear in Google if other sites link to it. Worse, combining the two backfires: if robots.txt blocks the page, Google never fetches it, never sees the noindex tag, and may keep the URL indexed anyway. To reliably remove a page from search results, let it be crawled and serve a noindex. This tool shows both signals separately so you can spot that conflict. If robots.txt is your problem, see our guide to fixing "Blocked by robots.txt" errors.

How to Remove an Accidental Noindex

  • Meta tag: find the <meta name="robots"> tag in your template or CMS SEO settings and change noindex to index, or delete the tag entirely (indexing is the default).
  • X-Robots-Tag header: this comes from server config (nginx, Apache, .htaccess), hosting platform settings, or a CDN rule. Search your config for "X-Robots-Tag" and remove the noindex value.
  • Verify the fix: re-run this checker until all signals are green, then request indexing in Google Search Console. Re-crawling can take days to weeks.

Common Causes of Accidental Noindex

  • CMS visibility settings - WordPress's "Discourage search engines" checkbox and similar toggles in other CMSs add a sitewide noindex.
  • SEO plugin defaults - plugins often noindex categories, tags, archives, or entire post types, sometimes more than you intended.
  • Staging leftovers - staging environments are noindexed on purpose, and the setting ships to production during a launch or migration.
  • Hosting or CDN rules - some platforms inject an X-Robots-Tag noindex header on preview domains or when a setting is toggled, with nothing visible in your HTML.
  • Page builder or theme options - a per-page "hide from search engines" toggle someone clicked months ago.

No Noindex, Still Not Indexed?

If this tool shows no blockers but your page is still missing from Google, the page is probably stuck in the crawl queue. Run our Google index checker for a wider indexability audit including canonical tags, and read why pages get stuck in "Crawled, currently not indexed". To stop babysitting the queue, IndexMachine submits your pages to Google and Bing daily through the official APIs and reports which ones got indexed.

FAQ

How do I check if a page has a noindex tag?

Paste the URL into the checker above. It fetches the live page and reports the meta robots tag, the googlebot meta tag, and the X-Robots-Tag header, showing the exact directive found. Checking manually means viewing the page source for the meta tag and inspecting response headers in browser dev tools for the header variant.

Does noindex remove a page from Google immediately?

No. Google has to re-crawl the page and see the directive first, which can take days or weeks. For urgent removals, use the Removals tool in Google Search Console alongside the noindex.

Is robots.txt disallow the same as noindex?

No. Disallow blocks crawling, noindex blocks indexing. A disallowed page can still be indexed from links, and a noindex on a disallowed page is never seen. Use noindex, without a robots.txt block, to keep a page out of results.

Why does my page have a noindex I never added?

Usually a CMS or plugin setting: WordPress's "Discourage search engines" option, an SEO plugin noindexing archives, a staging flag that shipped to production, or a hosting/CDN rule adding an X-Robots-Tag header. The exact tag or header this tool shows tells you which layer to look in.

How long until Google re-indexes after removing noindex?

Anywhere from a few days to several weeks, depending on how often Google crawls your site. Requesting indexing in Search Console or submitting the URL through the Indexing API speeds up the re-crawl.