Noindex Tag: How to Use It and Check It

A noindex tag keeps a page out of search results. How to add the noindex meta tag, what noindex nofollow means, how to do it in WordPress and how to check it.

Noindex Tag: How to Use It and Check It

A noindex tag is a rule that tells search engines not to show a page in their results. The usual form is a meta tag in the page's HTML head, <meta name="robots" content="noindex">. When Googlebot crawls a page and finds it, Google drops the page from Google Search, even if other sites link to it, while the page stays online for anyone who visits. For PDFs and other files without HTML, the same rule goes in an HTTP header, X-Robots-Tag: noindex. One condition: Google must be able to crawl the page, so a noindexed page must not be blocked in robots.txt.

Below: when a noindex tag is the right tool, how to add it in HTML, WordPress and Shopify, what noindex nofollow means, how to remove a noindex tag you did not mean to have, and how often noindex pages turn up in real sitemaps.

What is a noindex tag?

A noindex tag is an indexing rule, not a crawling rule. Crawlers still fetch the page and can still follow its links; they just leave it out of the index, so it cannot appear in search results. Google, Bing and the other major engines support it.

Here is what happens step by step:

  1. Googlebot crawls the page and reads its HTML head and HTTP headers.
  2. It finds noindex in a robots or googlebot meta tag, or in an X-Robots-Tag header.
  3. If the page was indexed, Google removes it from search results. If it was not, Google keeps it out.
  4. Search Console lists the URL in the Page indexing report as "Excluded by 'noindex' tag".

The tag only works from the next crawl. Google's documentation on blocking indexing with noindex notes that it can take months for Googlebot to revisit a page it considers unimportant, which is why you may want to request a crawl after adding or removing one.

When should you use a noindex tag?

Use noindex for pages that should exist for visitors but have no business in search results. The usual candidates:

  • Thank-you and confirmation pages after a form or a purchase.
  • Internal search results and filter combinations that produce thin, near-empty pages.
  • Thin tag and archive pages that only list posts found elsewhere.
  • Login, account and cart pages.
  • Staging and test copies of your site, if they are not behind a password.
  • Landing pages built only for ads or email, which would compete with your main pages.

When not to use it:

  • On pages you want to rank. That sounds obvious, but a stray noindex is one of the most common reasons a page vanishes from Google.
  • For duplicate versions of a page. A canonical tag pointing at the main version consolidates the signals; noindex just throws the duplicate away.
  • Together with a robots.txt block. Google cannot read a noindex on a page it is not allowed to crawl. Our post on why noindex in robots.txt fails explains the trap and how to get out of it.

How to block Google from indexing pages: noindex vs other methods

Noindex is the standard way to keep a live page out of Google, but it is not the only one. Pick the method by what the page is:

MethodKeeps the URL out of Google?How longBest for
noindex meta tag or X-Robots-Tag headerYes, after Google's next crawlFor as long as the rule stays on the pageLive pages that should not be in search
robots.txt DisallowNot reliably: a blocked URL can still be indexed from linksWhile the rule staysSaving crawl time, not removing pages
Password or loginYesWhile the page stays protectedPrivate content
404 or 410 statusYes, after the next crawlPermanentPages that are gone
Removals tool in Search ConsoleYes, a request usually takes up to a dayAbout six monthsEmergencies, while a permanent fix takes effect
Canonical tag to another pageUsually: Google indexes the other URL insteadIt is a hint, not a ruleDuplicate versions of one page

How to add a noindex tag

How to add a noindex tag in HTML

  1. Open the HTML template or file for the page.
  2. Find the <head> section.
  3. Add <meta name="robots" content="noindex"> anywhere inside it.
  4. Publish the change and clear any page cache or CDN cache, so crawlers get the new HTML.
  5. Check the live page with the free noindex checker.

To target Google only, use name="googlebot" instead of name="robots". Other engines then ignore the rule.

How to noindex a page in WordPress and other platforms

Most site builders have a setting, so you never touch the HTML:

PlatformWhere to set noindex
WordPress with Yoast SEOIn the post editor, Yoast SEO, Advanced tab: set 'Allow search engines to show this content in search results' to No.
WordPress with Rank MathIn the post editor, Rank Math, Advanced tab: tick No Index under Robots Meta.
WordPress, whole siteSettings, Reading: tick 'Discourage search engines from indexing this site'. Meant for staging sites only.
ShopifySettings, Metafields and metaobjects: add a seo.hidden definition (Integer), then set SEO Hidden to 1 on the page, product or blog post. Or add the tag in theme.liquid for that page handle.
Any server, for PDFs and other filesSend the X-Robots-Tag: noindex HTTP header from your server or CDN.

On Apache, for example, this .htaccess block noindexes every PDF on the site:

<Files ~ "\.pdf$">
  Header set X-Robots-Tag "noindex, nofollow"
</Files>

Noindex nofollow meta tag: what it means

The noindex nofollow meta tag, <meta name="robots" content="noindex, nofollow">, combines two rules. noindex keeps the page out of search results. nofollow tells crawlers not to follow the links on the page. They are independent, so there are four combinations:

Meta tagPage in search results?Links on the page followed?Typical use
No tag, or content='index, follow'YesYesEvery normal page. Index and follow are the defaults.
content='noindex'NoYesThank-you pages, thin archives, internal search.
content='noindex, nofollow' or content='none'NoNoLogin areas, staging copies, pages with untrusted links.
content='nofollow'YesNoRare. To mark individual links, use rel='nofollow' on the link instead.

For most pages you want out of search, plain noindex is enough. Adding nofollow cuts off the links on that page as a discovery path, which you rarely want on a thank-you page that links back to your site.

How to check a noindex tag

Three ways, depending on how much you trust what you are looking at:

  • The free noindex checker reads the robots and googlebot meta tags, the X-Robots-Tag header, the robots.txt rule for the URL and the HTTP status in one go. It catches noindex rules that only exist in headers, which "view source" never shows.
  • URL Inspection in Search Console. Inspect the URL and read Indexing allowed? in the Page indexing details. No means Google found a noindex. Click Test live URL to check the current version rather than the last crawl. Our URL Inspection tool guide covers the other fields.
  • The Page indexing report. Under Indexing, Pages, the row "Excluded by 'noindex' tag" lists every URL where Google found the rule. Set the filter at the top to All submitted pages to see only the URLs in your sitemaps: those are the ones most likely to be mistakes.

How to remove a noindex tag in WordPress

A noindex tag you did not add usually comes from a setting, not from your HTML. Work through them in this order:

  1. Settings, Reading. Untick "Discourage search engines from indexing this site" and save. This one setting noindexes every page, and it is often left on after a site moves from staging to live.
  2. The page's own SEO setting. In Yoast or Rank Math, open the page's Advanced settings and set it back to index.
  3. The content type defaults. SEO plugins can noindex whole post types, categories, tags or archives. In Yoast, go to Settings, Content types (or Categories & tags) and check that the type shows in search results; in Rank Math, check Titles & Meta for that type.
  4. Staging and maintenance plugins. Coming-soon and maintenance-mode plugins often add a noindex while active.
  5. Caches. Clear your page cache and CDN cache, or crawlers keep getting the old HTML with the old tag.
  6. Confirm and request a crawl. Run the page through the noindex checker, then in URL Inspection click Test live URL. When Indexing allowed? says Yes, click Request indexing.

Outside WordPress, the fix follows the same logic: find whether the rule sits in the template, in a CMS setting or in a server or CDN header, and remove it at the source.

How common are noindex pages in sitemaps?

More common than any other block a site owner sets on purpose. We looked at the sites connected to IndexMachine: on October 31, 2026, about 1.17 million sitemap URLs on 1,513 sites, each with its latest state in Google's URL Inspection data. Here are the states a site controls directly, with how many sitemap URLs and sites each covered. Aggregate counts only, with no site or URL named; these are sites whose owners signed up for an indexing tool, so they lean toward sites with indexing trouble. Most of these sites are on free accounts, where IndexMachine has not requested anything yet, so the numbers show where sites stand before indexing is turned on.

State in Search ConsoleSitemap URLsSites with at least one
Excluded by 'noindex' tag11,843157
Page with redirect9,273122
Alternate page with proper canonical tag5,83861
Blocked by robots.txt5,24117
Not found (404)2,91981

What the numbers say:

  • Noindex was the most common of these blocks. 11,843 sitemap URLs on 157 sites, or 10.4% of all sites. That is about 75 noindexed URLs per affected site, so it is usually a template or a setting, not one page.
  • Every one of those URLs was in a sitemap. A sitemap lists the pages you want indexed; a noindex tag says the opposite. Either the tag is a mistake (a staging setting, a content type default) or the URL does not belong in the sitemap. Both are worth fixing.

Spend your requests on pages that can be indexed

A page with a noindex tag cannot be indexed, however often you ask. Clicking Request indexing for it in Search Console wastes one of your limited daily requests, and when a template noindexes a whole section, the waste is invisible until you inspect the pages one by one.

IndexMachine handles both sides. A free account imports every site in your Search Console and shows the index status of every sitemap page, so a section stuck in "Excluded by 'noindex' tag" stands out. With indexing turned on, its Chrome extension presses Google's own Request indexing button in your Search Console every day, on autopilot, using your full daily Google quota on every site. Pages with a noindex rule never use your quota: IndexMachine shows you the reason, and once you have removed the tag, the page gets requested like any other. Every other engine gets unlimited IndexNow, plus 404 alerts and a weekly email report. You can pay once for lifetime access or subscribe.

Find every page a noindex tag is keeping out

A free IndexMachine account imports your Search Console sites and shows each sitemap page's index status, including the ones excluded by noindex. Turn on daily Request Indexing in your own Search Console plus unlimited IndexNow when you are ready.

FAQs

What is noindex?

Noindex is a rule that tells search engines not to include a page in their index, so it cannot appear in search results. You set it with a robots meta tag in the page's HTML or with an X-Robots-Tag HTTP header. The page stays live for visitors.

Does a noindex tag remove a page from Google?

Yes, once Google crawls the page again and sees the tag. That can take days or months depending on how often Google visits the page. Request indexing in URL Inspection to bring the crawl forward, or use the Removals tool to hide the page while you wait.

What is the difference between noindex and nofollow?

Noindex keeps the page itself out of search results. Nofollow tells crawlers not to follow the links on the page. You can use them alone or together as noindex, nofollow.

Can I put a noindex tag in robots.txt?

No. Google has ignored noindex lines in robots.txt since September 1, 2019. The rule has to be on the page, in a meta tag or an HTTP header, and the page has to stay crawlable so Google can read it. Our robots.txt guide covers what the file can and cannot do.

Does noindex hurt SEO?

Only for the page that carries it, which cannot rank while the tag is there. Noindexing thin or private pages does not harm the rest of your site. The risk is a noindex on a page you want in search, so check your important pages after every theme, plugin or template change.

Elevate your digital presence

Getting your pages indexed by Google is the first crucial step in your search engine optimization journey.
Fix indexing issues. Let the SEO magic begin.

Try free, see which pages Google hasn't indexed

Free account. Import may take a while for big sites, Google rate-limits Search Console.

See pricing