Noindex

SEO

Also: Noindex Tag · Noindex Directive · Meta Robots Noindex

What it doesTells Google not to index a page

How it worksMeta tag or HTTP response header

Use forPages you own but don't want ranked

Takes effectAfter Google recrawls the page

Quick definition

Noindex is a directive you place on a web page to tell search engines not to include it in their index. Pages with a noindex tag can still be crawled and visited, but they will not appear in search results. It is applied via a meta robots tag in the page's HTML or via an HTTP response header.

How it varies across Australia

Across Australian sites we have reviewed, accidental noindex on important pages is one of the most common technical SEO issues found. It tends to appear after CMS migrations, theme changes or staging environment settings that were never reversed before launch.

See digital maturity scores across Australian industries →

What it actually means

Noindex is how you tell Google: crawl this if you like, but do not show it to anyone searching. The instruction lives in one of two places: a meta tag inside the HTML head of the page, or an X-Robots-Tag in the HTTP header that the server sends before the page loads.

The meta tag version looks like this: `<meta name="robots" content="noindex">`. The HTTP header version is used for PDFs, images and other non-HTML files where you cannot add a meta tag.

The distinction between noindex and disallow in your robots.txt file trips people up constantly. Disallow in robots.txt tells Google not to crawl a page. Noindex tells Google not to index it. If you disallow a URL but the page has no noindex tag, Google might still index it based on links from other sites, it just hasn't seen the content recently. If you noindex a URL but allow crawling, Google crawls it, reads the instruction and removes it from the index.

Useful applications include thank-you pages, internal search results pages, thin category pages and staging or preview URLs. The risk is that noindex applied accidentally, typically through a CMS setting left on after a site launch, can silently remove ranking pages from search without any obvious error in Google Analytics or Search Console unless you are actively monitoring coverage reports.

Noindex is one of the few SEO settings where a single line of code can wipe a page from Google entirely.

How it shows up

Noindex shows up in two places you should be watching regularly.

First, Google Search Console's Index Coverage report flags pages with noindex under the 'Excluded' tab. If you see a sudden spike in excluded pages or find URLs you expect to rank sitting in that list, noindex is often the cause.

Second, any crawl tool like Screaming Frog or Sitebulb will surface noindex tags across every page it visits. Running a crawl after every significant site change is the simplest way to catch accidental noindex before it costs you traffic.

Noindex also interacts with internal linking and crawl budget. A page Google cannot index still consumes crawl budget if it is accessible. For very large sites this matters. For most Australian SMEs it does not.

The Australian context

Many Australian businesses operate on WordPress, Squarespace or Shopify themes that include a 'Discourage search engines' or 'password protect' toggle in site settings. These toggles almost always inject a global noindex on every page, and they are left switched on after development more often than they should be.

If your site launched on a new theme or moved to a new CMS in the last 12 months and organic traffic dropped without explanation, checking the site-wide noindex setting is the first thing worth verifying. Search Console's Coverage report will show you the scale of the problem within days of Google recrawling.

Where people get this wrong

Confusing noindex with disallow in robots.txt.Robots.txt blocks crawling, not indexing. A URL you block in robots.txt can still appear in search results if other sites link to it. Noindex is the instruction that actually removes a URL from the index.

Leaving noindex on after a site launch from staging.Staging environments are routinely set to noindex to prevent duplicate content from ranking. When the site goes live and the setting is not reversed, every page is silently excluded from Google's index.

Adding noindex to a page that is also blocked in robots.txt.If Google cannot crawl a page, it cannot read the noindex tag. The instruction never reaches Google, so the page may remain indexed from a previous crawl. Allow crawling, then apply noindex.

Common questions

How do I add a noindex tag to a page?

Add `<meta name="robots" content="noindex">` inside the `<head>` section of the page's HTML. Most CMS platforms including WordPress, Shopify and Squarespace have built-in SEO settings that let you toggle noindex per page without editing code directly.

How long does it take for noindex to take effect?

It takes effect after Google recrawls the page and processes the instruction. For active pages that Google visits frequently this can happen within days. For lower-priority pages it can take weeks. Monitor Search Console's Coverage report to confirm the page moves to Excluded.

Can a noindexed page still receive traffic?

Yes. Noindex only removes a page from search results. Direct links, social shares, paid ads and any other non-organic source can still send visitors to the page. Noindex is specifically about organic search visibility.

Should I use noindex or delete pages I don't want in Google?

It depends on the reason. Noindex is right for pages you want to keep live but out of search results, such as thank-you pages or internal tools. If a page has no purpose at all, deleting it and setting a 301 redirect to a relevant page is usually cleaner than leaving it live with noindex.

Debrief

Get the next one

No spam. No fluff. Just the next article, straight to your inbox.

Keep exploring

About New Rebellion

New Rebellion is a marketing intelligence consultancy. We build tools, score Australian businesses on how their marketing actually performs, and publish Debrief every day. This dictionary is part of how we work in the open.

How we think →