6 Reasons Your Pages Aren't Getting Indexed (And How to Fix Each)

If your pages aren’t indexed, they can’t rank. Period.

Google Search Console shows various indexing statuses that explain why pages aren’t appearing in search. This guide covers the 6 most common reasons and exactly how to fix each one.

Quick Diagnosis

Check your indexing status in Google Search Console under Pages (formerly Coverage):

Status	What It Means	Urgency
Discovered - currently not indexed	Google knows it exists but hasn’t crawled	Medium
Crawled - currently not indexed	Google crawled but chose not to index	High
Blocked by robots.txt	You’re blocking Google	Critical
Blocked by noindex	You told Google not to index	Critical
Duplicate, submitted URL not selected as canonical	Google chose a different URL	Medium
Soft 404	Page appears empty or error-like	High

1) Blocked by Robots.txt

What it means: Your robots.txt file is telling Google not to crawl these pages.

Common causes:

• Leftover rules from development/staging
• Overly broad Disallow rules
• Blocking entire directories accidentally
• Blocking CSS/JS files Google needs to render pages

How to Check

1. Visit yoursite.com/robots.txt
2. Use Google’s robots.txt Tester in Search Console
3. Use URL Inspection tool to check specific pages

How to Fix

# Bad - blocks everything
Disallow: /

# Bad - blocks important section
Disallow: /products/

# Good - only block what you need
Disallow: /admin/
Disallow: /cart/
Disallow: /checkout/

After fixing robots.txt:

1. Test again with robots.txt Tester
2. Request indexing via URL Inspection tool
3. Wait for re-crawl (can take days to weeks)

2) Blocked by Noindex Tag

What it means: Your page has a noindex directive telling Google not to index it.

Common causes:

• Development/staging noindex left on production
• CMS settings (WordPress visibility, Shopify settings)
• Global noindex applied to category/tag pages
• Template-level noindex on new pages

How to Check

1. View page source, search for noindex
2. Check HTTP headers for X-Robots-Tag: noindex
3. Use URL Inspection tool (shows “Indexing allowed? No”)
4. Run SEO audit to find all noindexed pages

How to Fix

Remove the noindex from:

Meta tag:

<!-- Remove this -->
<meta name="robots" content="noindex">

HTTP header:

# Remove this from server config
X-Robots-Tag: noindex

CMS settings:

• WordPress: Check Reading Settings and per-page visibility
• Shopify: Check page template settings
• Webflow: Check page settings under SEO

After removing noindex:

1. Request indexing in URL Inspection tool
2. Monitor Pages report for status change

3) Discovered - Currently Not Indexed

What it means: Google found your URL (via sitemap, internal links, or external links) but hasn’t crawled it yet.

Why this happens:

• Low crawl priority (new pages, weak internal links)
• Crawl budget limitations (large sites)
• Server response issues when Google tried to crawl
• Site under heavy load during crawl attempts

How to Fix

Improve crawl priority:

1. Add internal links from high-authority pages
2. Ensure page is in XML sitemap
3. Reduce click depth (pages should be within 3 clicks from homepage)
4. Request indexing in URL Inspection tool

Check server health:

1. Monitor server logs for Googlebot requests
2. Ensure fast server response times (under 200ms TTFB)
3. Check for crawl errors in Search Console

For large sites:

1. Prioritize important pages in sitemap
2. Remove low-value pages from crawl (noindex or delete)
3. Improve internal linking to key pages

4) Crawled - Currently Not Indexed

What it means: Google crawled the page but chose not to add it to the index. This is often a quality signal.

Why this happens:

• Content is too thin or low-quality
• Duplicate or near-duplicate content
• Page doesn’t provide unique value
• Site-wide quality issues (Helpful Content classifier)
• Page is auto-generated or template-heavy

How to Fix

Improve content quality:

1. Add substantial, unique content (aim for 500+ words of real value)
2. Include original insights, data, or expertise
3. Ensure content matches search intent
4. Add images, videos, or interactive elements

Check for duplicate content:

1. Search for sentences from your page in quotes on Google
2. Use Copyscape or similar tools
3. Implement proper canonicals if duplicates are intentional

Evaluate page purpose:

• Does this page help users?
• Would you recommend this page to someone?
• Does it say something other pages don’t?

If a page has no unique value, consider:

• Consolidating with other pages
• Adding substantial unique content
• Removing the page entirely

5) Duplicate, Submitted URL Not Selected as Canonical

What it means: Google found multiple versions of this content and chose a different URL as the canonical (main version).

Common causes:

• Same content on multiple URLs (with/without www, HTTP/HTTPS, trailing slashes)
• URL parameters creating duplicates
• Syndicated content indexed before your original
• Missing or incorrect canonical tags

How to Check

1. URL Inspection tool shows “Google-selected canonical” vs “User-declared canonical”
2. Search for exact sentences in quotes to find which version Google indexed
3. Check for duplicate URLs in Pages report

How to Fix

Implement canonical tags correctly:

<link rel="canonical" href="https://www.yoursite.com/preferred-url/">

Consolidate URL variations:

1. Choose one canonical version (www vs non-www, etc.)
2. 301 redirect all variations to canonical
3. Update internal links to use canonical URLs
4. Update sitemap to only include canonical URLs

For parameter duplicates:

1. Use Google Search Console URL Parameters tool
2. Implement self-referencing canonicals
3. Use noindex for filtered/sorted variations

6) Soft 404

What it means: The page returns a 200 OK status but Google thinks it looks like an error page (empty, “not found” message, or no main content).

Common causes:

• Search results pages with no results
• Empty product/category pages
• Pages with only boilerplate (nav, footer, no content)
• Dynamic pages that fail to load content
• JavaScript-rendered content not loading for Googlebot

How to Check

1. URL Inspection tool labels soft 404s
2. Check Pages report for soft 404 errors
3. View the page as Googlebot sees it (URL Inspection → View Crawled Page)

How to Fix

For truly empty pages:

• Return proper 404 status code if page doesn’t exist
• Add noindex if page should exist but has no content
• Remove from sitemap

For pages that should have content:

• Fix the underlying issue (database, API, JS rendering)
• Test with URL Inspection to verify Googlebot sees content
• Ensure main content loads without JavaScript if possible

For search/filter pages:

• Return 404 or noindex for no-results pages
• Add default content for empty states
• Use robots.txt to block search result URLs

Indexing Priority Framework

Not all indexing issues are equal. Focus on:

Fix First (Critical)

1. Robots.txt blocks on important pages
2. Noindex on revenue-generating pages
3. Soft 404s on key content

Fix Second (High Priority)

1. “Crawled - not indexed” on important pages
2. Canonical issues causing wrong URL to rank
3. “Discovered - not indexed” pages over 30 days old

Fix Third (Medium Priority)

1. Parameter duplicate issues
2. Low-value page indexing
3. Minor canonical inconsistencies

Monitor Indexing Health

After fixing issues:

1. Request indexing for fixed pages via URL Inspection
2. Check back in 1-2 weeks for status changes
3. Monitor Pages report weekly for new issues
4. Run regular audits to catch problems early

Find Your Indexing Issues

Use Rankture’s free audit to identify pages with indexing problems across your site:

• Pages blocked from indexing
• Thin content at risk of deindexing
• Duplicate content issues
• Technical crawl problems

Start here: Run a Free SEO Audit

Frequently Asked Questions

How long does it take for Google to index a page?

New pages can be indexed within hours to weeks. Pages on established, frequently-crawled sites index faster. Use URL Inspection’s “Request Indexing” to speed up the process, but it’s not instant.

Why does Google choose not to index some pages?

Google has limited resources and prioritizes quality. If a page is thin, duplicative, or provides no unique value, Google may crawl it but choose not to index it. Improving content quality is the fix.

Should I submit every page to Google manually?

No. Google discovers pages through crawling. Ensure proper internal linking, maintain an XML sitemap, and Google will find your pages. Manual submission is for new pages you want indexed quickly or pages with recent fixes.

Can too many unindexed pages hurt my site?

Having many low-quality pages that Google refuses to index can signal site-wide quality issues. This is similar to how Panda and Helpful Content updates work. Prune or improve low-quality pages rather than letting them accumulate.

How do I know if my page is indexed?

Search site:yoursite.com/page-url on Google. If it appears, it’s indexed. For comprehensive data, use Google Search Console’s Pages report or URL Inspection tool.

Related Guides

• Technical SEO Issues Killing Rankings
• Crawlability & Indexing Guide
• Signs Your Website Needs an SEO Audit
• XML Sitemap Best Practices