Skip to main content
WordPress fix guide

robots.txt Blocks Important Pages on WordPress

Your robots.txt file contains Disallow rules that may prevent search engines from crawling important pages on your site.

Issue ID: CRAWL-ROBOTS-BLOCKS-001Severity: majorEffort: S

Why this matters

Your robots.txt file contains Disallow rules that may prevent search engines from crawling important pages on your site. This affects how clearly search engines understand the page and how persuasive it looks in search results.

WordPress fix path

How to fix this on WordPress

Use the page editor, theme, or SEO tooling depending on where this issue lives.

  1. 1Inspect the page and theme output.
  2. 2Apply the fix in the most direct place.
  3. 3Publish and validate with a re-audit.

After you fix it

  • Use the robots.txt tester in Google Search Console to verify important URLs are allowed

See every WordPress issue on your site

This is one issue of many the full audit checks. Run a free scan to see what else might be holding your site back.

Run Free Audit