SEO fix guide
Page Blocked by robots.txt
Your robots.txt file prevents Googlebot from crawling this page.
Issue ID: INDEX-BLOCKED-001
Severity: critical
Impact: High
Effort: S
Use this article when
- You need deeper remediation guidance than the issue card can show.
- You want CMS-specific steps before handing the fix to a developer.
- You want a repeatable re-check path after shipping the change.
What this issue is
Your robots.txt file prevents Googlebot from crawling this page.
Why it matters
Your robots.txt file prevents Googlebot from crawling this page. This affects how clearly search engines understand the page and how persuasive it looks in search results.
How we detect it
- FreeSiteAudit flags this issue when the rule for INDEX-BLOCKED-001 fails and the page evidence points to Http headers.
- You can usually confirm this by checking the page source or the relevant page settings inside your CMS.
Evidence examples
Check the affected page source, rendered output, or relevant CMS setting to confirm the missing or incorrect element.
How to fix it
- 1Review your robots.txt file at /robots.txt
- 2Remove or modify the Disallow rule
- 3Use Allow directives to permit specific paths
How to re-check it
- Test URL with Google Search Console robots.txt tester