Skip to main content
Webflow fix guide

No robots.txt File on Webflow

Your site is missing a robots.txt file. Search engine crawlers look for this file to understand which pages they can and cannot access.

Issue ID: CRAWL-ROBOTS-PRESENT-001Severity: moderateEffort: S

Why this matters

Your site is missing a robots.txt file. Search engine crawlers look for this file to understand which pages they can and cannot access. This affects how clearly search engines understand the page and how persuasive it looks in search results.

Webflow fix path

How to fix this on Webflow

Use page settings, Designer, or project settings.

  1. 1Locate the element or setting causing the issue.
  2. 2Update it in Webflow.
  3. 3Publish and validate the output.

After you fix it

  • Navigate to /robots.txt and confirm it returns a 200 response with valid directives

See every Webflow issue on your site

This is one issue of many the full audit checks. Run a free scan to see what else might be holding your site back.

Run Free Audit