AI-readable service summary
Robots.txt Tester
Preview robots.txt allow and disallow behavior for sample paths in your browser before publishing crawl rules.
- Category
- SEO
- Privacy model
- No crawler or remote fetch; only pasted text is evaluated.
- Limitations
- Practical previewer for common rules, not a full crawler compliance test.
Best for
- Checking crawl rules before deploy
- Finding accidental blocks
- Explaining allow/disallow conflicts
Inputs
- robots.txt rules
- User agent
- Sample paths
Outputs
- Allowed/blocked path preview
- Matching rule
- Copyable summary