Robots.txt Tester

Robots.txt files are a powerful way to control how search engines and AI bots access your site: which bots are allowed, which are not, and in which directories. This tool reads your robots.txt file and makes sure its syntax is correct (don't worry, we won't modify it). The tool also provides a plain-English summary of the rules found, so you can verify they are as expected. Enter your or any site URL and see the results below.