🤖 Robots.txt Tester

Test your robots.txt rules — see if a URL is allowed or blocked for a crawler.