Online Tools Hub
Free, fast and browser-based utilities

Robots.txt Tester

Test whether a URL path is allowed or disallowed by a robots.txt file for a given user-agent.

About & How to Use

Paste your robots.txt content, enter a URL path and user-agent, and check whether that path would be allowed or blocked for crawling — useful before publishing your robots.txt.