Robots.txt Generator

robots.txt Generator

Create a valid robots.txt file for your website in seconds

Your website (optional – only for comment)

Apply preset for

Default rule for all crawlers (User-agent: *)

Allow Disallow

Add specific path rules

# robots.txt preview will appear here