filebot/website/robots.txt

10 lines
187 B
Plaintext

User-agent: *
Disallow: /forums/ucp.php
Disallow: /forums/mcp.php
Disallow: /forums/member
Disallow: /forums/memberlist.php
Disallow: /forums/faq.php
User-agent: TurnitinBot
Disallow: /