# Do not crawl these files

User-agent: *
Disallow: /admin/
Disallow: /membersonly/
Disallow: /documentation/
Disallow: /db/