Control Access to Your Site
Block or allow access with robots.txt
Blocking your entire site
Dapper's user agent is DapperBot. to block your entire site put this in you robots.txt:
User-agent: DapperBot
Disallow: /
Blocking only certain directories
Example:
User-agent: DapperBot
Disallow: /private/
Disallow: /search/
Disallow: /temp/
Allowing Dapper to access your site
Add the "Allow" command to your robots.txt, like this:
User-agent: DapperBot
Allow: /