# Robots.txt # For domain: http://www.smartad.no # All robots will spider the domain User-agent: * Disallow: