# All robots will spider the domain User-agent: * Disallow: # Disallow directory /images User-agent: * Disallow: /images Disallow: /Scripts Disallow: /documents Disallow: /formfiles