# All robots will spider the domain User-agent: * Disallow: # Disallow directory /ftp/ User-agent: * Disallow: /ftp/ # Disallow directory /stock_photos/ User-agent: * Disallow: /stock_photos/ # Disallow directory /manager/ User-agent: * Disallow: /manager/