User-agent: * Disallow: /manager/ Disallow: /__cache_WTB_AJAX.php #Disallow: /private_directory/ #Disallow: /private_file.html