User-agent: * Disallow: /ajax/ Disallow:/images/ Disallow:/aspnet_client/ Disallow:/bmz_cache/ Disallow:/cache/ Disallow:/cgi-bin/ Disallow:/comments/ Disallow:/download/ Disallow:/editors/ Disallow:/email/ Disallow:/extras/ Disallow:/pub/