User-agent: * Disallow: /adserver/ Disallow: /ads/ # Allow only specific directories User-agent: Teoma Disallow: /adserver/ Disallow: /ads/