# exclude help system from robots User-agent: * Disallow: /tools/ Disallow: /kundendb/ Disallow: /update/ Disallow: /.mc/ Disallow: /.w3m/ Disallow: /test/ Disallow: /statistik/ # but allow htdig to index our doc-tree User-agent: susedig Disallow: # disallow stress test #user-agent: stress-agent #Disallow: /