# Robots.txt for www.Descentforum.NET # by Do_Checkor, 2008-05-13 # we only allow a very few spiders to scan the forums because of server load. # if you want to contact me: mail robots.txt AT descentforum.net User-agent: Googlebot Disallow: /D3Server/ Disallow: /docheckor_de/ Disallow: /download/ Disallow: /missions/ Disallow: /images/ Disallow: /pics/ User-agent: w3index Disallow: /* Disallow: /docheckor_de/ User-agent: Lycos/x.x Disallow: /* Disallow: /docheckor_de/ User-agent: Lycos_Spider_(T-Rex) Disallow: /* Disallow: /docheckor_de/ User-agent: * Disallow: /* Disallow: / Disallow: /docheckor_de/