# This tells the robots to explore all the site # Now added cal stuff, local and the stats page User-agent: * Disallow: /local/ Disallow: /sys/ Disallow: /server-status Disallow: /webcal/ Disallow: /ssh/ Disallow: /mail/