# robots.txt for gecensus.stanford.edu User-agent: * Disallow: /cgi-bin Disallow: /webalizer Disallow: /alternate