User-agent: Scooter Disallow: /html/ Disallow: /ISsearch/ Disallow: /btlive.htm # The purpose of this file is to disallow AltaVista to crawl into the html directory # Always check robots.txt syntax at: http://www.tardis.ed.ac.uk/~sxw/robots/check/