User-agent: * # all spiders Disallow: /nst_404.htm Disallow: /nst_ant.htm Disallow: /nst_best.htm Disallow: /nst_besa.htm