# stops robots & web worms, etc. looking in certain places User-Agent: * Disallow: /cgi-bin/ Disallow: /GIFS/ Disallow: /icons/ Disallow: /usage/ Disallow: /manual/ Disallow: /INTERNET/ Disallow: /INTRANET/ Disallow: /soc_intranet/ Disallow: /noc_intranet/ Disallow: /noc_intramet/ Disallow: /NCS/PEOPLE/BRUCE/ Disallow: /myadmin Disallow: /phorum Disallow: /egroupware Disallow: /mrbs/ Disallow: /sbbs/ Disallow: /soes/images/banners/ Disallow: /vacancies/polls/ Disallow: /vacancies/scores/ Disallow: /content/ Disallow: /soes/images/banners/ Disallow: /soes/staff/bets/ Disallow: /dcuk/magpie/cache/ Disallow: /voa/ Disallow: /oceanstewardship/register/