User-agent: * Disallow: /cgi-bin Disallow: /configuration Disallow: /config Disallow: /*.doc$ Disallow: /*.pdf$ Disallow: /*.wpd$ Disallow: /*.psd$ Disallow: /~$ Disallow: /archived Disallow: /webteam Disallow: /development