# All robots will spider the domain User-agent: * Disallow: /nwu/changeset/ Disallow: /nwu/query Disallow: /nwu/login Disallow: /nwu/log/ Disallow: /nwu/browser/