# robots.txt # disallow blogs directories that shouldn't be spidered - May 2, 2007 (kgerich) User-agent: * Crawl-delay: 10 Disallow: /news/xml # old redirects...don't want spiders following them Disallow: /blogs/aggregator Disallow: /blogs/tracker Disallow: /blogs/comment/reply Disallow: /blogs/node/add Disallow: /blogs/files Disallow: /blogs/search Disallow: /blogs/book/print Disallow: /comments Disallow: /s/pages/static/newsletter-signup-form Disallow: /s/article/print Sitemap: http://www.computerworld.com/spring/sitemap-service.htm?command=index