# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: * Disallow: /search/do_search Disallow: /comments Disallow: /nodes Disallow: /links Disallow: /recent_comments Disallow: /user_session/new Disallow: /account/new Disallow: /password_resets/new