@timbray has anyone thought of enhancing robots.txt to point to an atom/rss list of changed resources? http://www.robotstxt.org |
@timbray has anyone thought of enhancing robots.txt to point to an atom/rss list of changed resources? http://www.robotstxt.org |