Clay Fouts a écrit :
> I've discovered that a web crawler was opening up large numbers of<snip>
> simultaneous requests for the RSS/Atom feed.
> If anyone can suggest a solution that can keepcouldn't a robots.txt do the job ?
> the system stable while not removing functionality, please let me
> know.
>