[Koha-bugs] [Bug 4042] Public OPAC search can fall prey to web crawlers

[bugzilla-daemon at bugs.koha-community.org]

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=4042

--- Comment #8 from José Anjos <joseanjos at gmail.com> ---
I would suggest that robots.txt like the one in comment 3 should come with
fresh installs. Firstly because most times people don't realize that the koha
performance are affected by that until it crashes.
Secondly because some bots take longer to stop like:
https://www.semrush.com/bot/
"Please note that there might be a delay up to two weeks before SEMrushBot
discovers the changes you made to robots.txt"

-- 
You are receiving this mail because:
You are the QA Contact for the bug.
You are watching all bug changes.