https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=4042 --- Comment #8 from José Anjos <joseanjos@gmail.com> --- I would suggest that robots.txt like the one in comment 3 should come with fresh installs. Firstly because most times people don't realize that the koha performance are affected by that until it crashes. Secondly because some bots take longer to stop like: https://www.semrush.com/bot/ "Please note that there might be a delay up to two weeks before SEMrushBot discovers the changes you made to robots.txt" -- You are receiving this mail because: You are the QA Contact for the bug. You are watching all bug changes.