[Koha-bugs] [Bug 4042] Public OPAC search can fall prey to web crawlers

[bugzilla-daemon at kohaorg.ec2.liblime.com]

http://bugs.koha.org/cgi-bin/bugzilla3/show_bug.cgi?id=4042





--- Comment #3 from Rick Welykochy <rick at praxis.com.au>  2010-01-14 01:02:45 ---
1. robots.txt only influences law-abiding crawlers.

2. Allowing GET searches from outside means that people could save
search URLs on their pages or bookmarks. When a private crawler or link
checker sees this search URL, it might do a fetch without checking
robots.txt. In general public GET URLs that do a significant amount of
work are problematic.


-- 
Configure bugmail: http://bugs.koha.org/cgi-bin/bugzilla3/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are watching all bug changes.