[Koha-bugs] [Bug 4042] Public OPAC search can fall prey to web crawlers

[bugzilla-daemon at bugs.koha-community.org]

http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=4042

Fred P <fred.pierre at smfpl.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |fred.pierre at smfpl.org

--- Comment #1 from Fred P <fred.pierre at smfpl.org> 2012-02-13 15:46:58 UTC ---
Very cool. We were experiencing slow-downs related to Google searches. Much of
our catalog was visible on Google, by searching the library name and book
title. We used robots.txt to effectively block googlebots.

However Baidu spiderbots from China continue to plague us from time to time.
Using the robots.txt helped, but did not completely solve the problem, although
it seems to have decreased the frequency.

We also get hit with port scans through the koha-tmpl directory (maps to
root?), although our security seems to be strong enough to resist those.

A system preference option would help us. Thanks for your hard work!

-- 
Configure bugmail: http://bugs.koha-community.org/bugzilla3/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA Contact for the bug.
You are watching all bug changes.