[Koha-bugs] [Bug 11190] sitemap.pl -- Generate a Catalog sitemap

[bugzilla-daemon at bugs.koha-community.org]

http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11190

--- Comment #31 from Frédéric Demians <frederic at tamil.fr> ---
(In reply to Paul Poulain from comment #28)
> Additional (final ?) comment: there is no changefreq definition. I can't
> find the default value if you don't specify it, but I think that a monthly
> or even yearly changefreq is better for a search engine 

The web crawlers download the sitemap files at an unknown frequency, and then
compare the recent URL with the previous one, based on url's timestamp. Even if
the sitemap is updated on the Koha server daily, the crawlers won't download it
daily.

> (and be careful, for
> large catalogue, if we put a too frequent period, the server will be crashed
> by multiple requests. We had to disallow search engines using robots.txt on
> many libraries !

A sitemap helps crawlers not to be lost in a Koha catalog. Does it slow down
requests sent by crawlers, we can't say or know. Empirically, I would say yes,
but there is no way to be sure. Crawlers seem less tempted to follow multiple
links at a rapid pace.

-- 
You are receiving this mail because:
You are watching all bug changes.