May 2015 - Koha-devel - lists.koha-community.org

search speed
by Gaetan Boisson 29 May '15

29 May '15

Hello again all, looking at speed issues there is one thing that i don't understand, and i feel some well versed developpers might have a better idea of what is happening. If you query zebra directly on the server, it's blazingly fast, no matter how big your database and how many results you get. (At least the difference is negligible, and we still get very low response times.) But if you do a search in Koha that brings 20 000 results, it's usualy 4 times faster (maybe more, sorry i don't have precise metrics here) than a search that brings up 1 000 000 results. Is it consistent with your experience? If it is, what would be the reason for this? My understanding is that the search code asks zebra for the first n records to display on the first page, and that facets are based on a number of result way below 20 000 anyway, so the total number of results shouldn't really make a difference. -- Gaetan Boisson Chef de projet bibliothécaire BibLibre 06 52 42 51 29 108 avenue Breteuil 13006 Marseille gaetan.boisson(a)biblibre.com

6 7

getFrameworkLanguages
by Mark Tompsett 28 May '15

28 May '15

Greetings, Indranil Das Gupta found this painful to see typo in getFrameworkLanguages: 'native_descrition'=>$language_set->{language_native_description}. I told him, tweaking C4/Languages requires writing a test (good rule of thumb). So, I wake up, and discover no tests were yet written, and I was itching for a sign off. So, I attempt and discover the hole is deeper than initially thought. In fact, Indranil Das Gupta pointed out to me that it doesn't seem to be used anywhere. mtompset@debian:~/kohaclone$ git grep getFrameworkLanguages C4/Languages.pm: memoize_memcached('getFrameworkLanguages' , memcached => C4::Context->memcached); Part of an export -- C4/Languages.pm: &getFrameworkLanguages More exporting -- C4/Languages.pm: @EXPORT_OK = qw(getFrameworkLanguages getTranslatedLanguages getAllLanguages getLanguages get_bidi regex_lang_subtags language_get_description accept_language getlanguage); POD stuff -- C4/Languages.pm:=head2 getFrameworkLanguages POD stuff example -- C4/Languages.pm: my $languages = getFrameworkLanguages(); Actual function head -- C4/Languages.pm:sub getFrameworkLanguages { As you can tell I didn't comment on one piece: that memoize_memcached line. Is there another thing to trace to figure out if it is used in the memoize logic somewhere, or is it safe to remove this function? Feedback appreciated. What bug 14284 becomes is dependent on feedback. http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=14284 GPML, Mark Tompsett

5 5

Call for Dev Meeting June 3
by Tomas Cohen Arazi 28 May '15

28 May '15

Hi everyone, starting the 3.22 cycle i'd like to keep a 3-week frecquency for dev meetings. Lots of big stuff is being worked by different people/teams so having a regular/deterministic schedule for the meetings might be handy to keep communicated. Next meeting will be held next wednestady, with the already used two-session schema. The agenda will look short at first sight, but we all know it is not :-D http://wiki.koha-community.org/wiki/Development_IRC_meeting_3_June_2015 =Short= Day: June 3 2015 Time: - Part 1: 15:00 UTC - Part 1: 22:00 UTC All comments are welcome. -- Tomás Cohen Arazi Prosecretaría de Informática Universidad Nacional de Córdoba ✆ +54 351 5353750 ext 13168 GPG: B76C 6E7C 2D80 551A C765 E225 0A27 2EA1 B2F3 C15F

1 0

Re: [Koha-devel] search speed
by Paul A 28 May '15

28 May '15

At 07:52 AM 5/28/2015 -0300, Tomas Cohen Arazi wrote: >El 28/5/2015 4:43 a. m., "Fridolin SOMERS" <fridolin.somers(a)biblibre.com> >escribiÃ³: > > > > Could this mean one should not get records from Zebra but directly from > database ? If getting the id of search results without getting the full > record is possible. > >It is possible. But we should evaluate the trade-off from preparing the >record for display too. Because for indexing we do lots of stuff to the >record, stuff that should be done on rendering time with such a change. Interesting. The rendering is only on 20 records, while the search is on tens or hundreds of thousands of records. It would obviously be a major exercise, but the trade-off would be enormous *if* it avoids the overload on the single core of the CPU (multi-threading across cores is, from what I was able to found out, just an impossible dream.) Facets are a search enhancement with enormous potential, but when the time required increases from a few tenths of a second to 20 seconds+, we felt we could not put it into production -- our users tend to want "instant gratification." Best -- Paul > > > > Le 27/05/2015 21:02, Paul A a Ã©crit : > >> > >> At 08:29 PM 5/27/2015 +0200, Gaetan Boisson wrote: > >>> > >>> Well as i said, the time is not the same depending on the number of > >>> results, but in both cases, the number of results is anyway much > >>> higher than the number of records taken into consideration for facets. > >>> > >>> Your investigation indicates that: > >>> > >>> In ZOOM->record, the time is spent in > >>> Â my $_rec = Net::Z3950::ZOOM::resultset_record($this->_rs(), $which); > >>> > >>> Maybe it's worth having a deeper look in this. > >> > >> > >> I looked into this to some extent in January this year; facets in 3.18 > >> <http://navalmarinearchive.com/z_koha/search_speed_data.html> appeared > >> to be a limiting factor as it "swamped" one CPU core (and NYProf showed > >> this to be from ZOOM - see > >> <http://navalmarinearchive.com/z_koha/nytprof_318_s/index.html> > >> > >> Regards -- Paul > >> > >> > >>> Le 27/05/2015 12:56, Jonathan Druart a ÃÂ©crit : > >>>> > >>>> Gaetan, > >>>> have a look at the metrics on bug 13665. > >>>> > >>>> 2015-05-27 11:45 GMT+01:00 Gaetan Boisson <gaetan.boisson(a)biblibre.com>: > >>>>> > >>>>> Â Hello again all, > >>>>> > >>>>> looking at speed issues there is one thing that i don't understand, > >>>>> and i > >>>>> feel some well versed developpers might have a better idea of what is > >>>>> happening. > >>>>> > >>>>> If you query zebra directly on the server, it's blazingly fast, no > >>>>> matter > >>>>> how big your database and how many results you get. (At least the > >>>>> difference > >>>>> is negligible, and we still get very low response times.) > >>>>> > >>>>> But if you do a search in Koha that brings 20 000 results, it's > >>>>> usualy 4 > >>>>> times faster (maybe more, sorry i don't have precise metrics here) > >>>>> than a > >>>>> search that brings up 1 000 000 results. > >>>>> > >>>>> Is it consistent with your experience? > >>>>> > >>>>> If it is, what would be the reason for this? My understanding is > >>>>> that the > >>>>> search code asks zebra for the first n records to display on the > >>>>> first page, > >>>>> and that facets are based on a number of result way below 20 000 > >>>>> anyway, so > >>>>> the total number of results shouldn't really make a difference. > >>>>> > >>>>> -- > >>>>> Gaetan Boisson > >>>>> Chef de projet bibliothÃÂ©caire > >>>>> BibLibre > >>>>> 06 52 42 51 29 > >>>>> 108 avenue Breteuil 13006 Marseille > >>>>> gaetan.boisson(a)biblibre.com

1 0

Install Koha 3.20 with Single Command at Ubuntu 14.04 LTS
by DP Tripathi 28 May '15

28 May '15

Dear All, Greetings! Now, Install Koha 3.20 with one single command at Ubuntu 14.04 LTS Just follow the instructions. I assume that you have installed Ubuntu 14.04 LTS in your system and it is connected with Internet. Step 1: First download the file at www.librarianguide.co.in/install_koha.sh Step 2: Wherever you keep the file, just give permission with following command. I assume the file is at /home/library root@nitr/home/library# chmod +x install_koha.sh (press enter) root@nitr/home/library# ./install_koha.sh (press enter) It will start installation. Just follow the instruction and provide necessary inputs. Step 3: After installation of everything it will open window with nano editor. Just change the port in Intranet (8000), save (ctrl+x). Now, it will open Firefox automatically with Koha Web Installer. User Name: koha_library Password: Note down the password from (/etc/koha/sites/library/koha-conf.xml) file. The password will be at the bottom of file in <config> section. Enjoy Koha! Thanks, DP Tripathi NIT Rourkela

4 3

How to get CAS based Single Sign On working?
by Koustubha Kale 25 May '15

25 May '15

Hi All, I have a situation where we have a main website based on Joomla. This Joomla site uses CAS to authenticate users. We would like users ( who have already logged in to the Joomla site via CAS) to be able to follow a link to Koha site and be logged in automatically ( e.g. Single Sign On ). I have got simple CAS ( not proxy CAS ) working with Koha ( version 3.2.6 ) using the same CAS server as used by Joomla site. Still when I login to Joomla site with CAS, and then go to Koha and click on login and follow the CAS login link, I am asked to fill up CAS login information again. How can this be avoided by using CAS SSO? I have read through http://wiki.koha-community.org/wiki/SSO_CAS_improvements and am confused by the statement "Note: simple sso cas support (no proxy) has been done already by biblibre, is in testing and should be released in Koha 3.2" in there. Does this statement mean that SSO is possible with simple CAS? If yes how to set it up? If not, I have also read through bugs 6012, 5630 and the CAS Proxy examples. Frankly I haven't been able to figure out how I can achieve the above required functionality based on all the reading. Any help is much appreciated.. Another related query is, Is it possible to automatically create users in Koha once they have authenticated with CAS? Regards, Koustubha Kale Anant Corporation Contact Details : Address : 103, Armaan Residency, R. W Sawant Road, Nr. Golden Dyes Naka, Thane (w), Maharashtra, India, Pin : 400601. TeleFax : +91-22-21720108, +91-22-21720109 Mobile : +919820715876 Website : http://www.anantcorp.com Blog : http://www.anantcorp.com/blog/?author=2

3 3

[CROSS-POST] does the language sw[itcher really need that much screen real estate?
by Indranil Das Gupta 25 May '15

25 May '15

Hi, The language switcher takes up a lot of space at the bottom. it also had issues of being not always visible (http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11057) Is there a specific design / UX issue (that I may be unaware of) why it is not implemented as a simple drop down from the masthead toolbar? thanks :) -- Indranil Das Gupta Phone : +91-98300-20971 Blog : http://indradg.randomink.org/blog IRC : indradg on irc://irc.freenode.net Twitter : indradg -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-==-=-=-=-=-=-=-=-=- Please exchange editable Office documents only in ODF Format. No other format is acceptable. Support Open Standards. For a free editor supporting ODF, please visit LibreOffice - http://www.documentfoundation.org

3 3

SQL Reports Library v2.0
by Pablo Bianchi 19 May '15

19 May '15

Hi, I count more than 300 reports on *SQL Reports Library*, is getting a little bit out of control. Become difficult to: + found the needed report, + tag them, + talk about the report, + track easily contributions to each one, + link "related" reports, different flavors of the same one, + vote them, + add easily to Koha, + get statistic information, and much more. I'm not sure what is the best solution. An ad hoc web development? A friend suggest me Semanticscuttle <http://semanticscuttle.sourceforge.net/>. Trying to at least make things more tidy I create: SQL Reports Library in templates <http://wiki.koha-community.org/wiki/SQL_Reports_Library_in_templates> (equivalent to the usual but using mediawiki templates). This use Template:Report <http://wiki.koha-community.org/wiki/Template:Report>. Some things happens (or will happen) with JQuery and SQL libraries: A wiki page is not a good library/database. Regards, Pablo

4 5

Dev meeting to talk about the upcoming release: May 19th
by Tomas Cohen Arazi 19 May '15

19 May '15

I'd like you to join the next meeting. It will be focused, exclusively, on Koha 3.20. It will probably be a short meeting, unless something happens before the meeting that needs broader discussion. Kind regards Link: http://wiki.koha-community.org/wiki/Development_IRC_meeting_19_May_2015 -- Tomás Cohen Arazi Prosecretaría de Informática Universidad Nacional de Córdoba ✆ +54 351 5353750 ext 13168 GPG: B76C 6E7C 2D80 551A C765 E225 0A27 2EA1 B2F3 C15F

2 2

Plugin marc21_linking_section.pl
by Marcel de Rooy 18 May '15

18 May '15

Hi all, Is anyone of you using this plugin? I can launch it, search for a record. But if I click the Choose button, nothing happens. (I would expect to get back something into the field that launched the plugin.) If you use it, please let me know what I am doing wrong :) See also bug 13437 which makes some changes to various marc21 plugins including this one. Thanks, Marcel

3 3