- Koha-devel - lists.koha-community.org

Re: [Koha] Zebra Indexing Problems
by Mueller, Christine, DCA 04 Feb '08

04 Feb '08

Please forgive reposting. Message below originally sent Feb 01, 2008; 05:04pm but it appears in Nabble as a reply to message with subject "Problem with misc/sax_parser_print.pl" ======================================================= Environment: Koha 3 Alpha / Ubuntu 7.1.0 / Zebra 2.0.24 ** was Zebra 2.0.26 ** / Mac-Tel Hardware / MARC21 Some of our problems decribed in original message below have been resolved by replacing Zebra 2.0.26 with Zebra 2.0.24 -- OPAC searching works again. John Chadwick, our Information Technology Manager, has reported the Zebra 2.0.26 problem as Bugzilla Bug #1811. Answers etc. to Joshua's questions in reply to my original message: -- Zebraqueue daemon running -- Make target used = standard -- Biblio that was still indexed after deletion from database had been deleted using the "staff client" API [biblioitem deleted first, then biblio]; this problem cleared when we reverted to Zebra 2.0.24 and rebuilt the zebra indexes -- but, now when we attempt to delete different biblioitem and biblio from database (using API) the "delete" options are grayed-out. -- After reverting to Zebra 2.0.24 we still have a delay in indexing. What is norm time between adding a new biblio and it being indexed, without our having to rebuild the index? -- We also had a problem with deleting a patron record using the "staff client" API. We could not delete record using MS Internet Explorer, but were able to delete it using Firefox. -- More details on loss of directories when server is rebooted. This is method used to recreate directories which are wiped out: In the directory /var/run there needs to exist the following directories (owner and group KOHA). So: sudo mkdir koha sudo chown koha koha sudo chgrp koha koha cd koha Repeat the above process only substitute zebradb sudo chmod 777 * Now, cd /var/lock sudo mkdir koha sudo chown koha koha sudo chgrp koha koha cd koha Repeat the above process only substitute zebradb Now, make two directories that will be empty. One is biblios and one is authorities. sudo chmod 777 * ........................ Any suggestions on how to improve speed of indexing and how to reboot server without loosing directories greatly appreciated! Christine Mueller Database Administrator Office of Information Technology New Mexico State Library 1209 Camino Carlos Rey Santa Fe, NM 87507 Phone: 505-476-9744 christine.mueller@... <http://www.nabble.com/user/SendEmail.jtp?type=post&post=15237923&i=0> http://www.stlib.state.nm.us/ ====================================================== Re: [Koha] Zebra Indexing Problems by Joshua Ferraro-3 Jan 31, 2008; 08:02am Hi Christine, On 1/30/08, Mueller, Christine, DCA <Christine.Mueller@...> wrote: > > > Environment: Koha 3 Alpha / Ubuntu 7.1.0 / Zebra 2.0.26 / Mac-Tel Hardware / > MARC21 > > No experience with Koha 2.x; our goal is to become familiar with Koha while > waiting for Koha 3 Beta Good plan :-) > Problems with Zebra Indexing: > > > > 1) When biblio and biblioitem deleted from database data remained in > Zebra indexes and search results displayed link to biblio which was no > longer in database, even after indexes rebuilt. - How to prevent? Could you clarify how you deleted data from the database? Did you use the API, or directly query the RDBMS? Do you have the zebraqueue daemon running? > > > 2) Sometimes new biblios would not be indexed for 20-30 minutes and > other times Zebra indexes would need to be rebuilt to force indexing of new > biblios. - Any suggestions for solving delayed indexing problem? Do you have the zebraqueue daemon running? > 3) When Zebra server is restarted Zebra directories are missing and > must be restored. - How can server be restarted without deleting > directories? Hmm ... that's very strange ... which make target did you use? standard, dev? > 4) Today searching no longer works at all. Zebra server was restarted, > missing directories were restored and indexes were rebuilt. Biblios and > biblioitems are still in the database. - Any suggestions for restoring > search function *without* reinstalling Zebra? i think we need to figure out why your zebra directories are disappearing ... > 5) If we want to export the biblios and biblioitems (less than 25 at > this time) in the database to create a backup file in case we need to do a > total reinstall of Koha and Zebra are there any "gotchas" or best practices? The MARC data is stored as a blob in biblioitems, so you could just mysqldump that table ... there are also some utilities in the interface in Tools -> Export Bibliographic and Holdings Data; as well as some command line tools that do the same thing in misc/ directory. So ... we need to figure out why your zebra configuration isn't working well, could you tell us a bit more about your environment? Also, I'd suggest we take this discussion to the koha-devel list where more of the technical questions tend to get hashed out (I've CCed your question to that list). Here's the list info: http://lists.nongnu.org/mailman/listinfo/koha-devel Cheers, -- Joshua Ferraro SUPPORT FOR OPEN-SOURCE SOFTWARE President, Technology migration, training, maintenance, support LibLime Featuring Koha Open-Source ILS jmf@... |Full Demos at http://liblime.com/koha |1(888)KohaILS Confidentiality Notice: This e-mail, including all attachments is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited unless specifically provided under the New Mexico Inspection of Public Records Act. If you are not the intended recipient, please contact the sender and destroy all copies of this message. -- This email has been scanned by the Sybari - Antigen Email System.

1 0

zebra server Koha 3.0
by Chadwick, John, DCA 04 Feb '08

04 Feb '08

I am on my third Koha 3.0 box. We are installing Koha 3 on Mac Minis (Intel duo core processors) running Ubuntu 7.10. The first two installations went in with no problems. The third is giving me grief. I get through the install and when I try to start the zebra server I get a command not found error: $ sudo /usr/share/koha/bin/koha-zebra-ctl.sh start Starting Zebra Server /usr/share/koha/bin/koha-zebra-ctl.sh: line 18: daemon: command not found Here is line 18: daemon --name=$NAME --errlog=$ERRLOG --stdout=$STDOUT --output=$OUTPUT --verbose=1 --respawn --delay=30 --user=$USER.$GROUP -- $ZEBRASRV -f $KOHA_CONF I also get the same issue when starting the zebraqueue server (line 20 instead of line 18). Any ideas on this one? Thanks, John +----------------------------------------------------------------------- -----+ John Chadwick, Ed.D. Information Technology Manager New Mexico State Library 1209 Camino Carlos Rey Santa Fe, NM 87507 Phone: 505-476-9740 Cell: 505-629-8116 Fax: 505-476-9761 john.chadwick(a)state.nm.us http://www.stlib.state.nm.us Confidentiality Notice: This e-mail, including all attachments is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited unless specifically provided under the New Mexico Inspection of Public Records Act. If you are not the intended recipient, please contact the sender and destroy all copies of this message. -- This email has been scanned by the Sybari - Antigen Email System.

2 2

Beta a few days late
by Joshua Ferraro 04 Feb '08

04 Feb '08

Hi folks, You probably noticed, I'm running a few days behind on the beta release of 3.0 -- there were just a couple of issues I'm wrapping up w/respect to the translations that turned out to be a bigger job than originally anticipated, the result should be a nice mechanism for enabling and disabling specific translations, rather than being stuck with 28 language choices on every page :-). So ... stay tuned, it'll be ready shortly. Cheers, -- Joshua Ferraro SUPPORT FOR OPEN-SOURCE SOFTWARE President, Technology migration, training, maintenance, support LibLime Featuring Koha Open-Source ILS jmf(a)liblime.com |Full Demos at http://liblime.com/koha |1(888)KohaILS

1 0

Good luck and Goodbye !!!1
by tarallo＠ort.edu.uy 04 Feb '08

04 Feb '08

Nearly four years ago I was introduced in the world of libraries from the ILS programmer point of view. Without prior experience with libraries or library automation this comunity was extremely helpfull and receptive. Since mid 2005 a working Koha Installation serves Universidad ORT Uruguay. Now, I'm leaving Universidad ORT, and started working for an AgroIndustrial Company. Different challenges, welcome new challanges !!!! If you want to contact me, or have interesting proposals, feel free to contact me at atarallo(a)acm.org Godspeed, see you Andrés Tarallo -- A/P Andrés Tarallo

1 0

a charmed letter about characters....
by Ignacio Javier 31 Jan '08

31 Jan '08

Hi all, I'm stuck on a **madness bubble**, in Koha 3 i18n. I've trying to import ISO records that use the upper part of 8 bit ASCII(latin1), and I've found that drives to an important warning: [Thu Jan 31 18:28:46 2008] import.pl: no mapping found for [0xCD] at position 23 in / Manuel Murguía; MURGUÍA, Manuel; g0=ASCII_DEFAULT g1=EXTENDED_LATIN at /usr/local/share/perl/5.8.8/MARC/Charset.pm line 210, <fh000011201706011.mrc> line 1. ...that result in not recognition of latin characters when imported Seems that g0 and g1 are reckon OK, the input encoding of the MARC record is in 8-bit ASCII extended, but the imported record is not imported correctly!!! In Koha.pm is the butter: sub FixEncoding { my $marc=shift; my $record = MARC::Record->new_from_usmarc($marc); #HERE<<<******** We are using MARC21. The rare part is the MARC::Charset issue, [0xCD] is latin1 OK, where is the problem? USMARC has not mapping for extended latin 1 chars? What perl module::method should I use for decoding MARC? Thanks in advance! Ignacio Javier Gómez Rodríguez Analista - Programador Tfno: 902905590 - Fax: 981571425 ignacio.gomez(a)coremain.com www.coremain.com

2 2

Reservation
by C W Nel 30 Jan '08

30 Jan '08

Can someone please tell me if a reservation is handled only by biblionumber and not by ISBN at all? Thanks

1 0

Authorities indexing
by Galen Charlton 29 Jan '08

29 Jan '08

Hi, I have been doing some work with the (Zebra) indexing definitions for MARC21 authority records. One of the current problems is that it is impossible to effectively search on the complete heading if subdivisions are present. For example, a topical heading such as 150 $a Medicine $x Ability testing is currently indexed as two separate phrases, "Medicine" and "Ability testing". A search for "medicine ability testing" doesn't work, and searching on the two phrases separately (he,ext=medicine and he,ext="ability testing") would also pick up a "ability testing -- medicine" heading if such existed in the authority file. I have found no way to fix this using Zebra's GRS-1 filter and its elm and melm directives in records.abs. Consequently, I have been working with Zebra's DOM XML filter, which generates index entries by mapping a MARC XML record to index terms via XSLT, and have been able to get much better results. Two patches containing the XSLT can be found at http://manage-gmc.dev.kohalibrary.com/patches/ Since manually maintaining the whole indexing XSL would be rather unwieldy, I've created a concise XML representation of the indexing definitions, authority-koha-indexdefs.xml. This in turn is mapped via the XSL transform koha-indexdefs-to-zebra.xsl to produce the XSL to be used by Zebra, authority-zebra-indexdefs.xsl. I have not yet made a formal schema for the Koha indexing definitions XML, but once its syntax has been extended to cover UNIMARC and bibliographic records, this could be an approach to take to have all Zebra indexing use the DOM XML module. In addition, it opens the possibility of creating code tthat allows users to work with the Zebra indexing definitions from the staff interface -- the definitions could be stored in the database, then serialized to XML and transformed to the Zebra indexing XSLT. Comments requested. Regards, Galen -- Galen Charlton Koha Application Developer LibLime galen.charlton(a)liblime.com p: 1-888-564-2457 x709

1 0

[IMPORTANT] transfer & reserve problem/question (bug ?)
by Paul POULAIN 29 Jan '08

29 Jan '08

Hello world, The status of a book, in the result list of a query is given by the items.onloan (952$q in marc21 if I don't mind). This field let Koha know wether the book is available or issued. If 952$7 -notforloan-, $1 -itemlost-, $0 -wthdrawn is set, the status will be correctly displayed. but what if a book is being transfered and/or reserved. Actually, the book is displayed as "available", which is wrong (unless i've missed some parameter someone will point ;-) ) imo, a book being transfered should display "1 item being transfered from X to Y" (in staff interface) and "Not available" (in opac) a book reserved should be displayed likely. The SAN-OP has this feature in it's specific 3.0 version, running live since 1 year now, and it display those information. How could we reintroduce this behaviour ? the easiest solution would be, in to introduce a test for that in C4/Search.pm/sub searchResults. what do you think of this solution ? Another one would be to have new fields in items table, to store a transfer or a reserve, but I think it's too complex. -- Paul POULAIN BibLibre SARL Expert en Logiciels Libres pour l'info-doc Tel : 04 91 31 45 19

2 3

Circulate by callnumber
by Jose Miguel Parrella Romero 28 Jan '08

28 Jan '08

Greetings, I've been told it's considered near-sacrilegy, but I would like to write a patch for Koha that allows staff to circulate items by callnumber. AFAICT it's only possible to do so using the item barcode, which might be a problem for items migrated from ILS that didn't allow/weren't used to store barcodes for each item, or simply for items that don't have barcodes and circulate. I modified the template and the circulation.pl script in order to handle an additional callnumber variable, and then I went on to modify issuebook and canbookbeissued from Circ2.pm, including the SQL query for the item information. However, I keep getting EXPIRED and NO_MORE_RENEWALS error messages and of course the item does not get circulated. I also think this might not be the right way, and maybe somebody else can provide some pointers on the expected behavior and what you do in these cases. Jose

2 2

Native Koha 3 Support for Win32 Installation Project
by Chris Nighswonger 27 Jan '08

27 Jan '08

Hi all, Some time back in December I started toying with installing Koha 3 on Windows XP using the Koha installer and Strawberry Perl 5.8.8. Several have asked about it so here is the latest. The attached Open Office document gives more grueling details. I made some modifications to Makefile.PL to detect the Win32 platform and went to work installing the required Perl modules. The larger part of them installed fine via cpan, but a half dozen or so did not. With Galen Charlton's help, I have made some progress. There are five (six w/Schedule::AT) modules which are yet to be compiled/installed on Win32 using Strawberry (versions may be bad due to an old copy of Makefile.PL): [Wed Jan 23 06:58:50 2008] Makefile.PL: Warning: prerequisite DBD::mysql 3.0008 not found. [Wed Jan 23 06:58:56 2008] Makefile.PL: Warning: prerequisite MARC::File::XML 0.88 not found. [Wed Jan 23 06:59:11 2008] Makefile.PL: Warning: prerequisite XML::Dumper 0.81 not found. [Wed Jan 23 06:59:11 2008] Makefile.PL: Warning: prerequisite XML::LibXSLT 1.63 not found. [Wed Jan 23 06:59:11 2008] Makefile.PL: Warning: prerequisite XML::RSS 1.31 not found. I *think* that XML::Dumper and XML::RSS will install once XML::LibXSLT is installed. Zebra remains to be installed and tested. The attachements to this email include: 1. A document detailing what I have accomplished so far. 2. Two files references in the document. This is very much a side project for me as I really have no interest in running Koha 3 on Win32 except to say I did it. :-) Any help would be greatly appriciated. Maybe someone out there with a lot of C++ experience can get libxslt working as this is the real blocker right now. Comments and criticisms welcome. Regards, Chris PS. I plan on adding the included summary to the wiki so that anyone can update it as work progresses. -- Chris Nighswonger Faculty Member Network & Systems Director Foundations Bible College & Seminary www.foundations.edu www.fbcradio.org

1 3