Hie, do you have enougth space in /tmp ? You may use rebuild_zebra -x for marcxml use and -k for keeping the temporary files. 2011/11/14 Partha Mukhopadhyay <psm_vu@india.com>
Dear all,
I'm facing a problem in Zebra reindexing. In fact we entered a total of 21000 documents (manifestation) in our Koha setup (upgraded to 3.4). Somehow, a few documents are indexed by Zebra and as a result many of the records are not available for seraching. I followed the steps as below to solve the problem but it is still accessing only those records (no incraese in indexing base; roughly aroud 8000 records are processed by Zebra everytime).
commands used: -------------- 1. sudo zebraidx -c /etc/koha/zebradb/zebra-biblios.cfg -g iso2709 -d biblios init No problem reported
2. sudo zebraidx -c /etc/koha/zebradb/zebra-authorities.cfg -g iso2709 -d authorities init No problem reported
3. sudo KOHA_CONF=/etc/koha/koha-conf.xml PERL5LIB=/usr/share/koha/lib /usr/share/koha/bin/migration_tools/rebuild_zebra.pl -r -v -b
The screen goes in this way.....
psm@psm-laptop:~$ sudo KOHA_CONF=/etc/koha/koha-conf.xml PERL5LIB=/usr/share/koha/lib /usr/share/koha/bin/migration_tools/ rebuild_zebra.pl -b -r -v Zebra configuration information ================================ Zebra biblio directory = /var/lib/koha/zebradb/biblios Zebra authorities directory = /var/lib/koha/zebradb/authorities Koha directory = /usr/share/koha/intranet/cgi-bin BIBLIONUMBER in : 999$c BIBLIOITEMNUMBER in : 999$d ================================ skipping authorities ==================== exporting biblio ====================
1...............................................................................
101.............................................................................
201.............................................................................
301.............................................................................
401.............................................................................
501.............................................................................
<This way all records are done and then came the following>
00:56:07-14/11 zebraidx(4485) [log] add grs.marcxml.record /tmp/HcFKEQeESz/biblio/exported_records 1858559 00:56:07-14/11 zebraidx(4485) [log] add grs.marcxml.record /tmp/HcFKEQeESz/biblio/exported_records 1859288 00:56:07-14/11 zebraidx(4485) [log] Records: 1000 i/u/d 1000/0/0 00:56:07-14/11 zebraidx(4485) [log] More than 1000 file log entries. Omitting rest 00:56:16-14/11 zebraidx(4485) [log] Records: 2000 i/u/d 2000/0/0 00:56:25-14/11 zebraidx(4485) [log] Records: 3000 i/u/d 3000/0/0 00:56:36-14/11 zebraidx(4485) [log] Records: 4000 i/u/d 4000/0/0 00:56:46-14/11 zebraidx(4485) [log] Records: 5000 i/u/d 5000/0/0 00:56:58-14/11 zebraidx(4485) [log] Records: 6000 i/u/d 6000/0/0 00:57:10-14/11 zebraidx(4485) [log] Records: 7000 i/u/d 7000/0/0 00:57:23-14/11 zebraidx(4485) [log] Records: 8000 i/u/d 8000/0/0
<assume problem starts from here>
00:57:29-14/11 zebraidx(4485) [warn] Unknown register type: Subject 00:57:35-14/11 zebraidx(4485) [log] Records: 9000 i/u/d 9000/0/0 00:57:45-14/11 zebraidx(4485) [log] MARC: Bad directory 00:57:45-14/11 zebraidx(4485) [warn] MARC: Bad offsets in data. Skipping rest 00:57:45-14/11 zebraidx(4485) [warn] Record didn't contain match fields in (bib1,Local-number) 00:57:45-14/11 zebraidx(4485) [log] error grs.marcxml.record /tmp/HcFKEQeESz/biblio/exported_records 26009459 00:57:55-14/11 zebraidx(4485) [log] Merge 14.8% completed; 57 seconds remaining 00:58:05-14/11 zebraidx(4485) [log] Merge 34.1% completed; 38 seconds remaining 00:58:15-14/11 zebraidx(4485) [log] Merge 50.9% completed; 28 seconds remaining 00:58:25-14/11 zebraidx(4485) [log] Merge 66.1% completed; 20 seconds remaining 00:58:35-14/11 zebraidx(4485) [log] Merge 87.9% completed; 6 seconds remaining 00:58:42-14/11 zebraidx(4485) [log] Iterations: isam/dict 28751767/293156 00:58:42-14/11 zebraidx(4485) [log] Dict: inserts/updates/deletions: 293156/0/0 00:58:49-14/11 zebraidx(4485) [log] Records: 9785 i/u/d 9785/0/0 00:58:49-14/11 zebraidx(4485) [log] zebra_stop: 170.24 180.78 9.04 00:58:50-14/11 zebraidx(4495) [log] zebra_start 2.0.43 abd433d1a315576cf1f4a53f2c70365f9a76477f 00:58:50-14/11 zebraidx(4495) [log] config /etc/koha/zebradb/zebra-biblios.cfg 00:58:50-14/11 zebraidx(4495) [log] Loaded filter module /usr/lib/idzebra-2.0/modules/mod-grs-marc.so 00:58:50-14/11 zebraidx(4495) [log] Loaded filter module /usr/lib/idzebra-2.0/modules/mod-dom.so 00:58:50-14/11 zebraidx(4495) [log] Loaded filter module /usr/lib/idzebra-2.0/modules/mod-grs-xml.so 00:58:50-14/11 zebraidx(4495) [log] Loaded filter module /usr/lib/idzebra-2.0/modules/mod-alvis.so 00:58:50-14/11 zebraidx(4495) [log] Loaded filter module /usr/lib/idzebra-2.0/modules/mod-grs-regx.so 00:58:50-14/11 zebraidx(4495) [log] Loaded filter module /usr/lib/idzebra-2.0/modules/mod-text.so 00:58:50-14/11 zebraidx(4495) [log] enabling shadow spec=/var/lib/koha/zebradb/biblios/shadow:20G 00:58:50-14/11 zebraidx(4495) [log] cache_fname = /var/lib/koha/zebradb/biblios/shadow/cache 00:59:41-14/11 zebraidx(4495) [log] zebra_stop: 50.99 1.04 4.90 ==================== CLEANING ==================== psm@psm-laptop:~$
Any idea? What to do?
----------------------------------------------------
Dr. Parthasarathi Mukhopadhyay
Lecturer (Sr. Scale)
Department of Library and Information Science
The University of Burdwan (WB)
------------------------------------------
_______________________________________________ Koha-devel mailing list Koha-devel@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
-- Fridolyn SOMERS ICT engineer PROGILONE - Lyon - France fridolyn.somers@gmail.com