[Koha-devel] Zebra Error (Koha 3.4)

Fridolyn SOMERS fridolyn.somers at gmail.com
Mon Nov 14 22:39:55 CET 2011 

Hie,

do you have enougth space in /tmp ?

You may use rebuild_zebra -x for marcxml use and -k for keeping the
temporary files.

2011/11/14 Partha Mukhopadhyay <psm_vu at india.com>

> Dear all,
>
> I'm facing a problem in Zebra reindexing. In fact we entered a total of
> 21000 documents (manifestation) in our Koha setup (upgraded to 3.4).
> Somehow, a few documents are indexed by Zebra and as a result many of the
> records are not available for seraching. I followed the steps as below to
> solve the problem but it is still accessing only those records (no incraese
> in indexing base; roughly aroud 8000 records are processed by Zebra
> everytime).
>
>
>
> commands used:
> --------------
> 1.    sudo zebraidx -c /etc/koha/zebradb/zebra-biblios.cfg -g iso2709 -d
> biblios init
>                    No problem reported
>
> 2.    sudo zebraidx -c /etc/koha/zebradb/zebra-authorities.cfg -g iso2709
> -d authorities init
>                      No problem reported
>
> 3.    sudo KOHA_CONF=/etc/koha/koha-conf.xml PERL5LIB=/usr/share/koha/lib
> /usr/share/koha/bin/migration_tools/rebuild_zebra.pl -r -v -b
>
>
>
> The screen goes in this way.....
>
> psm at psm-laptop:~$ sudo KOHA_CONF=/etc/koha/koha-conf.xml
> PERL5LIB=/usr/share/koha/lib /usr/share/koha/bin/migration_tools/
> rebuild_zebra.pl -b -r -v
> Zebra configuration information
> ================================
> Zebra biblio directory      = /var/lib/koha/zebradb/biblios
> Zebra authorities directory = /var/lib/koha/zebradb/authorities
> Koha directory              = /usr/share/koha/intranet/cgi-bin
> BIBLIONUMBER in :     999$c
> BIBLIOITEMNUMBER in : 999$d
> ================================
> skipping authorities
> ====================
> exporting biblio
> ====================
>
> 1...............................................................................
>
> 101.............................................................................
>
> 201.............................................................................
>
> 301.............................................................................
>
> 401.............................................................................
>
> 501.............................................................................
>
>            <This way all records are done and then came the following>
>
>
> 00:56:07-14/11 zebraidx(4485) [log] add grs.marcxml.record
> /tmp/HcFKEQeESz/biblio/exported_records 1858559
> 00:56:07-14/11 zebraidx(4485) [log] add grs.marcxml.record
> /tmp/HcFKEQeESz/biblio/exported_records 1859288
> 00:56:07-14/11 zebraidx(4485) [log] Records: 1000 i/u/d 1000/0/0
> 00:56:07-14/11 zebraidx(4485) [log] More than 1000 file log entries.
> Omitting rest
> 00:56:16-14/11 zebraidx(4485) [log] Records: 2000 i/u/d 2000/0/0
> 00:56:25-14/11 zebraidx(4485) [log] Records: 3000 i/u/d 3000/0/0
> 00:56:36-14/11 zebraidx(4485) [log] Records: 4000 i/u/d 4000/0/0
> 00:56:46-14/11 zebraidx(4485) [log] Records: 5000 i/u/d 5000/0/0
> 00:56:58-14/11 zebraidx(4485) [log] Records: 6000 i/u/d 6000/0/0
> 00:57:10-14/11 zebraidx(4485) [log] Records: 7000 i/u/d 7000/0/0
> 00:57:23-14/11 zebraidx(4485) [log] Records: 8000 i/u/d 8000/0/0
>
>          <assume problem starts from here>
>
>
> 00:57:29-14/11 zebraidx(4485) [warn] Unknown register type: Subject
> 00:57:35-14/11 zebraidx(4485) [log] Records: 9000 i/u/d 9000/0/0
> 00:57:45-14/11 zebraidx(4485) [log] MARC: Bad directory
> 00:57:45-14/11 zebraidx(4485) [warn] MARC: Bad offsets in data. Skipping
> rest
> 00:57:45-14/11 zebraidx(4485) [warn] Record didn't contain match fields in
> (bib1,Local-number)
> 00:57:45-14/11 zebraidx(4485) [log] error grs.marcxml.record
> /tmp/HcFKEQeESz/biblio/exported_records 26009459
> 00:57:55-14/11 zebraidx(4485) [log] Merge 14.8% completed; 57 seconds
> remaining
> 00:58:05-14/11 zebraidx(4485) [log] Merge 34.1% completed; 38 seconds
> remaining
> 00:58:15-14/11 zebraidx(4485) [log] Merge 50.9% completed; 28 seconds
> remaining
> 00:58:25-14/11 zebraidx(4485) [log] Merge 66.1% completed; 20 seconds
> remaining
> 00:58:35-14/11 zebraidx(4485) [log] Merge 87.9% completed; 6 seconds
> remaining
> 00:58:42-14/11 zebraidx(4485) [log] Iterations: isam/dict 28751767/293156
> 00:58:42-14/11 zebraidx(4485) [log] Dict: inserts/updates/deletions:
> 293156/0/0
> 00:58:49-14/11 zebraidx(4485) [log] Records: 9785 i/u/d 9785/0/0
> 00:58:49-14/11 zebraidx(4485) [log] zebra_stop: 170.24 180.78 9.04
> 00:58:50-14/11 zebraidx(4495) [log] zebra_start 2.0.43
> abd433d1a315576cf1f4a53f2c70365f9a76477f
> 00:58:50-14/11 zebraidx(4495) [log] config
> /etc/koha/zebradb/zebra-biblios.cfg
> 00:58:50-14/11 zebraidx(4495) [log] Loaded filter module
> /usr/lib/idzebra-2.0/modules/mod-grs-marc.so
> 00:58:50-14/11 zebraidx(4495) [log] Loaded filter module
> /usr/lib/idzebra-2.0/modules/mod-dom.so
> 00:58:50-14/11 zebraidx(4495) [log] Loaded filter module
> /usr/lib/idzebra-2.0/modules/mod-grs-xml.so
> 00:58:50-14/11 zebraidx(4495) [log] Loaded filter module
> /usr/lib/idzebra-2.0/modules/mod-alvis.so
> 00:58:50-14/11 zebraidx(4495) [log] Loaded filter module
> /usr/lib/idzebra-2.0/modules/mod-grs-regx.so
> 00:58:50-14/11 zebraidx(4495) [log] Loaded filter module
> /usr/lib/idzebra-2.0/modules/mod-text.so
> 00:58:50-14/11 zebraidx(4495) [log] enabling shadow
> spec=/var/lib/koha/zebradb/biblios/shadow:20G
> 00:58:50-14/11 zebraidx(4495) [log] cache_fname =
> /var/lib/koha/zebradb/biblios/shadow/cache
> 00:59:41-14/11 zebraidx(4495) [log] zebra_stop: 50.99 1.04 4.90
> ====================
> CLEANING
> ====================
> psm at psm-laptop:~$
>
>
>
>
> Any idea? What to do?
>
>
>
>
>
> ----------------------------------------------------
>
> Dr. Parthasarathi Mukhopadhyay
>
> Lecturer (Sr. Scale)
>
> Department of Library and Information Science
>
> The University of Burdwan (WB)
>
> ------------------------------------------
>
>
>
> _______________________________________________
> Koha-devel mailing list
> Koha-devel at lists.koha-community.org
> http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel
> website : http://www.koha-community.org/
> git : http://git.koha-community.org/
> bugs : http://bugs.koha-community.org/
>



-- 
Fridolyn SOMERS
ICT engineer
PROGILONE - Lyon - France
fridolyn.somers at gmail.com
-------------- section suivante --------------
Une pi?ce jointe HTML a ?t? nettoy?e...
URL: </pipermail/koha-devel/attachments/20111114/a82930d0/attachment-0001.htm>

More information about the Koha-devel mailing list