[koha-commits] main Koha release repository branch 3.8.x updated. v3.08.02-29-gdfecab9

Mon Jun 25 23:23:15 CEST 2012

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "main Koha release repository".

The branch, 3.8.x has been updated
       via  dfecab9f1106c7cd924517d5bbde23614173ae54 (commit)
       via  8b2f05756435bbca8559da2761375a6734bf9961 (commit)
       via  2ddfa61b44b363f84d4ab21e8b529048839956ff (commit)
       via  a16d60648f37237cbaa655c218508ace36a6375d (commit)
       via  87cb6ccdc8699df720e71bfe0ecda7967716f1a8 (commit)
       via  94f11f65c487e06e1cf9332b664e82e243eea73b (commit)
       via  be9d86d3db14c06120640c71d8e5e699ccd391ca (commit)
       via  5aeacbbeb342a1ff9f48845d7252398a4ff89d3f (commit)
       via  c75eefd1aceacc31590d7b905a9472466c3e5246 (commit)
       via  1d68c95a9fc88826783c231873296c52c53ac41b (commit)
       via  84bf354eea295fe7cac3d4fa69df877c162e3491 (commit)
      from  0b497da9a621fac57c6d53a098e180d16acee86c (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -----------------------------------------------------------------
commit dfecab9f1106c7cd924517d5bbde23614173ae54
Author: Frédéric Demians <f.demians at tamil.fr>
Date:   Fri Apr 6 19:39:03 2012 +0200

    Bug 7818 Add UNIMARC biblio records zebra DOM def files

    Signed-off-by: Jared Camins-Esakov <jcamins at cpbibliography.com>
    I tested two UNIMARC Koha installations using the sample UNIMARC
    data from the BibLibre sandbox, comparing the results with DOM
    and with GRS-1 indexing. The results are very similar, though there
    are some differences. Most noticeable:
    * relevance and facets seem to be more accurate with DOM enabled
    * the GRS-1 configuration returns approximately 10% more results with
      random single keywords like "petit," but the DOM results contain
      the most relevant items, and any lacks in the configuration can
      easily be corrected as UNIMARC users identify fields that should be
      indexed but aren't
    * authority-controlled searches match exactly
    * author and topic facets do not work with the out-of-the-box GRS-1
      indexing configuration (?!?)
    (adding second sign-off line below because all that probably looks like
    a commit message and not a sign off)

    Signed-off-by: Jared Camins-Esakov <jcamins at cpbibliography.com>
    Signed-off-by: Paul Poulain <paul.poulain at biblibre.com>
    Signed-off-by: Chris Cormack <chrisc at catalyst.net.nz>

commit 8b2f05756435bbca8559da2761375a6734bf9961
Author: Galen Charlton <gmc at esilibrary.com>
Date:   Fri Apr 6 11:26:12 2012 -0400

    Bug 7818: add warning about not editing record.abs when using DOM filter

    This commit also updates the authority and biblio DOM indexing definition
    XSL to include updated header comments.

    Signed-off-by: Galen Charlton <gmc at esilibrary.com>
    Signed-off-by: Jared Camins-Esakov <jcamins at cpbibliography.com>
    Signed-off-by: Paul Poulain <paul.poulain at biblibre.com>
    Signed-off-by: Chris Cormack <chrisc at catalyst.net.nz>

commit 2ddfa61b44b363f84d4ab21e8b529048839956ff
Author: Galen Charlton <gmc at esilibrary.com>
Date:   Fri Apr 6 11:18:55 2012 -0400

    Bug 7818: update comment to clarify availability of DOM index mode

    DOM indexing is now available for both bibs and authorities.

    Signed-off-by: Galen Charlton <gmc at esilibrary.com>
    Signed-off-by: Jared Camins-Esakov <jcamins at cpbibliography.com>
    Signed-off-by: Paul Poulain <paul.poulain at biblibre.com>
    Signed-off-by: Chris Cormack <chrisc at catalyst.net.nz>

commit a16d60648f37237cbaa655c218508ace36a6375d
Author: Galen Charlton <gmc at esilibrary.com>
Date:   Fri Apr 6 00:48:04 2012 -0400

    Bug 7818: use Title-cover for title phrase weighting

    This is offerred as a compromise alternative to creating
    a new Title-rel index to avoid having the statement of
    responsiblity unduly affect field weight when using the DOM
    filter and MARC21 -- the problem with creating a Title-rel index
    is that it would *force* reindexing upon upgrade.

    Signed-off-by: Galen Charlton <gmc at esilibrary.com>
    Signed-off-by: Jared Camins-Esakov <jcamins at cpbibliography.com>
    Signed-off-by: Paul Poulain <paul.poulain at biblibre.com>
    Signed-off-by: Chris Cormack <chrisc at catalyst.net.nz>

commit 87cb6ccdc8699df720e71bfe0ecda7967716f1a8
Author: Galen Charlton <gmc at esilibrary.com>
Date:   Fri Apr 6 00:05:46 2012 -0400

    Bug 7818: -x option of rebuild_zebra.pl now works with DOM filter

    One consequence is that the -x and -a options are no longer
    mutually exclusive.

    Also, because of the way that the GRS-1 SGML filter works, if you're
    indexing multiple documents, you can't just wrap them in a document
    element, but the DOM filter *requires* it.  Consequently, two
    new config settings in koha-conf.xml are added to indicate the
    Zebra filter in use so that the -x option of rebuild_zebra.pl
    knows whether to wrap the exported records or not:

    - bib_index_mode (defaults to 'grs1' if not specified)
    - auth_index_mode (defaults to 'dom')

    Signed-off-by: Galen Charlton <gmc at esilibrary.com>
    Signed-off-by: Jared Camins-Esakov <jcamins at cpbibliography.com>
    Signed-off-by: Paul Poulain <paul.poulain at biblibre.com>
    Signed-off-by: Chris Cormack <chrisc at catalyst.net.nz>

commit 94f11f65c487e06e1cf9332b664e82e243eea73b
Author: Galen Charlton <gmc at esilibrary.com>
Date:   Mon Mar 26 01:16:11 2012 -0400

    Bug 7818: Zebra DOM filter index definitions for MARC21 bibs

    The file biblio-zebra-indexdefs.xsl, which is the stylesheet that
    is used by the Zebra DOM filter to convert an incoming MARC21 bib
    to its indexed form, was generated by the following two steps:

    misc/maintenance/make_zebra_dom_cfg_from_record_abs \
      --input  etc/zebradb/marc_defs/marc21/biblios/record.abs \
      --output etc/zebradb/marc_defs/marc21/biblios/biblio-koha-indexdefs.xml

    xsltproc etc/zebradb/xsl/koha-indexdefs-to-zebra.xsl \
      etc/zebradb/marc_defs/marc21/biblios/biblio-koha-indexdefs.xml \
      > etc/zebradb/marc_defs/marc21/biblios/biblio-zebra-indexdefs.xsl

    Records indexed using this XSLTshould behave similarly to records
    indexed using the GRS-1 filter and the old record.abs definition, with
    the following big exception (and improvemwent): indexed phrases now
    span subfield boundaries if a specific subfield wasn't specified in the
    index definition.  For example, the GRS-1 filter index definition

    melm 245 Title

    would allow 245 $a Cats on boxes : $b cardboard fantasies

    to be searched as the phrases "cats on boxes" or "cardboard fantasies",
    but a title phrase seach of "cats on boxes cardboard fantasises"
    wouldn't work.  The DOM filter equivalent,

    <index_data_field xmlns="http://www.koha-community.org/schemas/index-defs" tag="245">
      <target_index>Title:w</target_index>
      <target_index>Title:p</target_index>
    </index_data_field>

    *does* allow phrase searches to span subfield boundaries.

    Signed-off-by: Galen Charlton <gmc at esilibrary.com>
    Signed-off-by: Jared Camins-Esakov <jcamins at cpbibliography.com>
    Signed-off-by: Paul Poulain <paul.poulain at biblibre.com>
    Signed-off-by: Chris Cormack <chrisc at catalyst.net.nz>

commit be9d86d3db14c06120640c71d8e5e699ccd391ca
Author: Galen Charlton <gmc at esilibrary.com>
Date:   Mon Mar 26 01:10:09 2012 -0400

    Bug 7818: add index_data_field option to DOM indexing repertoire

    Adds a new kohaidx:index_data_field index definition type which
    indexes all of the subfields of a MARC data field as a single
    phrase, separating the contents of each with a space.

    Signed-off-by: Galen Charlton <gmc at esilibrary.com>
    Signed-off-by: Jared Camins-Esakov <jcamins at cpbibliography.com>
    Signed-off-by: Paul Poulain <paul.poulain at biblibre.com>
    Signed-off-by: Chris Cormack <chrisc at catalyst.net.nz>

commit 5aeacbbeb342a1ff9f48845d7252398a4ff89d3f
Author: Galen Charlton <gmc at esilibrary.com>
Date:   Mon Mar 26 01:08:58 2012 -0400

    Bug 7818: move koha-indexdefs-to-zebra.xsl

    Since the koha-indexdefs-to-zebra.xsl  stylesheet will be used
    by both bib and authority indexing, put in a central location.

    Signed-off-by: Galen Charlton <gmc at esilibrary.com>
    Signed-off-by: Jared Camins-Esakov <jcamins at cpbibliography.com>
    Signed-off-by: Paul Poulain <paul.poulain at biblibre.com>
    Signed-off-by: Chris Cormack <chrisc at catalyst.net.nz>

commit c75eefd1aceacc31590d7b905a9472466c3e5246
Author: Galen Charlton <gmc at esilibrary.com>
Date:   Mon Mar 26 01:05:58 2012 -0400

    Bug 7818: utility to generate DOM indexing configs

    misc/maintenance/make_zebra_dom_cfg_from_record_abs:
      generate a DOM filter Zebra index config from a GRS-1 config

    Given a Zebra record.abs file containing a set of index definitions for
    Zebra's GRS-1 filter, write an equivalent DOM filter configuration.

    To generate the XSLT that is to be used by Zebra, run something like
    the following on the output of this utility:

    xsltproc ZEBRA_CFG_DIR/xsl/koha-indexdefs-to-zebra.xsl \
      biblio-koha-indexdefs.xml \
      > ZEBRA_CFG_DIR/marc_defs/marc21/biblios/biblio-zebra-indexdefs.xsl

    The above example assumes that the output of the program was named
    biblio-koha-indexdefs.xsl.

    This commit also introduces Koha::Indexer::Utils, a new package for
    misceallenous routines that support Koha's indexing definitions.

    Signed-off-by: Galen Charlton <gmc at esilibrary.com>
    Signed-off-by: Jared Camins-Esakov <jcamins at cpbibliography.com>
    Signed-off-by: Paul Poulain <paul.poulain at biblibre.com>
    Signed-off-by: Chris Cormack <chrisc at catalyst.net.nz>

commit 1d68c95a9fc88826783c231873296c52c53ac41b
Author: Galen Charlton <gmc at esilibrary.com>
Date:   Fri Mar 23 19:08:58 2012 -0400

    Bug 7818: update miscellaneous installer scripts

    Teach a couple of the quick-install scripts about
    DOM mode for bibs.

    Signed-off-by: Galen Charlton <gmc at esilibrary.com>
    Signed-off-by: Jared Camins-Esakov <jcamins at cpbibliography.com>
    Signed-off-by: Paul Poulain <paul.poulain at biblibre.com>
    Signed-off-by: Chris Cormack <chrisc at catalyst.net.nz>

commit 84bf354eea295fe7cac3d4fa69df877c162e3491
Author: Galen Charlton <gmc at esilibrary.com>
Date:   Fri Mar 23 18:52:27 2012 -0400

    Bug 7818: update installer for biblio DOM indexing

    Adds the necessary bits to enable DOM indexing for bib
    records as an option during installation from source.

    Signed-off-by: Galen Charlton <gmc at esilibrary.com>
    Signed-off-by: Jared Camins-Esakov <jcamins at cpbibliography.com>
    Signed-off-by: Paul Poulain <paul.poulain at biblibre.com>
    Signed-off-by: Chris Cormack <chrisc at catalyst.net.nz>

-----------------------------------------------------------------------

Summary of changes:
 C4/Search.pm                                       |    2 +-
 Koha/Indexer/Utils.pm                              |  222 ++
 Makefile.PL                                        |   22 +
 etc/koha-conf.xml                                  |   18 +-
 etc/zebradb/authorities/etc/dom-config.xml         |    2 +-
 etc/zebradb/biblios/etc/dom-config-marc.xml        |   54 +
 etc/zebradb/biblios/etc/dom-config.xml             |   54 +
 .../authorities/authority-zebra-indexdefs.xsl      |    8 +-
 .../marc21/authorities/koha-indexdefs-to-zebra.xsl |  403 ----
 .../marc_defs/marc21/authorities/record.abs        |    8 +
 .../marc21/biblios/biblio-koha-indexdefs.xml       | 1264 +++++++++++
 .../marc21/biblios/biblio-zebra-indexdefs.xsl      | 2345 ++++++++++++++++++++
 etc/zebradb/marc_defs/marc21/biblios/record.abs    |    8 +
 .../unimarc/biblios/biblio-koha-indexdefs.xml      | 1252 +++++++++++
 .../unimarc/biblios/biblio-zebra-indexdefs.xsl     | 2270 +++++++++++++++++++
 ...nfo-auth-dom.xml => retrieval-info-bib-dom.xml} |    0
 ...o-auth-grs1.xml => retrieval-info-bib-grs1.xml} |    0
 etc/zebradb/xsl/koha-indexdefs-to-zebra.xsl        |  440 ++++
 etc/zebradb/zebra-biblios-dom.cfg                  |   55 +
 install_misc/environment_Makefile.PL               |    2 +
 install_misc/install_koha_on_fresh_debian          |    1 +
 misc/koha-install-log                              |    4 +-
 .../maintenance/make_zebra_dom_cfg_from_record_abs |   72 +
 misc/migration_tools/rebuild_zebra.pl              |   78 +-
 rewrite-config.PL                                  |    3 +
 25 files changed, 8156 insertions(+), 431 deletions(-)
 create mode 100644 Koha/Indexer/Utils.pm
 create mode 100644 etc/zebradb/biblios/etc/dom-config-marc.xml
 create mode 100644 etc/zebradb/biblios/etc/dom-config.xml
 delete mode 100644 etc/zebradb/marc_defs/marc21/authorities/koha-indexdefs-to-zebra.xsl
 create mode 100644 etc/zebradb/marc_defs/marc21/biblios/biblio-koha-indexdefs.xml
 create mode 100644 etc/zebradb/marc_defs/marc21/biblios/biblio-zebra-indexdefs.xsl
 create mode 100644 etc/zebradb/marc_defs/unimarc/biblios/biblio-koha-indexdefs.xml
 create mode 100644 etc/zebradb/marc_defs/unimarc/biblios/biblio-zebra-indexdefs.xsl
 copy etc/zebradb/{retrieval-info-auth-dom.xml => retrieval-info-bib-dom.xml} (100%)
 copy etc/zebradb/{retrieval-info-auth-grs1.xml => retrieval-info-bib-grs1.xml} (100%)
 create mode 100644 etc/zebradb/xsl/koha-indexdefs-to-zebra.xsl
 create mode 100644 etc/zebradb/zebra-biblios-dom.cfg
 create mode 100755 misc/maintenance/make_zebra_dom_cfg_from_record_abs

hooks/post-receive
-- 
main Koha release repository