[Koha-devel] MARC record size limit

[Thomas Dukleth]

Reply inline:


Original Subject:  [Koha-devel] Search Engine Changes : let's get some solr

On Mon, October 4, 2010 08:10, LAURENT Henri-Damien wrote:

[...]

> zebra is fast and embeds native z3950 server. But it has also some major
> drawbacks we have to cope with on our everyday life making it quite
> difficult to maintain.

[...]

> I think that every one agrees that we have to refactor C4::Search.
> Indeed, query parser is not able to manage independantly all the
> configuration options. And usage of usmarc as internal for biblio comes
> with a serious limitation of 9999 bytes, which for big biblios with many
> items, is not enough.

How do MARC limitations on record size relate to Solr/Indexing or Zebra
indexing which lacks Solr/Lucene support in the current version?

How does BibLibre intend to fix the limitation on the size of
bibliographic records as part of its work on record indexing and retrieval
in Koha or in some parallel work.?

>
> BibLibre investigated in a catalogue based on solr.
> A  University in France contracted us for that development.
> This University is in relation with all the community here in France and
> solr will certainly be adopted by all the libraries France wide.
> We are planning to release the code on our git early spring next year
> and rebase on whatever Koha version will be released at that time 3.4 or
> 3.6.
>
>
> Why ?
>
> Solr indexes with data with HTTP.
> It can provide fuzzy search, search on synonyms, suggestions
> It can provide facet search, stemming.
> utf8 support is embedded.
> Community is really impressively reactive and numerous and efficient.
> And documentation is very good and exhaustive.
>
> You can see the results on solr.biblibre.com and
> catalogue.solr.biblibre.com
>
> http://catalogue.solr.biblibre.com/cgi-bin/koha/opac-search.pl?q=jean
> http://solr.biblibre.com/cgi-bin/koha/admin/admin-home.pl
> you can log there with demo/demo lgoin/password
>
> http://solr.biblibre.com/cgi-bin/koha/solr/indexes.pl
> is the page where ppl can manage their indexes and links.
>
> a) Librarians can define their own indexes, and there is a plugin that
> fetches data from rejected authorities and from authorised_values (that
> could/should  have been achieved with zebra but only with major work on
> xslt).
>
> b) C4/Search.pm count lines of code could be shrinked ten times.
> You can test from poc_solr branch on
> git://git.biblibre.com/koha_biblibre.git
> But you have to install solr.
>
> Any feedback/idea welcome.

[...]


Thomas Dukleth
Agogme
109 E 9th Street, 3D
New York, NY  10003
USA
http://www.agogme.com
+1 212-674-3783