<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
We had time and a resources available for a while. We got Bouzid to
learn Elastic Search, learn about its integration in Koha, then
wanted him to contribute. But been told twice to ... wait.<br>
<br>
We certainly have no time anymore. We'll be back, but probably not
until 2017 unless sponsored.<br>
<br>
Now, may I suggest something? Documentation. Not user friendly,
but at least dev-enlightening.<br>
<br>
"You" guys put time in there, as with plack and memcache and
whatnot, but if you're on the outside, you have no way of getting a
head start beside reading some 1200 bugzilla comments in
chronological order to know what's the status, how to get it to work
on a git, etc... (my ref to plack is not accidental).<br>
<br>
You can put tens of hours alone on the next bug and then wonder why
nobody comes in when you call for testers, or invest a few hours on
documenting a quick way for dummasses like me to catch up.<br>
<br>
<b>Now</b>, everyone is constrained by time, and I apologize if the
comment above is frustrating to read. I don't want to be rude, and
I appreciate all the hours everyone put to improve the product while
I don't or can't. Please see that just as my opinion on why
different big devs don't get as many helpers as deserved.<br>
<br>
<br>
<br>
<div class="moz-signature">
<style type="text/css">
.moz-signature {
color: #FFFFFF;
}
.sig_inlibro {
padding-top : 2px;
color: #888888;
font-family : "Trebuchet MS", verdana;
font-size: 90%;
}
.sig_content {
border-top: 2px solid #DDDDDD;
border-bottom: 2px solid #BFD13D;
background-color : #F6F6F6;
padding-left:10px;
}
.sig_inlibro a:visited, .sig_inlibro a:hover, .sig_inlibro a:link {
text-decoration: none;
color: #005B85;
}
.nom {
color: #005B85;
font-weight : bold;
}
.inlibro, .in {
color: #BFD13D;
}
.libro {
color: #005B85;
}
.in, .libro {
font-size : 120%;
}
.desc {
margin-bottom: 0;
padding-bottom: 5px;
}
.small {
font-size: 80%;
}
.tagline {
color : #00BCE4;
}
.sig_footer {
padding-left : 10px;
background-color : #EEEFEA;
}
</style>
<div class="sig_inlibro">
<div class="sig_content"> <span class="nom">Philippe Blouin,</span><br>
<span class="tagline small">Responsable du développement
informatique</span><br>
<p class="desc small"> Tél. : (888) 604-2627<br>
<a href="mailto:philippe.blouin@inLibro.com">philippe.blouin@inLibro.com</a>
</p>
</div>
<div class="sig_footer"> <span class="in">in</span><span
class="libro">Libro</span> <span class="tagline small">|
pour esprit libre |</span> <a class="small"
href="http://www.inLibro.com">www.inLibro.com</a> </div>
</div>
</div>
<div class="moz-cite-prefix">On 08/31/2016 03:55 AM, Jonathan Druart
wrote:<br>
</div>
<blockquote
cite="mid:CAJzKNY4uqm1BB7j-mBfKk8isCM8AdtWf-Ne5VwhLsFowvBUWQQ@mail.gmail.com"
type="cite">
<pre wrap="">2016-08-31 0:19 GMT+01:00 David Cook <a class="moz-txt-link-rfc2396E" href="mailto:dcook@prosentient.com.au"><dcook@prosentient.com.au></a>:
</pre>
<blockquote type="cite">
<pre wrap="">Is ElasticSearch usable with Koha at this point? I heard a lot in 2015, but
after Robin left I haven’t heard a word other than rumours that the patches
had been pushed?
</pre>
</blockquote>
<pre wrap="">
It's pushed and testable.
It does not work for new installs (bug 16838) and is broken if
OpacSuppression is set (bug 16660). Nobody seems to take care of these
bugs (I guess I should).
Improvements are provided but don't get lot of attention from signoffers
Bug 14567 - Browse interface for OPAC
Bug 14899 - Mapping configuration page for Elastic search
Cheers,
Jonathan
</pre>
<blockquote type="cite">
<pre wrap="">David Cook
Systems Librarian
Prosentient Systems
72/330 Wattle St
Ultimo, NSW 2007
Australia
Office: 02 9212 0899
Direct: 02 8005 0595
From: <a class="moz-txt-link-abbreviated" href="mailto:koha-devel-bounces@lists.koha-community.org">koha-devel-bounces@lists.koha-community.org</a>
[<a class="moz-txt-link-freetext" href="mailto:koha-devel-bounces@lists.koha-community.org">mailto:koha-devel-bounces@lists.koha-community.org</a>] On Behalf Of Tomas
Cohen Arazi
Sent: Tuesday, 23 August 2016 11:42 PM
To: Barton Chittenden <a class="moz-txt-link-rfc2396E" href="mailto:barton@bywatersolutions.com"><barton@bywatersolutions.com></a>; Jonathan Druart
<a class="moz-txt-link-rfc2396E" href="mailto:jonathan.druart@bugs.koha-community.org"><jonathan.druart@bugs.koha-community.org></a>
Cc: <a class="moz-txt-link-abbreviated" href="mailto:koha-devel@lists.koha-community.org">koha-devel@lists.koha-community.org</a>
Subject: Re: [Koha-devel] 16.05, zebra and jessie
I have seen use_zebra_facets=1 cause no facets rendered when GRS-1
configuration files are kept during upgrades up to where GRS-1 got
deprecated (3.20?). Is it the case? What does the About > System information
page says about your config?
The slowliness is not in zebra per se, but in the way we retrieve the facets
from it (so Koha/Perl side). We retrieve each facet at a time instead of
fetching them all in one call. And they come in XML format, so need to be
parsed. So, if anyone is willing to improve it, just need to optimize this
function (read the TODO):
sub _get_facet_from_result_set {
my $facet_idx = shift;
my $rs = shift;
my $sep = shift;
my $internal_sep = '<*>';
my $facetMaxCount = C4::Context->preference('FacetMaxCount') // 20;
return if ( ! defined $facet_idx || ! defined $rs );
# zebra's facet element, untokenized index
my $facet_element = 'zebra::facet::' . $facet_idx . ':0:' .
$facetMaxCount;
# configure zebra results for retrieving the desired facet
$rs->option( elementSetName => $facet_element );
# get the facet record from result set
my $facet = $rs->record( 0 )->raw;
# if the facet has no restuls...
return if !defined $facet;
# TODO: benchmark DOM vs. SAX performance
my $facet_dom = XML::LibXML->load_xml(
string => ($facet)
);
my @terms = $facet_dom->getElementsByTagName('term');
return if ! @terms;
my $facets = {};
foreach my $term ( @terms ) {
my $facet_value = $term->textContent;
$facet_value =~ s/\Q$internal_sep\E/$sep/ if defined $sep;
$facets->{ $facet_value } = $term->getAttribute( 'occur' );
}
return $facets;
}
Another option would be to make _get_facets_from_zebra build the element set
containing all facets so they are read in one call (comma-separate all
elements). The problem is that Zebra returns zero if one of the elements is
empty. Jared proposed to create a ghost record with all facet fields. I
didn't manage to make it work. Another option is to patch Zebra. I started
that, but abandoned once the ES code got pushed.
So, if use_zebra_facets=0 is good enough, maybe it should be recommended.
Problem is it is not a real facet, but the sole extraction of the fields
from the first x records.
As I said, it could be good enough anyway.
Regards
El mar., 23 ago. 2016 a las 10:21, Barton Chittenden
(<a class="moz-txt-link-rfc2396E" href="mailto:barton@bywatersolutions.com"><barton@bywatersolutions.com></a>) escribió:
Zebra tends to be I/O bound -- we've seen it write enormous .zrs files to
disk (~16G/query on large libraries). Bug 13665 mentions that searches could
be taking upwards of 40 seconds to complete -- I think that we've seen
searches time out and return no results at about 1 minute.
Is it possible to tune Zebra's space/time optimizations in any way so that
it doesn't write such large files to disk?
On Tue, Aug 23, 2016 at 5:38 AM, Jonathan Druart
<a class="moz-txt-link-rfc2396E" href="mailto:jonathan.druart@bugs.koha-community.org"><jonathan.druart@bugs.koha-community.org></a> wrote:
See bug 13665 - Retrieve facets from zebra is slow
To understand why and when use_zebra_facet=1 is slow
2016-08-22 21:31 GMT+01:00 Barton Chittenden <a class="moz-txt-link-rfc2396E" href="mailto:barton@bywatersolutions.com"><barton@bywatersolutions.com></a>:
</pre>
<blockquote type="cite">
<pre wrap="">I haven't run into the issue with the dashes in idzebra-2.0 2.0.59, but I
have run into this, when using ICU-Chains:
Bug 16581 : ICU tokenization bug in idzebra-2.0 2.0.59-1
URL :
<a class="moz-txt-link-freetext" href="https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16581">https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16581</a>
Priority : P5 - low
Urgency : enhancement
Status : NEW
I also know that when use_zebra_facets was first introduced, it was *very*
slow -- I can't find any bugs about that though. It's possible that it got
so slow under idzebra-2.0 2.61 that the searches are timing out.
It should be possible to set the logging for zebra so that you can see the
PQF queries:
See
Bug 15714 : Remove zebra.log from debian scripts and add optional log
levels
URL :
<a class="moz-txt-link-freetext" href="https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=15714">https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=15714</a>
Priority : P5 - low
Urgency : enhancement
Status : RESOLVED
For setting the log levels
And
<a class="moz-txt-link-freetext" href="http://koha.1045719.n5.nabble.com/Improving-Zebra-logging-td5861827.html">http://koha.1045719.n5.nabble.com/Improving-Zebra-logging-td5861827.html</a>
For a general discussion of how to use them.
... This should give you some idea of what's failing, both in terms of the
dashes in 2.0.59 and the non-functional zebra facets under 2.0.61.
My general feeling is that 2.0.59 is irredeemably broken by bug 16581, and
we need at least 2.0.60, but I don't have any experience with zebra
facets.
--Barton
On Mon, Aug 22, 2016 at 2:49 PM, Mark Tompsett <a class="moz-txt-link-rfc2396E" href="mailto:mtompset@hotmail.com"><mtompset@hotmail.com></a>
wrote:
</pre>
<blockquote type="cite">
<pre wrap="">
Greetings,
Similar problem. I hope someone has a better solution than setting it to
0.
GPML,
Mark Tompsett
-----Original Message-----
From: Philippe Blouin
Sent: Monday, August 22, 2016 2:40 PM
To: <a class="moz-txt-link-abbreviated" href="mailto:koha-devel@lists.koha-community.org">koha-devel@lists.koha-community.org</a>
Subject: [Koha-devel] 16.05, zebra and jessie
Hello!
We're trying to find the correction combination. We're new on Jessie,
so we still have some tweaking needed...
- By default, we get zebra 2.00.59 installed on Jessie through the
packages.
- On 16.05, we get some very bad results in the search when the itemtype
contains an hyphen (-), like 'A-DOC'.
- So we installed zebra 2.00.62. This fixes the search...
- But now we do not have facets.
- So we set <use_zebra_facets>0</use_zebra_facets>
- And now we have facets. But this feels... wrong?
My dummy question: what is the supposedly correct version of Zebra on
Jessie ?
And we're we correct in setting the config to 0 ?
Thanks
Blou
_______________________________________________
Koha-devel mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Koha-devel@lists.koha-community.org">Koha-devel@lists.koha-community.org</a>
<a class="moz-txt-link-freetext" href="http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel">http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel</a>
website : <a class="moz-txt-link-freetext" href="http://www.koha-community.org/">http://www.koha-community.org/</a>
git : <a class="moz-txt-link-freetext" href="http://git.koha-community.org/">http://git.koha-community.org/</a>
bugs : <a class="moz-txt-link-freetext" href="http://bugs.koha-community.org/">http://bugs.koha-community.org/</a>
_______________________________________________
Koha-devel mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Koha-devel@lists.koha-community.org">Koha-devel@lists.koha-community.org</a>
<a class="moz-txt-link-freetext" href="http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel">http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel</a>
website : <a class="moz-txt-link-freetext" href="http://www.koha-community.org/">http://www.koha-community.org/</a>
git : <a class="moz-txt-link-freetext" href="http://git.koha-community.org/">http://git.koha-community.org/</a>
bugs : <a class="moz-txt-link-freetext" href="http://bugs.koha-community.org/">http://bugs.koha-community.org/</a>
</pre>
</blockquote>
<pre wrap="">
_______________________________________________
Koha-devel mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Koha-devel@lists.koha-community.org">Koha-devel@lists.koha-community.org</a>
<a class="moz-txt-link-freetext" href="http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel">http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel</a>
website : <a class="moz-txt-link-freetext" href="http://www.koha-community.org/">http://www.koha-community.org/</a>
git : <a class="moz-txt-link-freetext" href="http://git.koha-community.org/">http://git.koha-community.org/</a>
bugs : <a class="moz-txt-link-freetext" href="http://bugs.koha-community.org/">http://bugs.koha-community.org/</a>
</pre>
</blockquote>
<pre wrap="">
_______________________________________________
Koha-devel mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Koha-devel@lists.koha-community.org">Koha-devel@lists.koha-community.org</a>
<a class="moz-txt-link-freetext" href="http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel">http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel</a>
website : <a class="moz-txt-link-freetext" href="http://www.koha-community.org/">http://www.koha-community.org/</a>
git : <a class="moz-txt-link-freetext" href="http://git.koha-community.org/">http://git.koha-community.org/</a>
bugs : <a class="moz-txt-link-freetext" href="http://bugs.koha-community.org/">http://bugs.koha-community.org/</a>
--
Tomás Cohen Arazi
Theke Solutions (<a class="moz-txt-link-freetext" href="https://theke.io">https://theke.io</a>)
✆ +54 9351 3513384
GPG: B2F3C15F
</pre>
</blockquote>
<pre wrap="">_______________________________________________
Koha-devel mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Koha-devel@lists.koha-community.org">Koha-devel@lists.koha-community.org</a>
<a class="moz-txt-link-freetext" href="http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel">http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel</a>
website : <a class="moz-txt-link-freetext" href="http://www.koha-community.org/">http://www.koha-community.org/</a>
git : <a class="moz-txt-link-freetext" href="http://git.koha-community.org/">http://git.koha-community.org/</a>
bugs : <a class="moz-txt-link-freetext" href="http://bugs.koha-community.org/">http://bugs.koha-community.org/</a></pre>
</blockquote>
<br>
</body>
</html>