[Bug 38912] New: Elasticsearch record show is a 404 from staff catalog details
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 Bug ID: 38912 Summary: Elasticsearch record show is a 404 from staff catalog details Change sponsored?: --- Product: Koha Version: 24.05 Hardware: All OS: All Status: NEW Severity: enhancement Priority: P5 - low Component: Searching - Elasticsearch Assignee: koha-bugs@lists.koha-community.org Reporter: ephetteplace@cca.edu QA Contact: testopia@bugs.koha-community.org Created attachment 176694 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=176694&action=edit screenshot of 404 To recreate: - Use Elasticsearch as search engine (SearchEngine = Elasticsearch) - Go to a record on the staff side /cgi-bin/koha/catalogue/detail.pl?biblionumber=1234 - Click the "show" link next to "Elasticsearch record:" - a 404 page appears in a pop-up window (see attached screenshot) The page is also a 404 if I inspect the link and open it in a new tab. The URL looks like /cgi-bin/koha/catalogue/showelastic.pl?id=1234 We are on 24.05.05. -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 Eric Phetteplace <ephetteplace@cca.edu> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |ephetteplace@cca.edu -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #1 from Eric Phetteplace <ephetteplace@cca.edu> --- I tested on ktd just now and this works. Is it possible it was fixed in between 24.05 and now? I searched for an existing bug but if there was one, I was unable to find it. -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #2 from Katrin Fischer <katrin.fischer@bsz-bw.de> --- It might have been fixed by bug 37494. -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 Nick Clemens (kidclamp) <nick@bywatersolutions.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Patch complexity|--- |Trivial patch Status|NEW |Needs Signoff -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #3 from Nick Clemens (kidclamp) <nick@bywatersolutions.com> --- Created attachment 177534 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=177534&action=edit Bug 38912: Add option to include '_doc' type in ES record view This bug has been filed several times and seems to relate to the ES version, the version of Search::Elasticsearch and maybe other factors. Because the version of ES being used may vary, and such the necessary perl module version needed we should add an easy toggle to allow this feature to work, including the type if needed and not if not. To test: 1 - Apply patches, updatedatabase 2 - Enable Elasticsearch in Koha 3 - View a record details page 4 - Click 'Elastic record: Show' 5 - You should see the record 6 - Toggle ElasticsearchIncludeDocType system preference 7 - You get a 404 8 - Toggle it back 9 - Record shows 10 - sudo apt-get install libsearch-elasticsearch-perl=6.81-1-koha1 11 - Restart all 12 - View ES record - it fails! 13 - Toggle the syspref 14 - It works! 15 - Sign off -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 Nick Clemens (kidclamp) <nick@bywatersolutions.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |fridolin.somers@biblibre.co | |m, | |nick@bywatersolutions.com See Also| |https://bugs.koha-community | |.org/bugzilla3/show_bug.cgi | |?id=37494, | |https://bugs.koha-community | |.org/bugzilla3/show_bug.cgi | |?id=35618 -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 Michał <schodkowy.omegi-0r@icloud.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |schodkowy.omegi-0r@icloud.c | |om --- Comment #4 from Michał <schodkowy.omegi-0r@icloud.com> --- Is there no way to vary this depending on detected ES version in use? Adding a syspref would kinda suck unless there’s no way to avoid it… I was under the impression it was mostly a matter of changes between ES versions at least. -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #5 from Nick Clemens (kidclamp) <nick@bywatersolutions.com> --- (In reply to Michał from comment #4)
Is there no way to vary this depending on detected ES version in use? Adding a syspref would kinda suck unless there’s no way to avoid it… I was under the impression it was mostly a matter of changes between ES versions at least.
I think there are several factors: The ES perl module version, the ES version, and the state of the indexes, and possibly others. The syspref makes it simple enough for the end user to change without a lot of overhead and I think it's a reasonable solution -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #6 from Fridolin Somers <fridolin.somers@biblibre.com> --- We already did something like this with system preference "ElasticsearchCrossFields" -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 David Nind <david@davidnind.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |david@davidnind.com Severity|enhancement |normal -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |dcook@prosentient.com.au --- Comment #7 from David Cook <dcook@prosentient.com.au> --- I thought the "type" parameter was dropped in ES 7 and ES 6 was EOL a few years ago? -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #8 from David Cook <dcook@prosentient.com.au> --- I think there's a lot of other places in Koha that explode if using ES 6, no? -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #9 from Katrin Fischer <katrin.fischer@bsz-bw.de> --- (In reply to David Cook from comment #8)
I think there's a lot of other places in Koha that explode if using ES 6, no?
Support was dropped after 22.11: https://wiki.koha-community.org/wiki/System_requirements_and_recommendations -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #10 from David Cook <dcook@prosentient.com.au> --- (In reply to Katrin Fischer from comment #9)
(In reply to David Cook from comment #8)
I think there's a lot of other places in Koha that explode if using ES 6, no?
Support was dropped after 22.11: https://wiki.koha-community.org/wiki/System_requirements_and_recommendations
So why are we looking at a patch for 24.05+? -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #11 from Fridolin Somers <fridolin.somers@biblibre.com> --- For me this looks like perl deps have an impact : I see we use Search::Elasticsearch 6.80 : https://git.koha-community.org/Koha-community/Koha/src/branch/main/cpanfile#... https://debian.koha-community.org/koha/dists/24.11/main/binary-amd64/Package... Shouldn't we upgrade to >= 7 ? Debian Bookworm provides version 8. https://packages.debian.org/bookworm/libsearch-elasticsearch-perl Our installs on Ubuntu noble use perl dep with version 8. Maybe this explains the difference of behavior. -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #12 from David Cook <dcook@prosentient.com.au> ---
https://debian.koha-community.org/koha/dists/24.11/main/binary-amd64/Package... (In reply to Fridolin Somers from comment #11) For me this looks like perl deps have an impact : I see we use Search::Elasticsearch 6.80 : https://git.koha-community.org/Koha-community/Koha/src/branch/main/ cpanfile#L102 https://debian.koha-community.org/koha/dists/24.11/main/binary-amd64/Package...
Shouldn't we upgrade to >= 7 ? Debian Bookworm provides version 8. https://packages.debian.org/bookworm/libsearch-elasticsearch-perl
Our installs on Ubuntu noble use perl dep with version 8. Maybe this explains the difference of behavior.
So I think that cpanfile line is an error/bug (which doesn't get carried over into debian/control fortunately). In practice, most people should be using a newer version of libsearch-elasticsearch-perl if it's available on their system. -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Needs Signoff |Failed QA --- Comment #13 from David Cook <dcook@prosentient.com.au> --- Sorry but I'm putting to FQA as I'm sure this isn't something we really want to do. -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 Magnus Enger <magnus@libriotech.no> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |magnus@libriotech.no --- Comment #14 from Magnus Enger <magnus@libriotech.no> --- I think I am running into this problem in the wild now. I have one server with this problem, running on Ubuntu 20.04 and this version of Search::Elasticsearch: $ sudo apt-cache policy libsearch-elasticsearch-perl libsearch-elasticsearch-perl: Installed: 6.81-1-koha1 Candidate: 6.81-1-koha1 Version table: *** 6.81-1-koha1 500 500 http://debian.koha-community.org/koha 23.11/main amd64 Packages 100 /var/lib/dpkg/status 6.00-1 500 500 http://archive.ubuntu.com/ubuntu focal/universe amd64 Packages I have another server without the problem, running Ubuntu 24.04 and this: $ sudo apt-cache policy libsearch-elasticsearch-perl libsearch-elasticsearch-perl: Installed: 8.12-1 Candidate: 8.12-1 Version table: *** 8.12-1 500 500 http://se.archive.ubuntu.com/ubuntu noble/universe amd64 Packages 100 /var/lib/dpkg/status 6.81-1-koha1 500 500 http://debian.koha-community.org/koha 23.11/main amd64 Packages I can't prove that the version of Search::Elasticsearch is what is causing this, but it is the only significant difference I have been able to find. -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #15 from David Cook <dcook@prosentient.com.au> --- (In reply to Magnus Enger from comment #14)
I think I am running into this problem in the wild now. I have one server with this problem, running on Ubuntu 20.04 and this version of Search::Elasticsearch:
I can't prove that the version of Search::Elasticsearch is what is causing this, but it is the only significant difference I have been able to find.
Looking at the Ubuntu website, it looks like Ubuntu 20.04 uses version 6 while 22.04 uses version 7 and all other newer Ubuntu versions use version 8 of the library. Ubuntu 20.04 is EOL pretty soon, so should probably upgrade off that anyway. Plus, according to the wiki, Koha newer than 22.11 isn't supported on Ubuntu 20.04. -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 Eric Phetteplace <ephetteplace@cca.edu> changed: What |Removed |Added ---------------------------------------------------------------------------- CC|ephetteplace@cca.edu | -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #16 from Magnus Enger <magnus@libriotech.no> --- (In reply to David Cook from comment #15)
Plus, according to the wiki, Koha newer than 22.11 isn't supported on Ubuntu 20.04.
Yeah, I figured that out after a while. :-) Feels like this bug is a "wontfix", but maybe we should leave it open for others with the same problem? -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #17 from Michał <schodkowy.omegi-0r@icloud.com> --- (In reply to Magnus Enger from comment #16)
Feels like this bug is a "wontfix", but maybe we should leave it open for others with the same problem?
I don't think there's a point in cluttering opened bugs forever, it'd be searchable in exact same way no matter if opened or not for such people. Unless the actionable solution for the bug would be deemed a patch to .deb control files to enforce a newer version, but the only practical result will be that the whole attempt to upgrade Koha on ancient Ubuntu/Debian versions would explode rather than just some small subset of features, so not sure if that'd really be an improvement either. But at least the system administrator would then know something's up :D -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #18 from Fridolin Somers <fridolin.somers@biblibre.com> --- Shouldn't we remove "libsearch-elasticsearch-perl" from Koha packages repo ? -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |dependency CC| |mtj@kohaaloha.com -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 Esther Melander <esther.melander@bywatersolutions.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |esther.melander@bywatersolu | |tions.com -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 Kyle M Hall (khall) <kyle@bywatersolutions.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|koha-bugs@lists.koha-commun |nick@bywatersolutions.com |ity.org | CC| |kyle@bywatersolutions.com -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #19 from Eric Phetteplace <ephetteplace@cca.edu> --- I'm fine with wontfix on this too if it's too hard / not worth addressing. But I think then the "Elasticsearch record: Show" link on staff side details should be removed. A nonfunctioning feature shouldn't be left in, even if users can hide it with IntranetUserCSS. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #20 from David Cook <dcook@prosentient.com.au> --- (In reply to Eric Phetteplace from comment #19)
I'm fine with wontfix on this too if it's too hard / not worth addressing.
But I think then the "Elasticsearch record: Show" link on staff side details should be removed. A nonfunctioning feature shouldn't be left in, even if users can hide it with IntranetUserCSS.
It's a very useful feature, and it should be functioning on all up-to-date systems. Are you still having issues with this? -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #21 from Eric Phetteplace <ephetteplace@cca.edu> --- I checked before posting my comment and am still receiving a 404 error. I've hidden the link from staff for now. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #22 from David Cook <dcook@prosentient.com.au> --- (In reply to Eric Phetteplace from comment #21)
I checked before posting my comment and am still receiving a 404 error. I've hidden the link from staff for now.
What versions of Koha and Elasticsearch are you using? -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #23 from Eric Phetteplace <ephetteplace@cca.edu> --- We're on the standard hosted ByWater stack, so presumably we're not the only ones having this problem. Koha 25.11.04 right now (but this has been a problem since I reported it over a year ago) and Elasticsearch 7.17.28. Under Perl Modules I see "Search::Elasticsearch (6.80 ) 6.81". -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #24 from David Cook <dcook@prosentient.com.au> --- (In reply to Eric Phetteplace from comment #23)
We're on the standard hosted ByWater stack, so presumably we're not the only ones having this problem. Koha 25.11.04 right now (but this has been a problem since I reported it over a year ago) and Elasticsearch 7.17.28. Under Perl Modules I see "Search::Elasticsearch (6.80 ) 6.81".
That's interesting What OS are you on? With libsearch-elasticsearch-perl, I don't see any modules that old on a publicly support OS: Ubuntu: Package libsearch-elasticsearch-perl jammy (22.04LTS) (perl): Perl client for Elasticsearch [universe] 7.715-1: all noble (24.04LTS) (perl): Perl client for Elasticsearch [universe] 8.12-1: all questing (25.10) (perl): Perl client for Elasticsearch [universe] 8.12-1: all resolute (26.04LTS) (perl): Perl client for Elasticsearch [universe] 8.12-1: all stonking (perl): Perl client for Elasticsearch [universe] 8.12-1: all Debian: Package libsearch-elasticsearch-perl bullseye (oldoldstable) (perl): Perl client for Elasticsearch 7.30-1: all bookworm (oldstable) (perl): Perl client for Elasticsearch 8.00-1: all trixie (stable) (perl): Perl client for Elasticsearch 8.12-1: all forky (testing) (perl): Perl client for Elasticsearch 8.12-1: all sid (unstable) (perl): Perl client for Elasticsearch 8.12-1: all I have a server on Koha 25.11.04 and for Perl I have "Search::Elasticsearch (6.80 ) 8.12". I'm using Ubuntu 24.04 and OpenSearch 2. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #25 from David Cook <dcook@prosentient.com.au> --- But I do see these other two packages... libsearch-elasticsearch-client-1-0-perl libsearch-elasticsearch-client-2-0-perl But those look outdated... It looks like https://github.com/elastic/elasticsearch-perl/issues/227 talks about this a bit... I wonder if Bywater accidentally installed an outdated client on your system... For what it's worth, 8.12 is also from 2024 and it's the last version that Elastic released. At some stage, we'll need to switch to a different Elasticsearch client (or write our own). -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #26 from Fridolin Somers <fridolin.somers@biblibre.com> --- Ah maybe we should update the cpanfile : https://git.koha-community.org/Koha-community/Koha/src/commit/bb83b600ecaacb... -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #27 from David Cook <dcook@prosentient.com.au> --- (In reply to Fridolin Somers from comment #26)
Ah maybe we should update the cpanfile :
https://git.koha-community.org/Koha-community/Koha/src/commit/ bb83b600ecaacbfdfdda2f7f06ea12bf8a71ef72/cpanfile#L103
Ah yes that's a good idea. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #28 from Eric Phetteplace <ephetteplace@cca.edu> ---
That's interesting What OS are you on?
About Koha says Debian: Linux cca 4.19.0-27-amd64 #1 SMP Debian 4.19.316-1 (2024-06-25) x86_64 -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=38912 --- Comment #29 from David Cook <dcook@prosentient.com.au> --- (In reply to Eric Phetteplace from comment #28)
That's interesting What OS are you on?
About Koha says Debian:
Linux cca 4.19.0-27-amd64 #1 SMP Debian 4.19.316-1 (2024-06-25) x86_64
While it doesn't say what Debian version it is, based off that kernel version, I'd say it's probably Debian 10 Buster which was EOL on June 30 2024. I'd recommend that you ask for a server upgrade, because that's quite out of date. I'm a bit surprised that 25.11.04 would even be running on that. -- You are receiving this mail because: You are watching all bug changes.
participants (1)
-
bugzilla-daemon@bugs.koha-community.org