[Bug 31504] New: ElasticSearch No indexing new records after upgrade
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=31504 Bug ID: 31504 Summary: ElasticSearch No indexing new records after upgrade Change sponsored?: --- Product: Koha Version: unspecified Hardware: All OS: All Status: NEW Severity: enhancement Priority: P5 - low Component: Searching - Elasticsearch Assignee: koha-bugs@lists.koha-community.org Reporter: hagud@orex.es After upgrading koha 21.11 to 22.05 ElasticSearch is not able to index new records. At webadmin we can see the warning 'Index 'koha_xxxxxx' needs to be recreated.' Executing 'Reset mapping' button doesn't fix the error... when trying to full reindex with option -d or -r it doesn't work admin@___21:~$ sudo koha-elasticsearch --rebuild -d ___ sudo: unable to resolve host ___21: Name or service not known sudo: unable to resolve host ___21: Name or service not known Use of uninitialized value $reason in concatenation (.) or string at /usr/share/koha/lib/Koha/SearchEngine/Elasticsearch/Indexer.pm line 283. Exception 'Koha::Exception' thrown 'Unable to update mappings for index "koha_____biblios". Reason was: "". Index needs to be recreated and reindexed' Something went wrong rebuilding indexes for ___ Removing the index directly at ElasticSearch doesn't works * ElasticSearch is not localhost -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=31504 Katrin Fischer <katrin.fischer@bsz-bw.de> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |nick@bywatersolutions.com -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=31504 --- Comment #1 from Nick Clemens <nick@bywatersolutions.com> --- Can you share the ES config, with the instance name replaced, rather than removed? The issue seems to be that ES cannot be reached, can you curl the host? that should get you the standard es 'you know, for search' response (In reply to Hugo Agud from comment #0)
After upgrading koha 21.11 to 22.05 ElasticSearch is not able to index new records.
At webadmin we can see the warning
'Index 'koha_xxxxxx' needs to be recreated.'
Executing 'Reset mapping' button doesn't fix the error... when trying to full reindex with option -d or -r it doesn't work
admin@___21:~$ sudo koha-elasticsearch --rebuild -d ___
sudo: unable to resolve host ___21: Name or service not known
sudo: unable to resolve host ___21: Name or service not known
Use of uninitialized value $reason in concatenation (.) or string at /usr/share/koha/lib/Koha/SearchEngine/Elasticsearch/Indexer.pm line 283.
Exception 'Koha::Exception' thrown 'Unable to update mappings for index "koha_____biblios". Reason was: "". Index needs to be recreated and reindexed'
Something went wrong rebuilding indexes for ___
Removing the index directly at ElasticSearch doesn't works
* ElasticSearch is not localhost
-- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=31504 --- Comment #2 from Hugo Agud <hagud@orex.es> --- Hi It is not an ES issue, it is a koha issue, I am pretty sure (and it has been appeared just with 22.05 not previous upgrades) I have checked this koha with many ES Servers (new and previous working ES v6.*), I have checked with working ES, with same results. I saw this error in the very beginng of testing koha, and it was an url (I can't remmeber that via url and 'I know what I am doing') you can delete index. Exception 'Koha::Exception' thrown 'Unable to update mappings for index "koha__demo1_biblios". Reason was: "". Index needs to be recreated and reindexed' It is something that can't be overwritten in koha that makes it crash -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=31504 Hannah Co <hannah.co@northwestu.edu> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |hannah.co@northwestu.edu -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=31504 --- Comment #3 from Hannah Co <hannah.co@northwestu.edu> --- I am seeing some of the same errors with Koha 23.05. on koha-elasticsearch index attempt I see Exception 'Koha::Exception' thrown 'Unable to update mappings for index "koha_elastic2_biblios". Reason was: "Validation Failed: 1: mapping type is missing;". Index needs to be recreated and reindexed' Something went wrong rebuilding indexes for koha Not sure about Hugo's setup, but here is what I have when I curl elasticsearch. In my case elasticsearch is on the same server as Koha. { "name" : "koha-node", "cluster_name" : "elasticsearch", "cluster_uuid" : "t8fdCQ9nQz6PIFsEXXQFew", "version" : { "number" : "6.8.23", "build_flavor" : "default", "build_type" : "deb", "build_hash" : "4f67856", "build_date" : "2022-01-06T21:30:50.087716Z", "build_snapshot" : false, "lucene_version" : "7.7.3", "minimum_wire_compatibility_version" : "5.6.0", "minimum_index_compatibility_version" : "5.0.0" }, "tagline" : "You Know, for Search" } let me know if any other info would help with this bug! -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=31504 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |dcook@prosentient.com.au --- Comment #4 from David Cook <dcook@prosentient.com.au> --- Sounds like a networking issue to me, so not a Koha or ES issue. You'll want to double-check your hostname and your /etc/hosts for starters. I know this has been an issue on your systems in the past, Hugo. Then you'll want to double-check your node config in your koha-conf.xml. -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=31504 --- Comment #5 from David Cook <dcook@prosentient.com.au> --- (In reply to Hannah Co from comment #3)
Exception 'Koha::Exception' thrown 'Unable to update mappings for index "koha_elastic2_biblios". Reason was: "Validation Failed: 1: mapping type is missing;". Index needs to be recreated and reindexed' Something went wrong rebuilding indexes for koha
Not sure about Hugo's setup, but here is what I have when I curl elasticsearch. In my case elasticsearch is on the same server as Koha.
{ "name" : "koha-node", "cluster_name" : "elasticsearch", "cluster_uuid" : "t8fdCQ9nQz6PIFsEXXQFew", "version" : { "number" : "6.8.23", "build_flavor" : "default", "build_type" : "deb", "build_hash" : "4f67856", "build_date" : "2022-01-06T21:30:50.087716Z", "build_snapshot" : false, "lucene_version" : "7.7.3", "minimum_wire_compatibility_version" : "5.6.0", "minimum_index_compatibility_version" : "5.0.0" }, "tagline" : "You Know, for Search" }
let me know if any other info would help with this bug!
I don't think that Koha supports Elasticsearch 6 anymore. "type" was deprecated and removed in newer versions, which is why Koha doesn't send it as a parameter anymore. You'll need to upgrade your Elasticsearch. -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=31504 --- Comment #6 from David Cook <dcook@prosentient.com.au> --- Overall, I'd say these are support issues, but let's leave this ticket open a little while longer... -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=31504 Katrin Fischer <katrin.fischer@bsz-bw.de> changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |INVALID Summary|ElasticSearch No indexing |Elasticsearch not indexing |new records after upgrade |new records after upgrade Status|NEW |RESOLVED --- Comment #7 from Katrin Fischer <katrin.fischer@bsz-bw.de> --- I think that's the issue: with Koha 23.05 Elasticsearch 6 is no longer supported. An update of Elasticsearch is required: https://wiki.koha-community.org/wiki/System_requirements_and_recommendations -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=31504 Katrin Fischer <katrin.fischer@bsz-bw.de> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|RESOLVED |REOPENED Resolution|INVALID |--- --- Comment #8 from Katrin Fischer <katrin.fischer@bsz-bw.de> --- Hm, OK, I see I misread the version numbers - but maybe something got backported that would explain the issues? -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=31504 --- Comment #9 from Katrin Fischer <katrin.fischer@bsz-bw.de> --- Hi Hugo, has this been resolved or is this still an issue? -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=31504 --- Comment #10 from Hugo Agud <hagud@orex.es> --- Yes, I have not found this behaviour again thanks! -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=31504 Katrin Fischer <katrin.fischer@bsz-bw.de> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|REOPENED |RESOLVED Resolution|--- |WORKSFORME --- Comment #11 from Katrin Fischer <katrin.fischer@bsz-bw.de> --- I'll close then, please feel free to re-open if it turns up again. (I hope not!) -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
participants (1)
-
bugzilla-daemon＠bugs.koha-community.org