[Koha-bugs] [Bug 26832] Elasticsearch mappings export should use UTF-8

[bugzilla-daemon at bugs.koha-community.org]

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=26832

David Nind <david at davidnind.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |david at davidnind.com

--- Comment #3 from David Nind <david at davidnind.com> ---
I hope I tested this right!

I followed the test plan without applying the patch. I got an error with
resetting the mappings at steps 8-9:

DBIx::Class::Storage::DBI::_dbh_execute(): Incorrect string value: '\xE9ro' for
column 'label' at row 1 at /kohadevbox/koha/Koha/Objects.pm line 114
 at /usr/share/perl5/DBIx/Class/Exception.pm line 77

Notes for testing using koha-testing-docker:

1. Before starting testing setup elastic search as the search engine:
   i. Enable Elasticsearch: system preference SearchEngine
   ii. Reindex: koha-elasticsearch --rebuild -b -a kohadev
2. For step 4:
   i. Uncomment in /etc/koha/sites/kohadev/koha-conf.xml:
<elasticsearch_index_mappings>
   ii. Note the location of the file:
/etc/koha/sites/kohadev/searchengine/elasticsearch/mappings.yaml
   iii. Create the directories: searchengine and elasticsearch
3. For step 5: 
   i. misc/search_tools/export_elasticsearch_mappings.pl -t marc21 >
/etc/koha/sites/kohadev/searchengine/elasticsearch/mappings.yaml
   ii. Check that the mappings.yaml file was created
   iii. Change ownership: chown -R kohadev-koha:kohadev-koha
/etc/koha/sites/kohadev/searchengine
4. I got errors in the user interface, a trace error page when trying to Reset
Mappings, and when trying to reindex.
5. I got past this by:
   i. applying the patch
   ii. disabling <elasticsearch_index_mappings> in koha-conf.xml
   iii. flush_memcached, restart_all 
   iv. Reset Mappings
   v. rerunning through the test plan (see notes 2 and 3 above)
6. To check if the file is UTF-8 use uchardet command:
   i. Install uchardet: apt-get install uchardet
   ii. Check the file format: uchardet
/etc/koha/sites/kohadev/searchengine/elasticsearch/mappings.yaml
   iii. It should show as being UTF-8

-- 
You are receiving this mail because:
You are watching all bug changes.