[Bug 20390] New: Elasticsearch - Biblio mappings for UNIMARC (updates existing)
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 Bug ID: 20390 Summary: Elasticsearch - Biblio mappings for UNIMARC (updates existing) Change sponsored?: --- Product: Koha Version: master Hardware: All OS: All Status: NEW Severity: enhancement Priority: P5 - low Component: Searching - Elasticsearch Assignee: koha-bugs@lists.koha-community.org Reporter: claire.hernandez@biblibre.com -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Patch complexity|--- |Large patch -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 --- Comment #1 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- Created attachment 72806 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=72806&action=edit Bug 20390: UNIMARC biblio mappings WIP Current status: NEW -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #72806|0 |1 is obsolete| | --- Comment #2 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- Created attachment 72884 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=72884&action=edit Bug 20390: UNIMARC biblio mappings WIP -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 --- Comment #3 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- Created attachment 72885 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=72885&action=edit Follow-up: Bug 20390: UNIMARC biblio mappings WIP -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Change sponsored?|--- |Sponsored -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |Needs Signoff -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 --- Comment #4 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- Created attachment 74428 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=74428&action=edit Follow-up: Bug 20390: UNIMARC biblio mappings from Gaetan Boisson -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #72884|0 |1 is obsolete| | Attachment #72885|0 |1 is obsolete| | Attachment #74428|0 |1 is obsolete| | --- Comment #5 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- Created attachment 74429 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=74429&action=edit Bug 20390: UNIMARC biblio mappings This is a unimarc default mappings for Koha Elasticsearch implementation by Claudie Trégouët and Gaetan Boisson. There will have updates because some discussions are in progress. To test: 1) Delete data from search_marc_map, search_marc_to_field search_field 2) Reset mappings with the url mappings.pl?op=reset&i_know_what_i_am_doing=1 3) Rebuild the whole index rebuild_elastic_search.pl -d -b 4) Have a look to the mappings interface 5) Check if the recorded information in elasticsearch are with the expected mappings. -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 Nicolas Legrand <nicolas.legrand@bulac.fr> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |nicolas.legrand@bulac.fr Status|Needs Signoff |Patch doesn't apply --- Comment #6 from Nicolas Legrand <nicolas.legrand@bulac.fr> --- mappings.yaml has been moved by bug 20073. -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Patch doesn't apply |Needs Signoff -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #74429|0 |1 is obsolete| | --- Comment #7 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- Created attachment 75388 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=75388&action=edit Bug 20390: UNIMARC biblio mappings This is a unimarc default mappings for Koha Elasticsearch implementation by Claudie Trégouët and Gaetan Boisson. There will have updates because some discussions are in progress. To test: 1) Delete data from search_marc_map, search_marc_to_field search_field 2) Reset mappings with the url mappings.pl?op=reset&i_know_what_i_am_doing=1 3) Rebuild the whole index rebuild_elastic_search.pl -d -b 4) Have a look to the mappings interface 5) Check if the recorded information in elasticsearch are with the expected mappings. Rebased by : Claire Hernandez <claire.hernandez@biblibre.com> 2018/17/05 -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 --- Comment #8 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- Created attachment 75389 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=75389&action=edit Bug 20390: (follow-up) UNIMARC biblio mappings - Clean the title mapping for Unimarc: 464, 413 and 454 are kept. If you need more, it is better to add it at the installation than removing a lot. - Change type of 995w for unimarc Sponsored-by: BULAC (Bibliothèque universitaire des langues et civilisations) -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 --- Comment #9 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- Created attachment 75390 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=75390&action=edit Bug 20390: (follow-up) UNIMARC mappings - Fix a typo in unimarc mappings (for authorities mapping) See comment on Bug 17373 -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|Elasticsearch - Biblio |Elasticsearch - Mappings |mappings for UNIMARC |for UNIMARC (updates |(updates existing) |existing) -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 Séverine Queune <severine.queune@bulac.fr> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Needs Signoff |Patch doesn't apply CC| |severine.queune@bulac.fr --- Comment #10 from Séverine Queune <severine.queune@bulac.fr> --- Applied on sandbox#12 : The sandbox you've requested is not ready. Some problems occurred applying patches from bug 20390: <h1>Something went wrong !</h1>Applying: Bug 20390: UNIMARC biblio mappings Using index info to reconstruct a base tree... A etc/searchengine/elasticsearch/mappings.yaml Falling back to patching base and 3-way merge... Auto-merging admin/searchengine/elasticsearch/mappings.yaml CONFLICT (content): Merge conflict in admin/searchengine/elasticsearch/mappings.yaml error: Failed to merge in the changes. Patch failed at 0001 Bug 20390: UNIMARC biblio mappings The copy of the patch that failed is found in: .git/rebase-apply/patch When you have resolved this problem run git bz apply --continue. If you would prefer to skip this patch, instead run git bz apply --skip. To restore the original branch and stop patching run git bz apply --abort. Bug 20390 - Elasticsearch - Mappings for UNIMARC (updates existing) 75388 - Bug 20390: UNIMARC biblio mappings 75389 - Bug 20390: (follow-up) UNIMARC biblio mappings 75390 - Bug 20390: (follow-up) UNIMARC mappings Apply? [(y)es, (n)o, (i)nteractive] Patch left in /tmp/Bug-20390-UNIMARC-biblio-mappings-lAznq5.patch . -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Depends on| |20073 Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20073 [Bug 20073] Move Elasticsearch settings to configuration files -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Patch doesn't apply |Needs Signoff --- Comment #11 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- 20073 had been reverted, so I was waiting for its push, it now ok so 20390 applies now. Thanks Nick ! -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 Bug 20390 depends on bug 20073, which changed state. Bug 20073 Summary: Move Elasticsearch settings to configuration files https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20073 What |Removed |Added ---------------------------------------------------------------------------- Status|Pushed to Master |RESOLVED Resolution|--- |FIXED -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 Katrin Fischer <katrin.fischer@bsz-bw.de> changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|koha-bugs@lists.koha-commun |claire.hernandez@biblibre.c |ity.org |om CC| |katrin.fischer@bsz-bw.de -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #75389|0 |1 is obsolete| | --- Comment #12 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- Created attachment 85063 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=85063&action=edit Bug 20390: (follow-up) UNIMARC biblio mappings Changes from Laurence -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #75390|0 |1 is obsolete| | --- Comment #13 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- Created attachment 85280 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=85280&action=edit Bug 20390: (follow-up) UNIMARC mappings - Fix a typo in unimarc mappings (for authorities mapping) See comment on Bug 17373 -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #85063|0 |1 is obsolete| | --- Comment #14 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- Created attachment 85284 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=85284&action=edit Bug 20390: (follow-up) UNIMARC biblio mappings Changes from Laurence. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #75388|0 |1 is obsolete| | Attachment #85280|0 |1 is obsolete| | Attachment #85284|0 |1 is obsolete| | CC| |claire.hernandez@biblibre.c | |om --- Comment #15 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- Created attachment 87142 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=87142&action=edit only one rebased and reviewed Mappings reviewed. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #87142|0 |1 is obsolete| | --- Comment #16 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- Created attachment 87720 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=87720&action=edit Unimarc mappings evolution for Elasticsearch -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 Fridolin SOMERS <fridolin.somers@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Depends on| |19575 CC| |fridolin.somers@biblibre.co | |m Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=19575 [Bug 19575] Use canonical field names and resolve aliased fields -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 --- Comment #17 from Fridolin SOMERS <fridolin.somers@biblibre.com> --- Looks like this need to be updated with Bug 19575 changes. Like pubdate => date-of-publication -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 --- Comment #18 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- Created attachment 88922 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=88922&action=edit Mappings review -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #88922|0 |1 is obsolete| | --- Comment #19 from claire.hernandez@biblibre.com <claire.hernandez@biblibre.com> --- Created attachment 88925 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=88925&action=edit (follow-up) Unimarc mappings evolution for Elasticsearch -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 Bug 20390 depends on bug 19575, which changed state. Bug 19575 Summary: Use canonical field names and resolve aliased fields https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=19575 What |Removed |Added ---------------------------------------------------------------------------- Status|Pushed to Stable |RESOLVED Resolution|--- |FIXED -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 e.betemps <e.betemps@gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |e.betemps@gmail.com -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 Fridolin SOMERS <fridolin.somers@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.koha-community | |.org/bugzilla3/show_bug.cgi | |?id=26487 -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 --- Comment #20 from Fridolin Somers <fridolin.somers@biblibre.com> --- Needs rebase -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 Anne-Cécile Bories <anne-cecile.bories@iepg.fr> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |anne-cecile.bories@iepg.fr -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 Alex Arnaud <alex.arnaud@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #87720|0 |1 is obsolete| | Attachment #88925|0 |1 is obsolete| | --- Comment #21 from Alex Arnaud <alex.arnaud@biblibre.com> --- Created attachment 119074 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=119074&action=edit Unimarc mappings evolution for Elasticsearch -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 Alex Arnaud <alex.arnaud@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |alex.arnaud@biblibre.com --- Comment #22 from Alex Arnaud <alex.arnaud@biblibre.com> --- Patches rebased and squashed -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 --- Comment #23 from Alex Arnaud <alex.arnaud@biblibre.com> --- Created attachment 119120 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=119120&action=edit Bug 20390: mappings according to last IFLA updates -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 jmbroust <jean-manuel.broust@univ-lyon2.fr> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jean-manuel.broust@univ-lyo | |n2.fr -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 --- Comment #24 from Fridolin Somers <fridolin.somers@biblibre.com> --- tpubdate is on 100a_/8-11, must be only 100a_/8 -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 --- Comment #25 from Fridolin Somers <fridolin.somers@biblibre.com> --- leader_/1-5 seems wrong, its leader_/0-4 like in MARC21 -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 --- Comment #26 from Fridolin Somers <fridolin.somers@biblibre.com> --- (In reply to Fridolin Somers from comment #25)
leader_/1-5 seems wrong, its leader_/0-4 like in MARC21
For llength I mean -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 --- Comment #27 from Fridolin Somers <fridolin.somers@biblibre.com> --- char-encoding is on 100a. Its missing ranges. In zebra it is : 26-27, 28-29 and 30-31 -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 --- Comment #28 from Fridolin Somers <fridolin.somers@biblibre.com> --- same for : modified-code => 100a_/21 script-title => 100a_/34-35 -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 --- Comment #29 from Fridolin Somers <fridolin.somers@biblibre.com> --- ff8 fields also : ff8-18 : 110a_/1 ff8-18-21 : 105a_/0 ff8-18-21 : 105a_/1 ff8-18-21 : 105a_/2 ff8-18-21 : 105a_/3 ff8-19 : 110a_/2 ff8-21 : 110a_/0 ff8-23 : 106a ff8-29 : 105a_/8 ff8-29 : 110a_/7 ff8-30 : 105a_/9 ff8-31 : 105a_/10 ff8-31 : 110a_/9 -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 mathieu saby <mathsabypro@gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mathsabypro@gmail.com -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20390 Fridolin Somers <fridolin.somers@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Needs Signoff |Patch doesn't apply --- Comment #30 from Fridolin Somers <fridolin.somers@biblibre.com> --- Does not apply. Is first patch obsolete ? Applying only patch with "Bug 20390: ..." does not work eather. -- You are receiving this mail because: You are watching all bug changes.
participants (1)
-
bugzilla-daemon＠bugs.koha-community.org