[Bug 39557] New: Normalize MARC21 XML metadata into structured MySQL database tables via Koha Plugin
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=39557 Bug ID: 39557 Summary: Normalize MARC21 XML metadata into structured MySQL database tables via Koha Plugin Change sponsored?: --- Product: Koha Version: Main Hardware: All OS: All Status: NEW Severity: enhancement Priority: P5 - low Component: MARC Bibliographic data support Assignee: koha-bugs@lists.koha-community.org Reporter: koha@trust-box.at QA Contact: testopia@bugs.koha-community.org The proposed plugin (Koha::Plugin::HKS3::NormalizeMARC2DB) aims to normalize MARC21 XML metadata from the biblio_metadata.metadata table into structured MySQL database tables. Currently, MARC21 XML is stored as a single XML blob, making advanced querying, reporting, and integration difficult. This plugin introduces an automatic normalization step triggered by the after_biblio_action hook whenever metadata is added or modified. It splits MARC XML into normalized relational tables fully supporting repeatable fields, subfields, and indicators. Advantages: Significantly simplifies complex querying and reporting of MARC21 data. Enhances data integrity and consistency. Facilitates integration with external reporting tools, analytics, and applications. Improves database performance for MARC metadata queries. Provides clear and structured access to MARC data elements. This approach aligns with best practices for database normalization and can substantially enhance Koha's extensibility and interoperability. -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=39557 Mark Hofstetter <koha@trust-box.at> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |koha@trust-box.at URL| |https://github.com/HKS3/koh | |a-normalize-marc2db -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=39557 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |dcook@prosentient.com.au -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=39557 Jonathan Druart <jonathan.druart@gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jonathan.druart@gmail.com -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=39557 --- Comment #1 from Mark Hofstetter <koha@trust-box.at> --- please checkout - install via kpz, and read instruction (you have to "run tool") https://github.com/HKS3/koha-normalize-marc2db https://github.com/HKS3/koha-normalize-marc2db/releases -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=39557 Katrin Fischer <katrin.fischer@bsz-bw.de> changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|koha-bugs@lists.koha-commun |koha@trust-box.at |ity.org | CC| |michaela.sieber@kit.edu, | |nick@bywatersolutions.com, | |simon.hohl@dainst.org --- Comment #2 from Katrin Fischer <katrin.fischer@bsz-bw.de> --- I feel like this can get easily lost in bugzilla as it's not in the queues for testing. Adding some parties that might be interested in testing. -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=39557 Michelle Spinney <mspinney@clamsnet.org> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mspinney@clamsnet.org -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=39557 catherine.micklethwaite@nhs.net changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |catherine.micklethwaite@nhs | |.net --- Comment #3 from catherine.micklethwaite@nhs.net --- It would be a huge advantage to have something like this in place - I'm new to Koha and really surprised at how difficult it is to interrogate and modify MARC data -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=39557 Arthur Suzuki <arthur.suzuki@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |arthur.suzuki@biblibre.com -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=39557 --- Comment #4 from Mark Hofstetter <mark@hofstetter.at> --- released a new version of nm2db https://github.com/HKS3/koha-normalize-marc2db please consider upgrading -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=39557 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.koha-community | |.org/bugzilla3/show_bug.cgi | |?id=42164 -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=39557 --- Comment #5 from David Cook <dcook@prosentient.com.au> --- (In reply to catherine.micklethwaite from comment #3)
It would be a huge advantage to have something like this in place - I'm new to Koha and really surprised at how difficult it is to interrogate and modify MARC data
That's a good point. It can be frustrating how difficult it is to interrogate and modify MARC data in Koha. That said, for a systems librarian or tech person, it's not too bad because there are a number of options using APIs, Z39.50, MarcEdit, etc. I would actually like to experiment with building up the APIs more and having more modular cataloguing editors. (At some point, I plan to integrate Koha with Marva Quartz - the open source BIBFRAME editor from the Library of Congress.) Catherine, could you speak to some more of your use cases? I think Mark's work here would be useful for you for sure, but maybe there's something else we can do for you in the meantime as well. -- You are receiving this mail because: You are watching all bug changes.
participants (1)
-
bugzilla-daemon＠bugs.koha-community.org