June 2022 - Koha-bugs - lists.koha-community.org

[Bug 10662] Build OAI-PMH Harvesting Client
by bugzilla-daemon＠bugs.koha-community.org 17 Jun '22

17 Jun '22

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=10662 --- Comment #314 from David Cook <dcook(a)prosentient.com.au> --- Fortunately, since we have RabbitMQ now, some of it should be a lot easier! (I was just looking at bug 27421 which asynchronously stages, imports, and reverts MARC imports. It could be helpful for this work too.) *The hard part for the OAI-PMH harvester in Koha is the task scheduling.* Koha doesn't have any way to let users define their own task schedules. (Back in 2018, Frido also mentioned Koha support companies might not want to let librarians set task schedules for OAI-PMH anyway for performance/API rate limiting reasons.) That said, if librarians controlling the scheduling doesn't matter for you, you could just create a cronjob that sends OAI-PMH tasks to RabbitMQ (or a plugin that uses the nightly plugin cronjob). Then all that's left is to create a Koha::BackgroundJob::OAIPMHHarvest class. -- The background job class could probably encapsulate the entire task. (For bug 10662, the requirement was to download records every 3 seconds, so I had to split the harvest/download and import tasks into two separate asynchronous tasks to achieve fast enough download speeds.) For bug 10662, I also had a requirement to handle very long XML streams over HTTP rather than the usual short XML responses, which technically is allowed according to the OAI-PMH specification, and that meant a custom downloader. It was high performance but it meant I had to add even more code. In theory, you might be able to have Koha::BackgroundJob::OAIPMH::Download, Koha::BackgroundJob::OAIPMH::Stage and Koha::BackgroundJob::OAIPMH::Import classes. The scheduler (e.g. cronjob) could enqueue a Koha::BackgroundJob::OAIPMH::Download task which downloads the records, that could then enqueue a Koha::BackgroundJob::OAIPMH::Stage task to stage (ie run the matcher/duplicate finder and ideally do some OAI-PMH specific checks), and that could enqueue the final Koha::BackgroundJob::OAIPMH::Import task to run the actual import. (The advantage of breaking it into 3 different tasks is that Koha by default only has 1 background job worker, so very long tasks could prevent other tasks from running in a timely way.) (However, if we had more than 1 background job worker, I'd be a little concerned about race conditions where Worker B tries to import Record 1-A after Worker A has imported Record 1-B where Record 1-A is older than Record 1-B. There needs to be a sanity check to make sure that records only overwrite older records.) Depending on how bug 27421 works, Koha::BackgroundJob::OAIPMH::Stage and Koha::BackgroundJob::OAIPMH::Import could potentially be subclasses of Koha::BackgroundJob::StageMARCForImport and Koha::BackgroundJob::StageMARCForImport. Although I don't really like Koha's built-in MARC import classes for OAI-PMH, because once records are staged they're imported without any sanity checks. Also record matching rules are user-controllable and solely MARC based so they're unreliable and not great for matching incoming OAI-PMH records to past harvested records. -- You are receiving this mail because: You are watching all bug changes.

1 0

[Bug 10662] Build OAI-PMH Harvesting Client
by bugzilla-daemon＠bugs.koha-community.org 17 Jun '22

17 Jun '22

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=10662 --- Comment #313 from David Cook <dcook(a)prosentient.com.au> --- (In reply to Koha Team University Lyon 3 from comment #311) > Hi, > KohaLA is intersted in continuing this feature and we are probably going to > fund some devs on that. > > Sonia That's great to hear! I think the problem with bug 10662 is that I tried to create too many things in one bug report. -- You are receiving this mail because: You are watching all bug changes.

1 0

[Bug 10950] Add preferred pronoun field to patron record
by bugzilla-daemon＠bugs.koha-community.org 17 Jun '22

17 Jun '22

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=10950 --- Comment #35 from David Cook <dcook(a)prosentient.com.au> --- (In reply to Owen Leonard from comment #22) > As a future improvement, we might want to do something like what I > implemented for my library's internal employee directory app: A JS plugin > called Tom Select (https://tom-select.js.org/) which allows you to specify > some predefined choices but also allows the user to enter their own custom > values instead. The predefined choices could be added as authorized values. I like the sound of being able to choose between your own free text or a predefined choice -- You are receiving this mail because: You are watching all bug changes.

1 0

[Bug 10950] Add preferred pronoun field to patron record
by bugzilla-daemon＠bugs.koha-community.org 16 Jun '22

16 Jun '22

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=10950 --- Comment #34 from Katrin Fischer <katrin.fischer(a)bsz-bw.de> --- (In reply to Jonathan Druart from comment #33) > To make this change usable I think we should have a new AV category to list > the different choices. By default it could come with a predefined list that > would be translatable. > > Unless we really want to keep it a free text field? I think that was intended, what do you think about just a category, but leave empty, and make it like bsort1 (free text but AV possible?) -- You are receiving this mail because: You are watching all bug changes.

1 0

[Bug 3544] Value builder plug-ins don't work with repeatable subfields
by bugzilla-daemon＠bugs.koha-community.org 16 Jun '22

16 Jun '22

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=3544 --- Comment #8 from Katrin Fischer <katrin.fischer(a)bsz-bw.de> --- I see you linked bug 30975 already, could this be a duplicate? -- You are receiving this mail because: You are watching all bug changes.

1 0

[Bug 3544] Value builder plug-ins don't work with repeatable subfields
by bugzilla-daemon＠bugs.koha-community.org 16 Jun '22

16 Jun '22

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=3544 --- Comment #7 from Katrin Fischer <katrin.fischer(a)bsz-bw.de> --- I've heard a similar complaint recently, could it be a browser issue? -- You are receiving this mail because: You are watching all bug changes.

1 0

[Bug 29483] New: AllowRenewalIfOtherItemsAvailable has poor performance for records with many items
by bugzilla-daemon＠bugs.koha-community.org 16 Jun '22

16 Jun '22

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29483 Bug ID: 29483 Summary: AllowRenewalIfOtherItemsAvailable has poor performance for records with many items Change sponsored?: --- Product: Koha Version: master Hardware: All OS: All Status: NEW Severity: normal Priority: P5 - low Component: Architecture, internals, and plumbing Assignee: koha-bugs(a)lists.koha-community.org Reporter: nick(a)bywatersolutions.com QA Contact: testopia(a)bugs.koha-community.org When a record has many items and holds and the check to see if other items available can take a long time to return -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.

1 61

[Bug 10950] Add preferred pronoun field to patron record
by bugzilla-daemon＠bugs.koha-community.org 16 Jun '22

16 Jun '22

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=10950 Jonathan Druart <jonathan.druart+koha(a)gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jonathan.druart+koha@gmail. | |com --- Comment #33 from Jonathan Druart <jonathan.druart+koha(a)gmail.com> --- To make this change usable I think we should have a new AV category to list the different choices. By default it could come with a predefined list that would be translatable. Unless we really want to keep it a free text field? -- You are receiving this mail because: You are watching all bug changes.

1 0

[Bug 30977] New: Set mar21_linking_records.pl value builder in frameworks by default
by bugzilla-daemon＠bugs.koha-community.org 16 Jun '22

16 Jun '22

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=30977 Bug ID: 30977 Summary: Set mar21_linking_records.pl value builder in frameworks by default Change sponsored?: --- Product: Koha Version: unspecified Hardware: All OS: All Status: NEW Severity: enhancement Priority: P5 - low Component: MARC Bibliographic data support Assignee: koha-bugs(a)lists.koha-community.org Reporter: katrin.fischer(a)bsz-bw.de QA Contact: testopia(a)bugs.koha-community.org The mar21_linking_records.pl is a very helpful plugin when linking records from the various 77x fields. It will allow you to search for the record you want to link and pull in the information from it into various subfields. I believe this feature is not known very well and it would help if we added it to the default frameworks. It doesn't alter the behaviour of the fields if not used, so no harm done :) -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.

1 2

[Bug 3544] Value builder plug-ins don't work with repeatable subfields
by bugzilla-daemon＠bugs.koha-community.org 16 Jun '22

16 Jun '22

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=3544 Jonathan Druart <jonathan.druart+koha(a)gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.koha-community | |.org/bugzilla3/show_bug.cgi | |?id=30975 -- You are receiving this mail because: You are watching all bug changes.

1 0