[Bug 36147] New: Load Austlang dataset from source to make available as authorised values
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36147 Bug ID: 36147 Summary: Load Austlang dataset from source to make available as authorised values Change sponsored?: --- Product: Koha Version: master Hardware: All OS: All Status: NEW Severity: enhancement Priority: P5 - low Component: Cataloging Assignee: koha-bugs@lists.koha-community.org Reporter: aleisha@catalyst.net.nz QA Contact: testopia@bugs.koha-community.org CC: m.de.rooy@rijksmuseum.nl Austlang provides information about Indigenous Australian languages which has been assembled from referenced sources. The dataset provided at https://collection.aiatsis.gov.au/datasets/austlang/001 includes the language names, each with a unique alpha-numeric code which functions as a stable identifier, alternative/variant names and spellings and the approximate location of each language variety. This is a live dataset and is updated regularly. It would be great to have a cronjob that regularly pulled this dataset to keep an authorised value category of AUSTLANG updated with Indigenous Australian languages -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36147 Aleisha Amohia <aleisha@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|koha-bugs@lists.koha-commun |aleisha@catalyst.net.nz |ity.org | Status|NEW |ASSIGNED Change sponsored?|--- |Sponsored -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36147 --- Comment #1 from Aleisha Amohia <aleisha@catalyst.net.nz> --- Created attachment 162330 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=162330&action=edit Bug 36147: [WIP] Load Austlang dataset from source to make available as authorised values -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36147 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |dcook@prosentient.com.au -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36147 Aleisha Amohia <aleisha@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|ASSIGNED |Needs Signoff -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36147 Aleisha Amohia <aleisha@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #162330|0 |1 is obsolete| | --- Comment #2 from Aleisha Amohia <aleisha@catalyst.net.nz> --- Created attachment 162354 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=162354&action=edit Bug 36147: Script to load Austlang dataset from source to make available as authorised values This enhancement adds a new cronjob that can be scheduled to regularly load Indigenous Australian languages (Austlang) data from an external source, process it, then create or update authorised values of this data. This enhancement also adds an AUSTLANG authorised value category which can be used for the Austlang data. To test: 1) Check the documentation for the script is clear and accurate perldoc misc/cronjobs/download_austlang_for_authvalues.pl 2) Run the script with the verbose flag to see an error. You should see the error "No AUSTLANG authorised value category found." ./misc/cronjobs/download_austlang_for_authvalues.pl -v 3) Install the database update and confirm in Koha Administration -> Authorized values that the AUSTLANG category exists, with no values in it 4) Run the script with a fake URL to see the error "Error accessing data." ./misc/cronjobs/download_austlang_for_authvalues.pl -v --url 'bad-url' 5) Run the script normally. When you refresh the AUSTLANG authorised values page, there should be languages loaded as authorised values. ./misc/cronjobs/download_austlang_for_authvalues.pl -v [--category AUSTLANG] 6) Run the script again to confirm it skips matches by default, i.e. a message is printed "Authorised value match found, not updating: Y80" ./misc/cronjobs/download_austlang_for_authvalues.pl -v [--category AUSTLANG] 7) Run the script with the --update flag so it updates matches. Confirm a count of updated values is printed at the end. ./misc/cronjobs/download_austlang_for_authvalues.pl -v --update [--category AUSTLANG] Sponsored-by: Education Services Australia SCIS -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36147 Pedro Amorim <pedro.amorim@ptfs-europe.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |pedro.amorim@ptfs-europe.co | |m -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36147 Martin Renvoize <martin.renvoize@ptfs-europe.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |martin.renvoize@ptfs-europe | |.com Status|Needs Signoff |Failed QA --- Comment #3 from Martin Renvoize <martin.renvoize@ptfs-europe.com> --- This should really be a plugin in my opinion. I don't see why it should be another script added to Core. There is a cron hook that could be used perfectly for this I believe. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36147 --- Comment #4 from David Cook <dcook@prosentient.com.au> --- (In reply to Martin Renvoize from comment #3)
This should really be a plugin in my opinion. I don't see why it should be another script added to Core.
There is a cron hook that could be used perfectly for this I believe.
+1 -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36147 --- Comment #5 from Martin Renvoize <martin.renvoize@ptfs-europe.com> --- I will add that I'm really looking forward to having a more public way of discovering plugins.. that's one of my big goals at Hackfest.. so this isn't a 'No, don't do this'.. it's "lets do this is a more modular/manageable way" :) -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36147 Aleisha Amohia <aleisha@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |MOVED Status|Failed QA |RESOLVED --- Comment #6 from Aleisha Amohia <aleisha@catalyst.net.nz> --- Totally hear you both, and agree this is better as a plugin :) Working on that over at https://gitlab.com/aleishaamohia/koha-plugin-austlang -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36147 Aleisha Amohia <aleisha@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- URL| |https://gitlab.com/aleishaa | |mohia/koha-plugin-austlang -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36147 --- Comment #7 from David Cook <dcook@prosentient.com.au> --- (In reply to Aleisha Amohia from comment #6)
Totally hear you both, and agree this is better as a plugin :)
Working on that over at https://gitlab.com/aleishaamohia/koha-plugin-austlang
Sounds good :) I meant to mention earlier that I have a library who use MarcEdit to convert the Austlang CSV into MARC Authority records, if I recall correctly. I think though that they've created them with their own authority type, which I think might have some negative consequences with indexing. I recommended they just add them as Topic Terms for indexing purposes but I think they stuck with the custom type. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36147 --- Comment #8 from Aleisha Amohia <aleisha@catalyst.net.nz> --- (In reply to David Cook from comment #7)
(In reply to Aleisha Amohia from comment #6)
Totally hear you both, and agree this is better as a plugin :)
Working on that over at https://gitlab.com/aleishaamohia/koha-plugin-austlang
Sounds good :)
I meant to mention earlier that I have a library who use MarcEdit to convert the Austlang CSV into MARC Authority records, if I recall correctly.
I think though that they've created them with their own authority type, which I think might have some negative consequences with indexing. I recommended they just add them as Topic Terms for indexing purposes but I think they stuck with the custom type.
Ah yes that sounds interesting. This feature was so they could link Indigenous Australian languages specifically in the 041$a, hence the use of authorised values. -- You are receiving this mail because: You are watching all bug changes.
participants (1)
-
bugzilla-daemon@bugs.koha-community.org