- Koha-devel - lists.koha-community.org

Optimizing Starman startup
by dcook＠prosentient.com.au 30 Apr '21

30 Apr '21

Hi all, Do you despair when you see the following periodically in "top" when a starman worker is recreated ? PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 9529 my-koha 20 0 460108 197212 17172 R 100.0 0.4 0:03.41 /usr/share/koha/api/v1/app.pl Or the following in top when you install koha-common package or restart the koha-common service? 11101 1-koha 20 0 447232 193320 16076 R 10.6 0.4 0:09.09 /usr/share/koha/api/v1/app.pl 11168 1-koha 20 0 447240 193264 16056 R 10.6 0.4 0:08.72 /usr/share/koha/api/v1/app.pl 11306 2-koha 20 0 447220 193148 16000 R 10.6 0.4 0:08.07 /usr/share/koha/api/v1/app.pl 11543 2-koha 20 0 447232 193036 15828 R 10.6 0.4 0:07.07 /usr/share/koha/api/v1/app.pl 11784 3-koha 20 0 441536 189664 16172 R 10.6 0.4 0:06.04 /usr/share/koha/api/v1/app.pl 11830 3-koha 20 0 439548 187212 15748 R 10.6 0.4 0:05.82 /usr/share/koha/api/v1/app.pl 11831 4-koha 20 0 438620 186344 15748 R 10.6 0.4 0:05.81 /usr/share/koha/api/v1/app.pl 11853 4-koha 20 0 437680 185672 16000 R 10.6 0.4 0:05.79 /usr/share/koha/api/v1/app.pl Well, I still have a lot of investigation left to do, but I notice 1 place that a lot of time taken is here (per worker): my $validator = JSON::Validator::OpenAPI::Mojolicious->new; $validator->load_and_validate_schema( $self->home->rel_file("api/v1/swagger/swagger.json"), { allow_invalid_ref => 1, } ); push @{$self->routes->namespaces}, 'Koha::Plugin'; my $spec = $validator->schema->data; $self->plugin( 'Koha::REST::Plugin::PluginRoutes' => { spec => $spec, validator => $validator } ); $self->plugin( OpenAPI => { spec => $spec, route => $self->routes->under('/api/v1')->to('Auth#under'), allow_invalid_ref => 1, # required by our spec because $ref directly under # Paths-, Parameters-, Definitions- & Info-object # is not allowed by the OpenAPI specification. } ); Anyone have ideas for improving this? Do we have to validate the schema every time? Can we move the schema validation into a different module and preload it into Starman using the -M flag so that it's done 1 time per Starman master instance rather than 1 time per Starman worker instance? I find "/usr/share/koha/api/v1/app.pl" to be the bane of deployments, as it puts a massive load on a server, when you have multiple Koha instances on the server. David Cook Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595

5 24

git trick for compiled CSS
by Fridolin SOMERS 29 Apr '21

29 Apr '21

Hi, I'd like to share a trick. When generating compiled CSS files, no way to check the git diff since all is on one line. I've managed to find a trick : git show --word-diff shows chucks deleted/added so with some regexp : git show --word-diff $SHA1 | egrep '(\[\-)|(\{\+)' | sed -r 's/^.*(\[\-.*\-\]\{\+.*\+\}).*$/\1/g' For example : aebd3f6a53 Bug 27566: Compiled CSS [-textarea{font-family:NotoSans}.navbar-]{+textarea{font-family:NotoSans,sans-serif}.navbar+} [-textarea{font-family:NotoSans}.navbar-]{+textarea{font-family:NotoSans,sans-serif}.navbar+} [-textarea{font-family:NotoSans}.navbar-]{+textarea{font-family:NotoSans,sans-serif}.navbar+} [-textarea{font-family:NotoSans}.navbar-]{+textarea{font-family:NotoSans,sans-serif}.navbar+} This is very usefull to check that compilation worked and did not broke the 90% of the file XD Best regards :D -- Fridolin SOMERS <fridolin.somers(a)biblibre.com> Software and system maintainer 🦄 BibLibre, France

3 2

Template::Toolkit and Translations
by dcook＠prosentient.com.au 28 Apr '21

28 Apr '21

Hi all, While I mostly work in English, I occasionally do support libraries in other languages like French, Arabic, and Chinese. And more recently Ive been looking at the Languages dropdown in the OPAC advanced search. In the templates, I notice that we often translate HTML, but what if we translated strings for a Template::Toolkit data structure instead? Consider the following: [% BLOCK en %]Anglais[% END %] [% BLOCK fr %]Français[% END %] [% langs.en = INCLUDE en %] [% langs.fr = INCLUDE fr %] I suppose its not very beautiful, but the translation process should be simple and in the end we have a re-usable hash map rather than static HTML. As I commented on Bug 12017 (https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=12017) we could have a database table of language codes with native language names, and then iterate through that and use the hash map of translations to provide the translations. Since were not producing HTML, we could flexibly reuse this language data in various different contexts. Whether its the Languages dropdown in the OPAC advanced search, the language selector, or whatever. We could probably use this concept in other places as well where we need translations but we dont want to be bound to HTML. What do people think? Im not wedded to the idea, but its something that crossed my mind this morning, when I looked at the large switch statements at https://bugs.koha-community.org/bugzilla3/page.cgi?id=splinter.html <https://bugs.koha-community.org/bugzilla3/page.cgi?id=splinter.html&bug=120 17&attachment=40285> &bug=12017&attachment=40285. (To that end, I would also suggest a theme-independent Template::Toolkit include directory, but thats another story) David Cook Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595

2 4

Koha 19.11.17 released
by Victor Grousset/tuxayo 26 Apr '21

26 Apr '21

Hello! The Koha Community is happy to announce the release of Koha 19.11.17 The full release notes can be found at: https://koha-community.org/koha-19-11-17-released/ Debian packages should be available shortly. Thanks to everyone involved :) Cheers, -- Victor Grousset/tuxayo

1 0

Release of Koha 20.05.11
by Andrew Fuerste-Henry 26 Apr '21

26 Apr '21

Hi all! We're proud to announce the release of Koha 20.05.11. This is a maintenance release. Full release notes can be found here: https://koha-community.org/koha-20-05-11-released/ Debian packages should be available in a few days. Thank you! -- Andrew Fuerste-Henry Educator (he/him/his) ByWater Solutions bywatersolutions.com Phone:(888)900-8944 <(888)%20900-8944> What is Koha? <http://bywatersolutions.com/what-is-koha/>

1 0

Issue with bugzilla
by Jonathan Druart 26 Apr '21

26 Apr '21

Hi all, We are experiencing issues on bugzilla. It seems that it is not possible to comment and search. However you can search if you are logged out, and apply patches using git-bz. The issue will certainly not be fixed until tomorrow. Cheers, Jonathan

1 1

Release of Koha 20.11.05
by Fridolin SOMERS 26 Apr '21

26 Apr '21

Hello everyone 🤗 The Koha community is proud to announce the release of Koha 20.11.05. It is a maintenance release. The full release notes are available here: https://koha-community.org/koha-20-11-05-released/ Debian packages should be available in a few days. Best regards 🤓 -- Fridolin SOMERS <fridolin.somers(a)biblibre.com> Software and system maintainer 🦄 BibLibre, France

1 0

Deleting entries from language_descriptions
by dcook＠prosentient.com.au 26 Apr '21

26 Apr '21

Hi all, I was looking at how to add languages to the Languages drop down in the OPAC advanced search and went down an unpleasant C4::Languages rabbithole But looking at language_descriptions, Im wondering if perhaps we could delete the following data, as I imagine its very outdated and unused: MySQL [koha_kohadev]> select * from language_descriptions; +----------+----------+------+---------------------------------------+-----+ | subtag | type | lang | description | id | +----------+----------+------+---------------------------------------+-----+ | opac | i | en | OPAC | 1 | | opac | i | fr | OPAC | 2 | | opac | i | de | OPAC | 3 | | intranet | i | en | Staff Client | 4 | | intranet | i | fr | Client personnel | 5 | | intranet | i | de | Dienstoberfläche | 6 | | prog | t | en | Prog | 7 | | prog | t | fr | Prog | 8 | | prog | t | de | Prog | 9 | At the moment, it looks like adding a language requires manual SQL queries to language_subtag_registry, language_descriptions, and language_rfc4646_to_iso639. Its a shame there is no native interface for updating it. I imagine a plugin could work out well for it, although I think for the library in mind theyll probably just do a manual insert, as its not worth the development cost David Cook Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595

2 2

bulkmarcimport.pl ... re-import/update existing records
by David Schmidt 25 Apr '21

25 Apr '21

Hello koha folks, ### I hope this is the correct list for this kind of email ### We are currently exporting about 500k recods from a dabis system into a new koha installation. the export file (MARCXML) goes through some transformations using catmandu. I imported the first 25k records using this command: ``` bulkmarcimport.pl -M MARCXML -file tmp/marc_001.xml ``` after inspecting the records some of the catmandu fixes had to be updated and now im trying to update the existing koha records with the new marc_002.xml file. ``` bulkmarcimport.pl -M MARCXML -update -isbn -file tmp/marc_002.xml ``` this gives me alot of these errors: ``` WARNING: Updating record failed at /usr/share/koha/bin/migration_tools/bulkmarcimport.pl line 470, <GEN24> line 190. ..Use of uninitialized value $originalid in concatenation (.) or string at /usr/share/koha/bin/migration_tools/bulkmarcimport.pl line 470, <GEN24> line 194. WARNING: Updating record failed at /usr/share/koha/bin/migration_tools/bulkmarcimport.pl line 470, <GEN24> line 194. ``` I also tried using -match but I havent figured out how the parameters for -match are supposed to look like ``` bulkmarcimport.pl -m MARCXML -update -match="001" -file tmp/marc_002.xml ``` ``` .Use of uninitialized value $recorddata in pattern match (m//) at /usr/share/koha/bin/migration_tools/bulkmarcimport.pl line 603, <GEN24> line 2. unable to search the database for duplicates : No query entered at /usr/share/koha/bin/migration_tools/bulkmarcimport.pl line 323, <GEN24> line 2. ``` help or pointers are appreciated. cheers david

2 1

Time to translate: string freeze to prepare April release
by Fridolin SOMERS 22 Apr '21

22 Apr '21

Hi, String freeze is into effect. The 20.11.x maintenance branch is preparing for 20.11.05 release. The release is scheduled for around the 26rd. This means it's the right time to head over to the translation platform: https://translate.koha-community.org/projects/ Happy translating 🌎🌍🌏 -- Fridolin SOMERS <fridolin.somers(a)biblibre.com> Software and system maintainer 🦄 BibLibre, France

1 1