https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 Mason James <mtj@kohaaloha.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |Needs Signoff -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 M. Tompsett <mtompset@hotmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mtompset@hotmail.com --- Comment #2 from M. Tompsett <mtompset@hotmail.com> --- Nice! I used perl /home/vagrant/misc4dev/cp_debian_files.pl to place the script in place. And toggled between master and my patched branch. while true; do time sudo koha-dump kohadev; done -- had to CTRL-Z and then kill %1 to stop it, but the idea was to get a feel for multiple runs, since I was just using the default kohadev DB. Basically 1.3 (old) vs 0.8 (patched) real seconds on a laptop with 4 cores 2 threads, virtualizing the jessie box with "4" of the "8" cpus (tweaked the virtualbox settings before testing this). Times were comparable when the box only had 1 cpu. -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 M. Tompsett <mtompset@hotmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #73848|0 |1 is obsolete| | --- Comment #3 from M. Tompsett <mtompset@hotmail.com> --- Created attachment 73927 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=73927&action=edit Bug 20543: Use multi-core compression to speed up Koha backups to test... 1/ run backup, observe execution time $ sudo time koha-dump mylib real 0m17.000s 2/ apply patch 3/ copy new koha-dump to sbin $ sudo cp debian/scripts/koha-dump /usr/sbin/koha-dump 4/ install pigz $ sudo apt-get install pigz 5/ run backup, observer execution time is less $ sudo time koha-dump mylib real 0m8.000s * tested on a 4 thread system Signed-off-by: Mark Tompsett <mtompset@hotmail.com> -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 Marcel de Rooy <m.de.rooy@rijksmuseum.nl> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |m.de.rooy@rijksmuseum.nl Severity|normal |enhancement --- Comment #4 from Marcel de Rooy <m.de.rooy@rijksmuseum.nl> --- Speed up.. Sounds like an enhancement to me. Correct me when I am wrong -- You are receiving this mail because: You are watching all bug changes.

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 --- Comment #6 from M. Tompsett <mtompset@hotmail.com> --- (In reply to Jonathan Druart from comment #5)

One more deps, one more deps! :)

Maybe we should use it only if installed (and not require it?)

It's not installed by default. I think adding the dependency is a good idea, as we want faster out of the box, not requiring knowing the magical incantation to get it to work. -- You are receiving this mail because: You are watching all bug changes.

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 --- Comment #8 from M. Tompsett <mtompset@hotmail.com> --- (In reply to Jonathan Druart from comment #7)

(In reply to M. Tompsett from comment #6)

...

It's not installed by default.

Hum? The patch adds the dependency. In debian/control, I read "koha-common depends on pigz"

Right, and it should add it, because it is kind of silly to have a patch that decides which to use if pigz is installed. People would generally not read any documentation, if there would be any, about that possibility. Because we want this out of the box, not need to know arcane knowledge to use it. This patch is just fine the way it is. -- You are receiving this mail because: You are watching all bug changes.

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 --- Comment #10 from Mason James <mtj@kohaaloha.com> --- (In reply to Jonathan Druart from comment #5)

One more deps, one more deps! :)

Maybe we should use it only if installed (and not require it?)

hi Jonathan a single 56k dependency, for a 3x speedup in backup time (i7-2600 cpu) why would anyone *not* want this enabled, by default? -- You are receiving this mail because: You are watching all bug changes.

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 --- Comment #12 from Tomás Cohen Arazi <tomascohen@gmail.com> --- Is pigz available on D8, D9 and supported Ubuntus? (I guess 16.04 and 18.04). While I see the advantage of having backups done faster, they are also an async task, and using all available cores in full (as a peak) might not be good for production sites. -- You are receiving this mail because: You are watching all bug changes.