Growing size of koha/koha-testing:master
Hi all, I've noticed recently that koha/koha-testing:master has been steadily growing. At this point, it's about 4.37GB in size. For 21.11 I think it used to be about 2GB and 22.11 was 3.5GB. Do we know what's contributing to this? David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595
I think it's related to having Cypress bundled. And maybe some mistake on package cache cleanup. El dom, 4 feb 2024 a las 19:30, David Cook via Koha-devel (< koha-devel@lists.koha-community.org>) escribió:
Hi all,
I’ve noticed recently that koha/koha-testing:master has been steadily growing. At this point, it’s about 4.37GB in size. For 21.11 I think it used to be about 2GB and 22.11 was 3.5GB.
Do we know what’s contributing to this?
David Cook
Senior Software Engineer
Prosentient Systems
Suite 7.03
6a Glen St
Milsons Point NSW 2061
Australia
Office: 02 9212 0899
Online: 02 8005 0595
_______________________________________________ Koha-devel mailing list Koha-devel@lists.koha-community.org https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel website : https://www.koha-community.org/ git : https://git.koha-community.org/ bugs : https://bugs.koha-community.org/
-- Tomás Cohen Arazi Theke Solutions (https://theke.io) ✆ +54 9351 3513384 GPG: B2F3C15F
On 24-02-04 23:30, David Cook via Koha-devel wrote:
Do we know what’s contributing to this?
After running `ncdu /` from inside KTD Debian 10 (the smallest image it seems) - 661 M /kohadevbox/Cypress - 347 M /kohadevbox/node_modules - 95 M /kohadevbox/misc4dev - 224 M /usr/lib/locale (does locales are needed for Koha? because all are generated) - 410 M /usr/lib/x86_64-linux-gnu , various lib, maybe libLLVM and guile are not needed - 93 M /usr/lib/gcc - 270 M /usr/share/locale & /usr/share/doc not sure that prunable depending on how packages are made in Debian. Maybe part can be pruned via a dirty rm -rf like it seems to be done for the apt repo metadata in dockerfiles. Seen that a few times. - 400 M /usr/local/share/.cache/yarn likely everything is needed to be able to rebuild CSS & vue without having to redownload. Which is done on start so not only needed when working with UI. Ok maybe some stuff is not needed? Same questions with /kohadevbox/node_modules npm(node) and yarn have redundancy in their cache >_< They share all of their top 10 packages (some with same size, other with quite different) ^^" I guess one is used for SCSS compilation and another one for vue and cypress. But they still have in common the packages of the 3, hmm Cheers, -- Victor Grousset/tuxayo
That's interesting. I think that adds up to about 2.5GB. I wonder where the other 2GB comes from. I have been wondering if we should be doing some of these steps in a "builder" image and copying across files in case some of the bloat is in the layering. Something to play with perhaps. It's not a top priority at the moment, but I thought I'd raise it. A few large koha-testing-docker images start adding up in terms of SDD space. I upgraded workstations not that long ago, and now I'm thinking maybe I need to do it again just for the storage... David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 -----Original Message----- From: Victor Grousset/tuxayo <victor@tuxayo.net> Sent: Wednesday, 7 February 2024 1:33 PM To: David Cook <dcook@prosentient.com.au> Cc: koha-devel <koha-devel@lists.koha-community.org> Subject: Re: [Koha-devel] Growing size of koha/koha-testing:master On 24-02-04 23:30, David Cook via Koha-devel wrote:
Do we know what’s contributing to this?
After running `ncdu /` from inside KTD Debian 10 (the smallest image it seems) - 661 M /kohadevbox/Cypress - 347 M /kohadevbox/node_modules - 95 M /kohadevbox/misc4dev - 224 M /usr/lib/locale (does locales are needed for Koha? because all are generated) - 410 M /usr/lib/x86_64-linux-gnu , various lib, maybe libLLVM and guile are not needed - 93 M /usr/lib/gcc - 270 M /usr/share/locale & /usr/share/doc not sure that prunable depending on how packages are made in Debian. Maybe part can be pruned via a dirty rm -rf like it seems to be done for the apt repo metadata in dockerfiles. Seen that a few times. - 400 M /usr/local/share/.cache/yarn likely everything is needed to be able to rebuild CSS & vue without having to redownload. Which is done on start so not only needed when working with UI. Ok maybe some stuff is not needed? Same questions with /kohadevbox/node_modules npm(node) and yarn have redundancy in their cache >_< They share all of their top 10 packages (some with same size, other with quite different) ^^" I guess one is used for SCSS compilation and another one for vue and cypress. But they still have in common the packages of the 3, hmm Cheers, -- Victor Grousset/tuxayo
participants (3)
-
David Cook -
Tomas Cohen Arazi -
Victor Grousset/tuxayo