[Bug 11830] New: Document disk space requirements for git install on Ubuntu
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 Bug ID: 11830 Summary: Document disk space requirements for git install on Ubuntu Change sponsored?: --- Product: Koha Version: master Hardware: All OS: Linux Status: NEW Severity: enhancement Priority: P5 - low Component: Installation and upgrade (command-line installer) Assignee: gmcharlt@gmail.com Reporter: dan@coffeecode.net QA Contact: testopia@bugs.koha-community.org Created attachment 25587 --> http://bugs.koha-community.org/bugzilla3/attachment.cgi?id=25587&action=edit Adds a HARDWARE REQUIREMENTS section to the INSTALL.ubuntu file When I installed Koha for the first time on Ubuntu, I provisioned a VM with what I assumed would be a generous 4GB of disk space. This turned out to be a very bad assumption due to the 2.3GB that a full git clone of the Koha repository requires. The symptoms of running out of disk space were sadly not immediately apparent and caused much head scratching. Therefore, in INSTALL.ubuntu, include an upfront note about hardware requirements in the case of a git install, in the hopes that others will not end up experiencing a similar fate :) -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 Dan Scott <dan@coffeecode.net> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |Needs Signoff Assignee|gmcharlt@gmail.com |dan@coffeecode.net -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 M. Tompsett <mtompset@hotmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Needs Signoff |Failed QA CC| |mtompset@hotmail.com --- Comment #1 from M. Tompsett <mtompset@hotmail.com> --- I agree with the idea. However, you forgot to account for data size. The sizes you suggest are far too small to actually import and fully reindex a small production system set of data. Please change to 20GB, and I'll sign off. ;) -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 --- Comment #2 from M. Tompsett <mtompset@hotmail.com> --- Last I checked a full clone of git was just over 1GB. A bare install of Ubuntu is let's say 2GB. I am using a 15GB VM, and I only have 2.7GB left. My data is about 45K records. Also, it doesn't matter if it is a VM or not VM. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 M. Tompsett <mtompset@hotmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Failed QA |Needs Signoff Patch complexity|--- |String patch -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 M. Tompsett <mtompset@hotmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #25587|0 |1 is obsolete| | --- Comment #3 from M. Tompsett <mtompset@hotmail.com> --- Created attachment 25622 --> http://bugs.koha-community.org/bugzilla3/attachment.cgi?id=25622&action=edit Bug 11830 - Missing Disk Space recommendation for installation This adds a section which recommends at least 20GB disk space to the INSTALL.ubuntu file. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 M. Tompsett <mtompset@hotmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|dan@coffeecode.net |mtompset@hotmail.com Severity|enhancement |minor --- Comment #4 from M. Tompsett <mtompset@hotmail.com> --- I've put up a revision. Feel free to sign it off, Dan. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 --- Comment #5 from Dan Scott <dan@coffeecode.net> --- M. Tompsett - I didn't forget to account for data size. As far as I know nobody recommends running Koha from git for production purposes; my assumption is that someone running from git is using it for development purposes. In which case most developers are going to be using a small data set, or will provision according to the size of their data. What I'm trying to establish is a reasonable minimal baseline. After "git clean -f" and "git reset --hard HEAD", "du -hs kohaclone" shows me a disk space usage of 1.9 GB. After running "perl Makefile.PL" and "make", "du -hs kohaclone" shows me a disk space usage of 2.3 GB. After running "make install", "du -hs /home/koha/koha-dev" then shows me disk space usage of 401 MB. Thus, a minimal git install requires 2.7 GB of free space... rounding up to the 3 GB I recommended in my original patch seems reasonable. On my 6.0 GB Ubuntu VM, here's what "df -h" shows after a minimal install and a load of approximately 1000 MARC records: Filesystem Size Used Avail Use% Mounted on /dev/mapper/koha--vg-root 5.6G 4.9G 413M 93% / udev 992M 4.0K 992M 1% /dev tmpfs 401M 276K 401M 1% /run none 5.0M 0 5.0M 0% /run/lock none 1002M 0 1002M 0% /run/shm /dev/vda1 228M 78M 138M 37% /boot I stand by my original patch as-is, as it uses the terms "at least" to target the minimal case for a git install and for the minimal VM size. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 --- Comment #6 from M. Tompsett <mtompset@hotmail.com> --- Some people may actually want to load real data for testing. Larger is better. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 --- Comment #7 from Dan Scott <dan@coffeecode.net> --- (In reply to M. Tompsett from comment #6)
Some people may actually want to load real data for testing. Larger is better.
Yes, but those people are going to know how large their data is and can determine how much disk space they will need on top of the documented minimum requirements. If you want to provide a metric like "If you have 1 GB of MARC binary records, you should provision 3 GB of space to allow for indexing, etc", then I think that would be a helpful addition. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 Galen Charlton <gmcharlt@gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #25587|1 |0 is obsolete| | CC| |gmcharlt@gmail.com -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 Galen Charlton <gmcharlt@gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Needs Signoff |In Discussion --- Comment #8 from Galen Charlton <gmcharlt@gmail.com> --- To reflect the state of affairs correctly, I'm setting this to in-discussion and un-obsoleting Dan's patch. Mark: please do not automatically obsolete the original patch when you're counter-patching. As I've expressed on koha-devel, I believe that a better place for system specs, including for devs, is on the wiki or main website. As far as the two patches are concerned, Dan's numbers add up. I agree that a metric for estimating disk space per 1K bib records would be useful. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 --- Comment #9 from Galen Charlton <gmcharlt@gmail.com> --- (In reply to Dan Scott from comment #7)
If you want to provide a metric like "If you have 1 GB of MARC binary records, you should provision 3 GB of space to allow for indexing, etc", then I think that would be a helpful addition.
One number that's reasonably conservative for small to medium-sized databases: 55M of disk per 1,000 MARC21 bib records for Zebra and MySQL storage. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 --- Comment #10 from Galen Charlton <gmcharlt@gmail.com> --- Final comment for now -- whatever form the specs take, there should be a clear distinction between specs for devs and specs for production, with some padding for production. This is because while a lot of small Koha database could in fact reasonably live on a system with only 10G of disk -- I've seen far too many Koha setups where insufficient attention is paid to monitoring disk usage to want the official community recommendation to be too low. In other words, I'm fine with Dan's suggestion of minimum 6G for development setups, but prefer Mark's suggestion of 20G for production usage. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 --- Comment #11 from Dan Scott <dan@coffeecode.net> --- (In reply to Galen Charlton from comment #10)
As I've expressed on koha-devel, I believe that a better place for system specs, including for devs, is on the wiki or main website.
That sounds good to me, as long as there's a clear pointer from the INSTALL.* files to the appropriate URL for hardware requirements. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 --- Comment #12 from M. Tompsett <mtompset@hotmail.com> --- Okay. How about here: http://koha-community.org/download-koha/ We could add some statement to the point list like: * Hard drive space recommendations include >=6 GB for a minimal development install, >= 20GB for a production install And then add that link to the USEFUL REFERENCE LINKS section like: Download (requirements, etc.): http://koha-community.org/download-koha/ Perhaps even include a link to a wiki page which flushes out disk space and memory suggestions? -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=11830 M. Tompsett <mtompset@hotmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|mtompset@hotmail.com |gmcharlt@gmail.com -- You are receiving this mail because: You are watching all bug changes.
participants (1)
-
bugzilla-daemon@bugs.koha-community.org