[Koha-bugs] [Bug 27267] Create more efficient daemon for indexing Zebra

bugzilla-daemon at bugs.koha-community.org bugzilla-daemon at bugs.koha-community.org
Fri Apr 9 16:04:38 CEST 2021


https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=27267

Julian Maurice <julian.maurice at biblibre.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|Signed Off                  |Failed QA
                 CC|                            |julian.maurice at biblibre.com

--- Comment #13 from Julian Maurice <julian.maurice at biblibre.com> ---
> 14. The top tool should show about 6.1MB usage.

I get 6.9MB, and there is an additional 17.6MB used by the child process every
5 seconds. So that's 24.5MB taken only to check if there is records to index.
Still better than 180MB, but worth noting IMO.
Talking about that, I wonder if it's really better to use a child process in
this case. Instead of just staying in memory, the code will be loaded/unloaded
every 5 seconds. Maybe it will use less memory 99% of the time, but it will
probably use more cpu time (and it will need all the memory once every 5 second
anyway, so that memory is not really "free")

I tried different things to measure memory consumption depending on what we
use:
- if I add 'require C4::Context' to _get_count (and nothing else), the child
process memory consumption goes up to 65MB
- if I add 'C4::Context->dbh()', memory consumption goes up to 98MB

I don't know exactly where the problem is (though I suspect the DBIx::Class
schema to take a significant part of memory), but it would be useful for such
cases to have a method that returns a DBI object without loading half of Koha.

Also I agree with Joonas, the "$dbh creation" code should not be duplicated.

-- 
You are receiving this mail because:
You are watching all bug changes.


More information about the Koha-bugs mailing list