[Koha-bugs] [Bug 27267] New: Create more efficient daemon for indexing Zebra

[bugzilla-daemon at bugs.koha-community.org]

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=27267

            Bug ID: 27267
           Summary: Create more efficient daemon for indexing Zebra
 Change sponsored?: ---
           Product: Koha
           Version: master
          Hardware: All
                OS: All
            Status: NEW
          Severity: enhancement
          Priority: P5 - low
         Component: Searching - Zebra
          Assignee: koha-bugs at lists.koha-community.org
          Reporter: dcook at prosentient.com.au

At the moment, each instance of Koha on a server gets its own rebuild_zebra.pl
daemon which uses approximately 170MB of RAM when idling. While this is not a
huge amount on its own, it does not scale well when you start adding many Koha
instances on the server. It would be very possible to have 10GB of RAM taken up
on a server by idle rebuild_zebra.pl processes alone.

In 2018, I wrote a custom Koha indexer daemon (on a non-Debian based OS) which
only uses 12MB of RAM. It gets a list of Koha instances, queries the zebraqueue
table in those instances, and then forks child processes to run
rebuild_zebra.pl (in non-daemon mode) for Koha instances that need it. It also
uses advisory file locking, so that only 1 rebuild_zebra.pl process will run
per instance at any given time.

I would need to refactor the daemon to run using the Debian Koha tooling, but I
think that this would be a useful addition to Koha, especially for vendors and
other large organisations running multiple Koha instances.

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.