[Koha-bugs] [Bug 22417] Delegate background jobs execution

[bugzilla-daemon at bugs.koha-community.org]

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=22417

--- Comment #20 from Julian Maurice <julian.maurice at biblibre.com> ---
I played a little with this patchset, and also with Minion. Some remarks:

- Net::RabbitFoot says it's compatible with version 0-8 of the AMQP
specification. RabbitMQ website says it implements version 0-9-1. Are we sure
these two are compatible ?
- Net::RabbitFoot is quite easy to package for Debian stretch/stable (all
dependencies are already packaged - I did not try on oldstable)
- If rabbitmq-server is not started, new_koha_job.pl and koha_worker.pl do not
work. Is there a way to enqueue job when rabbitmq-server is not started ?
- If koha_worker.pl is not started, and I enqueue jobs, and restart
rabbitmq-server and then start koha_worker.pl, the worker does nothing.
Potential loss of jobs here ?

Now for the Minion part,
- the mysql backend requires a recent version of Minion (which requires a more
recent version of Mojolicious than the one packaged in debian.k-c.org). It
might be complicated to package.
- the sqlite backend however have some versions that can be packaged and can
work with our version of Mojolicious (requires packaging Minion 6.04,
Mojo::SQLite 2.002, and Minion::Backend::SQLite 0.009)
- it works similarly to the rabbitmq code (a worker that run continuously, some
code to enqueue jobs, where all jobs are stored in database) but doesn't
require to have something (like rabbitmq-server) listening all the time to
work. The worker just fetches queued jobs from its backend when it starts (and
also regularly while it's running)
- from what I have seen, it requires less code (see for example:
https://mojolicious.io/blog/2018/12/10/minion-stands-alone/)
- workers can be "paused" (meaning they won't accept new jobs, but active jobs
will continue to run)

I'm a little concerned about the potential loss of jobs with the RabbitMQ
option. Is there any way to avoid this problem ?

-- 
You are receiving this mail because:
You are watching all bug changes.