[Koha-bugs] [Bug 10662] Build OAI-PMH Harvesting Client

bugzilla-daemon at bugs.koha-community.org bugzilla-daemon at bugs.koha-community.org
Mon Nov 28 07:01:42 CET 2016


https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=10662

--- Comment #104 from David Cook <dcook at prosentient.com.au> ---
There's a lot of code in these changes, so I'm thinking once again of breaking
up this enhancement into a couple of Bugzilla issues.

At the moment, the enhancement can be thought of as an import API and an
asynchronous task queue. 

--

The import API takes a few simple parameters and an OAI-PMH response, which has
been downloaded from an OAI-PMH repository, and imports the records from the
response into Koha.

That can be tested and pushed independent of the asynchronous task queue.

The asynchronous task queue is the largest part of the change, and I've written
it myself using the POE framework. There are more out-of-the-box third-party
periodic asynchronous task queues out there, such as Celery (written in
Python), which we could use instead, but this doesn't add any dependencies
beyond the POE Perl modules. Plus, if we did use something like Celery, we'd
have to write the task code, typically in Python, for it anyway.

The task queue (ie Icarus) works pretty well and doesn't touch Koha at all
itself. I've included the code in the Koha:: namespace, but I could easily put
it into its own namespace. It has a lot of unit tests, and I still need to add
a lot more. 

As per Stockholm University Library's requirements, Icarus also has an
interface in Koha, so that's where Icarus does touch Koha, although only
indirectly. They communicate using JSON over a Unix socket.

-- 
You are receiving this mail because:
You are watching all bug changes.


More information about the Koha-bugs mailing list