[Koha-bugs] [Bug 10662] Build OAI-PMH Harvesting Client

[bugzilla-daemon at bugs.koha-community.org]

http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=10662

--- Comment #42 from David Cook <dcook at prosentient.com.au> ---
I did some more thinking today...

The daemon, which I'm going to call Icarus as it's way easier to say that
OAI-PMH harvester daemon, is going to be the focal point.

Clients, such as the Koha web staff client or an icarus-client tool, will send
"harvesting tasks" to the daemon as JSON messages via a Unix socket. The daemon
will process those JSON messages, periodically perform the tasks to download
the records, and then hand the records off to a record processor plugin.

The plugin can then do whatever. It can hook directly into Koha, it can send
the record to a REST API, or whatever. The JSON message is going to have an
"extras" object that can contain data for the plugin, such as the URL of an API
to send to. 

The plan at the moment is to leave it up to individuals to add the plugin to
@INC when starting up the daemon.

That said, I think about adding some sort of default plugin, so that out of the
box users can use Icarus (ie the OAI-PMH harvester) without any additional
configuration. 

I think the plugin approach should allow me to build 90% of the infrastructure
we need for the harvester while leaving 10% up to libraries to have custom
implementations. In theory, this could also help people with different
timelines for their desired implementation. That is, I can provide the core
functionality, but you might consider developing your own plugins to handle the
record. 

Anyway, I have to run, but that's where my thoughts (and diagrams) have led me. 

Oh, the daemon will also be based on the POE module. While it was recently
removed from Koha's dependencies as it wasn't being used anyway, I imagine it
will be trivial to add it back in. We'll have to ask Galen who was the one who
removed it, I think, and who will be the package manager going forward...

-- 
You are receiving this mail because:
You are watching all bug changes.