[Koha-bugs] [Bug 10662] Build OAI-PMH Harvesting Client

[bugzilla-daemon at bugs.koha-community.org]

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=10662

--- Comment #120 from David Cook <dcook at prosentient.com.au> ---
Hey everyone, 

Here's the latest release of the OAI-PMH harvester (along with code for
harvesting RDFXML as well as MARCXML via OAI-PMH, as requested and sponsored by
Stockholm University Library).

I think this will be the last major iteration. After this, I'll work on bugs
that people find in testing, and do whatever is necessary to work it through
the QA process, but in terms of design I think this is mostly it. 

__TEST PLAN__
0a) Apply bugs 18585, 18586, 18713
0b) Upgrade your git dev system by using "make" and "make upgrade". I haven't
tried this on a gitified system, but I doubt it will work because of the
changes to koha-conf.xml and the added oai-pmh-harvester.yaml file (as well as
the added triplestore.yaml file from 18585). (Note that I have included Debian
scripts. I haven't tried building a DEB package yet, but you could try building
a package from your Git and use that for testing.)
0c) If you want to test the RDF functionality, you'll need a triplestore
(preferably Apache Jena Fuseki) and to update triplestore.yaml with the details
for the SPARQL endpoint.

1) On the command line, run KOHA_CONF=/path/to/etc/koha-conf.xml perl
misc/harvesterd.pl
OPTIONALLY: Add the --log-level DEBUG option for verbose debugging logging
2) Go to /cgi-bin/koha/tools/tools-home.pl
3) Click on "OAI-PMH harvester"
(/cgi-bin/koha/tools/oai-pmh-harvester/dashboard.pl)
4) At the toolbar choose "New request"
5) Give the request a "Name", add "URL" for an OAI-PMH repository, and fill in
the OAI-PMH parameters as desired/required. Everything else is probably fine as
a default, although if you want your request to run periodically, change
"Interval (seconds)" to something you think it reasonable. 
6) Click "Test parameters" to make sure your inputs are all valid. 
7) Click "Save" (note that you can save without validating your inputs for
works in progress)
8) Click "Actions" and choose "Send"
9) If the send is successful, go to the "Submitted requests" tab
10) Click "Actions" and choose "Start"
11) Go to the "Import history" tab
12) Click "Refresh import history" to update the table and see your results. If
nothing is coming up, you may have to go back to the "Submitted requests" tab
and double-check the status of your result and if there were any errors.
NOTE: If your request isn't periodic, it will disappear from the "Submitted
requests" table once it's finished, so you may have to check your command line
screen. If you enabled the DEBUG logging, you should be able to see any
problems that arose during the harvest. If you're not getting output on your
terminal screen, it may be going to your log file. Double-check
oai-pmh-harvester.yaml to see if you have a log file defined.

-- 
You are receiving this mail because:
You are watching all bug changes.