[Bug 21359] New: Add RDF support to OAI-PMH harvester
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21359 Bug ID: 21359 Summary: Add RDF support to OAI-PMH harvester Change sponsored?: --- Product: Koha Version: unspecified Hardware: All OS: All Status: NEW Severity: enhancement Priority: P5 - low Component: Cataloging Assignee: koha-bugs@lists.koha-community.org Reporter: dcook@prosentient.com.au QA Contact: testopia@bugs.koha-community.org CC: m.de.rooy@rijksmuseum.nl The OAI-PMH harvester is set up to import only MARC records into Koha. The goal of this enhancement would be to allow RDF records to be imported into Koha as well. -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21359 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.koha-community | |.org/bugzilla3/show_bug.cgi | |?id=10662 -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21359 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- Depends on| |18585, 18713, 18586 Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=18585 [Bug 18585] Connect to RDF triplestore https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=18586 [Bug 18586] Create module to mint RDF subject URIs https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=18713 [Bug 18713] Add support for named graphs and rfds:seeAlso to Koha::RDF -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21359 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|koha-bugs@lists.koha-commun |dcook@prosentient.com.au |ity.org | -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21359 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- Depends on|18585 | Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=18585 [Bug 18585] Connect to RDF triplestore -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21359 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- Depends on| |10662 Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=10662 [Bug 10662] Build OAI-PMH Harvesting Client -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21359 --- Comment #1 from David Cook <dcook@prosentient.com.au> --- Created attachment 78974 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=78974&action=edit Bug 21359: Add RDF support to OAI-PMH harvester This patch allows the OAI-PMH harvester to process RDFXML and place it in an external triplestore. Currently, these RDFXML records must be linked to MARCXML records via a matching OAI-PMH repository and OAI-PMH identifier combination. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21359 --- Comment #2 from David Cook <dcook@prosentient.com.au> --- Created attachment 78993 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=78993&action=edit Empty RDF Triplestore Configuration File This file needs values to be filled in order to connect to a triplestore -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21359 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #78974|0 |1 is obsolete| | --- Comment #3 from David Cook <dcook@prosentient.com.au> --- Created attachment 78998 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=78998&action=edit Bug 21359: Add RDF support to OAI-PMH harvester This patch allows the OAI-PMH harvester to process RDFXML and place it in an external triplestore. Currently, these RDFXML records must be linked to MARCXML records via a matching OAI-PMH repository and OAI-PMH identifier combination. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21359 --- Comment #4 from David Cook <dcook@prosentient.com.au> --- This setup/test plan is not a final draft as I don't have any suitable RDFXML sources via OAI-PMH to test at the moment, and it's not 100% clear what the best way to handle RDF in Koha is yet. To setup Kohadevbox: 0. Apply patches (e.g. git bz apply 21359) 1. sudo apt-get install libpoe-perl libpoe-component-jobqueue-perl librdf-trine-perl librdf-query-perl 2. In your browser, go to localhost:8081 and run web installer 3. cd /home/vagrant/kohaclone 4. sudo koha-shell kohadev -c "perl installer/data/mysql/updatedatabase.pl" 5a. Download OAI-PMH configuration file from https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=78583 as oai.yml in /home/vagrant/kohaclone 5b. Download RDF Triplestore configuration file from https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=78993 as triplestore.yaml in /home/vagrant/kohaclone 5c. The "url" values for "query" and "update" need to be filled in with a RDF triplestore (e.g. Apache Fuseki) in triplestore.yaml 6. sudo vi /etc/koha/sites/kohadev/koha-conf.xml Add the following before </config>: <oai_pmh_harvester_config>/home/vagrant/kohaclone/oai.yml</oai_pmh_harvester_config> <triplestore_config>/home/vagrant/kohaclone/triplestore.yaml</triplestore_config> 7. restart_all 8. sudo KOHA_CONF=/etc/koha/sites/kohadev/koha-conf.xml PERL5LIB=/home/vagrant/kohaclone perl misc/harvesterd.pl --log-level DEBUG To test: 1) Start OAI-PMH harvester daemon according to the above Kohadevbox instructions (koha-testing-docker can be used instead but will need some modifications) 2) Go to /cgi-bin/koha/tools/tools-home.pl 3) Click on "OAI-PMH harvester" (/cgi-bin/koha/tools/oai-pmh-harvester/dashboard.pl) 4) At the toolbar choose "New request" 5a) Give the request a "Name" (this is just used for Koha and not sent in the request), add "URL" for an OAI-PMH repository (e.g. http://<koha>/cgi-bin/koha/oai.pl), and fill in the OAI-PMH parameters as desired/required (an explanation of the protocol is at http://www.openarchives.org/OAI/openarchivesprotocol.html or see attached screenshot oai_request_example.jpg). The remaining values can be kept unchanged. 5b) You'll need to specify a URI in "RDF type" for the type of RDF record you want to import. (Since RDF is essentially a container that contain many triples, you need to choose the type of the primary record you want to import) 6) Click "Test parameters" to make sure your inputs are all valid. 7) Click "Save" 8) Click "Actions" and choose "Submit" 9) If the submission is successful, go to the "Submitted requests" tab 10) Click "Actions" and choose "Start" 11) Go to the "Import history" tab 12) Click "Refresh import history" to update the table and see your results. If nothing is coming up, you may need to change your request as the OAI-PMH repository may not have any results for that particular request. 13) You will need to check your triplestore directly to see if any content has been added -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21359 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |In Discussion --- Comment #5 from David Cook <dcook@prosentient.com.au> --- My thoughts on this one have changed a lot over the years due to research and experience. Really we need to add RDF support to Koha before we do anything else. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21359 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|dcook@prosentient.com.au |koha-bugs@lists.koha-commun | |ity.org -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21359 David Cook <dcook@prosentient.com.au> changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |WISHLIST Status|In Discussion |RESOLVED -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21359 Bug 21359 depends on bug 18713, which changed state. Bug 18713 Summary: Add support for named graphs and rfds:seeAlso to Koha::RDF https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=18713 What |Removed |Added ---------------------------------------------------------------------------- Status|In Discussion |RESOLVED Resolution|--- |INVALID -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21359 Bug 21359 depends on bug 10662, which changed state. Bug 10662 Summary: Build OAI-PMH Harvesting Client https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=10662 What |Removed |Added ---------------------------------------------------------------------------- Status|Failed QA |RESOLVED Resolution|--- |DUPLICATE -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
participants (1)
-
bugzilla-daemon@bugs.koha-community.org