- Koha-devel - lists.koha-community.org

Re: [Koha-devel] Koha hackfest in Marseille & https://reasonablegraph.org/ platform
by David Cook 09 Feb '18

09 Feb '18

Hi Nikos, I hadn't heard of property graphs until I read your message; that sounds interesting. I'd just read about triplestores so far. I'd love to hear more about the inference engine as well. That sounds like it could have some long-term value in terms of automatic discovery and interconnection. I'm curious how it works for transforming ontologies as well. I suppose if it's all rule based it's just a matter of creating the rules. In regards to the dbpedia URI, displaying the external data to the front-end seems like it would be really slow. Say you have 30 URIs to external nodes in your RDF record, that is 30 HTTP requests just for 1 RDF record. Even if you performed them in parallel, that seems problematic. So I would think you'd want to import the external node's data and duplicate it in your system (this would also be helpful for indexing, no?). But then when you have that external data in your system, how do you know how to present it to the frontend? I was looking again at http://www.worldcat.org/title/good-omens-the-nice-and-accurate-prophecies-o…. In the Related Entities section, they have '<http://dbpedia.org/resource/New_York_City> schema:name "New York"'. That triple doesn't actually appear in dbpedia, so it must be one that OCLC created locally. That seems logical to me in a way... OCLC gets the benefit of an authoritative URI but the convenience of using a locally understood metadata schema. But that triple... it would have either had to be created manually or automatically using some reasoning (and since I don't actually see any string that just says "New York" in dbpedia... I really have to wonder). I'll check out that demo now... Do you have any way of showing the RDF for a record to a user? If I'm looking at http://humanities.reasonablegraph.org/archive/item/7961?dv=1, can I see the actual data used to generate the page? I'm intrigued by the line 'VIAF 54266158 (Personal) ⟶ Apostolidēs, Renos Eraklēs 1924-'. I've seen a number of Linked Data apps that link to VIAF, which seems such a typical use case for libraries. Clicking on the link I get taken to https://viaf.org/viaf/54266158/#Renos,_1924-2004. Now I think I can see an RDF version of this page... I just need to go to "Record Views" and click "RDF record": https://viaf.org/viaf/54266158/rdf.xml. OK... I see the string "Apostolidēs, Renos Eraklēs 1924-" has a skos:prefLabel predicate on VIAF. I assume that the RDF record in RG just has an object for https://viaf.org/viaf/54266158/#Renos,_1924-2004 and that you're dereferencing that URI and looking for that particular predicate? Where does that get defined in RG? Another example is http://data.nlg.gr/archive/item/316756?dv=1. I see that you provide RG to the National Library of Greece too. (Side note: you have a typo in your "Powered by" section on http://data.nlg.gr/archive/item/316756?dv=1) Now I see that the HTML version is XHTML+RDFa 1.0... but I'm not seeing any RDF in the HTML. OK going into the editor... I see ea:link:VIAF_Number... ahh you're not storing it as RDF. This "Data Model" or "Tree" section is an expression of your property graph I guess. Is it that you have some rule that takes any ea:link:VIAF_Number and generates a URI for it and then you use rules to infer what data you need from that URL in order to populate your own graph? It looks like you're storing a combination of plain text strings, JSON strings, and some sort of prefixed JSON I've never seen before? So I see "Person - Link" in the editor. I try putting in 90705830 (the LC number for Huckleberry Finn) but nothing happens yet... and now I see "Your submission for the updated record is being processed in the background. The updated record will be refreshed in a few moments.". That makes sense. Hmm... adding the Lccn did nothing. I'm guessing I would have had to include the URI too? But that just seems like a regular URL. Of course in the case of VIAF you just have to ask for RDF to get RDF instead of HTML (e.g. curl -H "Accept: application/rdf+xml" https://viaf.org/viaf/54266158/) On http://humanities.reasonablegraph.org/archive/item/7961?dv=1 I see an "Occupation", and in the editor I see "Field of Activity" under "Person - Local Fields". The labels in the editor and the OPAC don't seem to match up. The editor only lets you link to locally stored concepts... which is OK because otherwise it could be a mess. I see you can add new concepts. It looks like a very manual process though and that the links aren't necessarily RDF links. What schema is http://humanities.reasonablegraph.org using for its data? I'm guessing something unique to RG? Or at least locally definable? Does that serialize as RDF? I'm guessing not. But when you say that you implement FRBR and BIBFRAME... all you really need to do is implement the model and since they're graphs I suppose you can do it however you like internally. Can people link to RG and get back RDF? I just tried 'curl -H "Accept: application/rdf+xml" http://humanities.reasonablegraph.org/archive/item/7963' and that failed, so I'm guessing not? In terms of collaborating with Koha, what sort of integration is available? Apologies for the stream of consciousness. RG does seem like a generic graph-based web solution that could be used in GLAM, but I haven't seen anything yet that suggests it is capable of supporting Linked Data or even RDF. I imagine I'm missing something in the demo? David Cook Systems Librarian Prosentient Systems 72/330 Wattle St Ultimo, NSW 2007 Australia Office: 02 9212 0899 Direct: 02 8005 0595 -----Original Message----- From: Nikos Papazis [mailto:papazis@altsol.gr] Sent: Thursday, 8 February 2018 11:26 PM To: David Cook <dcook(a)prosentient.com.au>; 'Paul Poulain' <paul.poulain(a)biblibre.com>; koha-devel(a)lists.koha-community.org Subject: Re: [Koha-devel] Koha hackfest in Marseille & https://reasonablegraph.org/ platform Dear David, RG models the data as a property graph. We have developed an abstraction layer on top of PostgreSQL, that implements a graph. Also we have implemented an inference engine, that can apply forward reasoning on the graph. So the dataset is modeled as a set of graph nodes with properties (for the enitites) and a set of graph arcs (for the relationships between the nodes/entities). The inference engine has 2 prime tasks: 1. to manage the graph and do housekeeping tasks on it and 2. to apply logic rules on the dataset and infer new relationships and/or nodes from the supplied data. There are separate sets of rules in the inference engine for transforming and exporting the local ontology to another one. For instance for transforming FRBR to MARC21 or to Europeana Data Model as RDF, etc. Regarding the linkage to external datasets, like dbpedia, we store the URI of the related external node. From that we could either import the external node's data and duplicate them in our system OR we could just display the external data to the frontend. Related to the above is the mechanism of copy cataloguing. For instance if an installation handles bibliographic records and is modeled under FRBR/RDA, we have an Z39.50 interface which lets the user pick a MARC21 record from an external catalogue, present it to the user and then copy it and map it to the related FRBR records of the work-expression-manifestation-item. One demo that is relevant and has significant volume of different types of material is http://humanities.reasonablegraph.org/ This demo holds both bibliographic and archival material. We have fields for storing the URL to external datasets. We do not import the external dataset. I am at your disposal for any assistance. regards, Nikos On 01/02/2018 12:13 πμ, David Cook wrote: > Thanks for your reply, Nikos. > > That certainly sounds interesting. I'd like to know more about the platform, although I won't be making it to the hackfest in Marseille this year. > > How does RG handle Linked Data relationships? Say I was entering in a place of publication and wanted to use dbpedia's entry for New York City. I would provide the URI but what happens after that? Do I add a local triple to describe that external resource using a schema supported by RG, or does it fetch the RDF document from the remote server and let me decide what to import or transform? > > If you can direct me to the appropriate demo, I'd love to look more at how your system handles Linked Data. I think I've gone as far as there is to go with RDF on its own, but curious how existing systems are handling the links to external resources. > > Cheers, > > David Cook > Systems Librarian > Prosentient Systems > 72/330 Wattle St > Ultimo, NSW 2007 > Australia > > Office: 02 9212 0899 > Direct: 02 8005 0595 > > > -----Original Message----- > From: Nikos Papazis [mailto:papazis@altsol.gr] > Sent: Thursday, 1 February 2018 1:01 AM > To: David Cook <dcook(a)prosentient.com.au>; 'Paul Poulain' > <paul.poulain(a)biblibre.com>; koha-devel(a)lists.koha-community.org > Subject: Re: [Koha-devel] Koha hackfest in Marseille & > https://reasonablegraph.org/ platform > > Dear David, > > regarding the github repo of ReasonableGraph (RG): until now the sole developers of the RG platform are us. There isn't any community yet. We do provide the platform with l-GPL license in our installation, which are listed on the platform's website and are located in Greece. So we do not allocate any resources in maintaining a public repo. If a community arises, we will switch our private repos to the public one and do there our commits. This is the reason why our github repo seems abandoned. > > We too have implemented BIBFRAME 2.0, among other standards. Primarily for proof of concept and for providing demo installations. Our purpose is to demonstrate the fact that different ontologies can be quite easily implemented on our platform. Which has configuration files for describing any ontology and the entry forms necessary to manage it. > For all our demo instalations, we provide full access to anyone who might be interested. > > Having said that, I come to your question regarding the use or possible value of RG for the KOHA ecosystem. > > We feel that RG can offer 2 valuable functions: 1) a real-time backend that transforms MARC21 or UNIMARC collections into FRBR or BIBFRAME datasets (or any other semantic model) 2) and the ability to simultaneously manage/annotate/enrich the collection on both standards. > > So it can act as the necessary tool for adopting the new standards. > Helping to keep the MARC expertise and tools and at the same time experiment with the new standards. > > And the same time it allows libraries to explore the possibility of having unified repositories for all their collections (bibliographic, archival, museum, musical, etc). > > The demos mentioned by Paul are showcasing the above. > > Thanx to David and Paul for their comments. > > Looking forward to meeting you in Koha hackfest in Marseille > > Regards, > Nikos > > PS: I am not a member of the koha-devel list yet. So please forward it > there for completeness > > On 31/01/2018 12:52 πμ, David Cook wrote: >> I'm skeptical of anything that claims to implement BIBFRAME for production, since BIBFRAME appears to still be an experimental work in progress (https://www.loc.gov/bibframe/faqs/#q09) That said, it does seem like folk like Ex Libris are trying to use BIBFRAME 2.0 in production (https://www.loc.gov/bibframe/implementation/register.html) I suppose every technology needs its early adopters. I can see why places like Oslo Public Library, the National Library of Sweden, and la Bibliothèque Nationale de France are using their own schemas though. >> >> The ReasonableGraph Github only seems to have 1 contributor and a handful of commits. Mostly from 1 year ago and 15 days ago. I wonder what is missing? I haven't had time to deep dive the code yet. >> https://github.com/reasonablegraph >> >> That said, I'm intrigued by anything that claims to use Linked Data. To date, I've mostly only seen systems that use RDF stored locally. That is, that only link internally and don't resolve external links. The most interesting example of Linked Data that I've actually found is with OCLC WorldCat: http://www.worldcat.org/title/good-omens-the-nice-and-accurate-prophecies-o…. If you open the "Linked Data" section, you can see that "New York" from the top of the webpage comes from this predicate and object: library:placeOfPublication <http://dbpedia.org/resource/New_York_City>. The interesting bit is if you go down to "Related Entities", you'll see 'schema:name "New York"'. I find that interesting because http://dbpedia.org/page/New_York_City doesn't have a predicate of schema:name. So, in theory, OCLC must be converting a triple from another vocabulary into Schema.org. Either that or they provide the link as the authoritative link an! > d ! >> then just add their own local triple saying "New York". I suppose that's a possibility too. But it kind of defeats the purpose of machine readable Linked Data. But Linked Data is hard since you never know what you're going to get back from the other end. >> >> At this point, what could Reasonable Graph offer for Koha? >> >> Apologies if that sounds rude at all. I've just been thinking a lot about RDF and Linked Data for the last couple of years. >> >> David Cook >> Systems Librarian >> Prosentient Systems >> 72/330 Wattle St >> Ultimo, NSW 2007 >> Australia >> >> Office: 02 9212 0899 >> Direct: 02 8005 0595 >> >> >> -----Original Message----- >> From: koha-devel-bounces(a)lists.koha-community.org >> [mailto:koha-devel-bounces@lists.koha-community.org] On Behalf Of >> Paul Poulain >> Sent: Tuesday, 30 January 2018 11:45 PM >> To: koha-devel(a)lists.koha-community.org >> Cc: Nikos Papazis <papazis(a)altsol.gr> >> Subject: [Koha-devel] Koha hackfest in Marseille & >> https://reasonablegraph.org/ platform >> >> Hi koha-devel, >> >> I had a hangout with Nikos (in cc:) , from Reasonablegraph. >> reasonablegraph is a platform (L-GPL) that is able to deal with MARC >> records, transform them into FRBR / Bibframe /linked data. They made >> some work with Koha >> (http://unioncatalog.reasonablegraph.org/?lang=en, >> click on "Search" top-left) >> >> At the end of Nikos demo, I suggested him to come to the hackfest for a day or two, in order to present reasonablegraph to anyone interested, and talk about any possible collaboration between Koha community and reasonablegraph. He will probably come. >> >> That's another very good reason to come to Marseille in March :D >> >> -- >> Paul Poulain, Associé-gérant / co-owner BibLibre, Services en >> logiciels libres pour les bibliothèques BibLibre, Open Source >> software and services for libraries >> >> _______________________________________________ >> Koha-devel mailing list >> Koha-devel(a)lists.koha-community.org >> http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel >> website : http://www.koha-community.org/ git : >> http://git.koha-community.org/ bugs : http://bugs.koha-community.org/ >> >> >> >> > > > -- > AltSol team > mob: +30 6974471632 > office: +30 2109617148 > fax: +30 2109617148 > URL: http://www.altsol.gr > linkedIn: https://www.linkedin.com/in/npapazis > > > > -- AltSol team mob: +30 6974471632 office: +30 2109617148 fax: +30 2109617148 URL: http://www.altsol.gr linkedIn: https://www.linkedin.com/in/npapazis

1 0

What's on in koha-devel #17
by Jonathan Druart 08 Feb '18

08 Feb '18

Hello librarians and developers, The what's on in koha-devel #17 is available on the Koha website: https://koha-community.org/whats-on-in-koha-devel-17/ Regards, Jonathan

1 0

Last bit for utf8mb4
by Tomas Cohen Arazi 08 Feb '18

08 Feb '18

Hi everyone, bug 18336, implementing utf8mb4 encoding [1] is now failed QA (should probably be IN DISCUSSION). The reason for it to be failed is that the encoding change from utf8 into utf8mb4 alters all *text fields too (and I didn't notice it) and so there's a discrepancy between the updated schema and a fresh one. Fixing it seems easy: I just need to change all fields like this in kohastructure.sql: TEXT => MEDIUMTEXT MEDIUMTEXT => LONGTEXT As I understand it, *TEXT columns only store as part of the row the number of bytes stored (in the external object storage) for the object [2]. Given this, the changes described above means this size change: 2 bytes => 3 bytes 3 bytes => 4 bytes The move into utf8mb4 is needed, and is important for supporting supplemental characters (japanese, chinese, emojis, etc). Do you have another understanding on how this could impact (say) space? Do you think we should move forward with it? I think we should move forward and will provide a followup patch right now, but more opinions are needed here. Thanks in advance Tomás [1] https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=18336 [2] https://dev.mysql.com/doc/refman/5.7/en/string-type-overview.html -- Tomás Cohen Arazi Theke Solutions (https://theke.io <http://theke.io/>) ✆ +54 9351 3513384 GPG: B2F3C15F

1 0

Re: [Koha-devel] OPACUserJS, password recovery form
by Holger Meissner 08 Feb '18

08 Feb '18

That’s it! Thank you very much, Eric. :) Best Holger Von: Eric Phetteplace [mailto:ephetteplace@cca.edu] Gesendet: Mittwoch, 7. Februar 2018 19:11 An: Holger Meissner Cc: koha-devel(a)lists.koha-community.org Betreff: Re: [Koha-devel] OPACUserJS, password recovery form You've an error in your JavaScript, "Uncaught TypeError: Cannot set property 'disabled' of null": [cid:image002.jpg@01D3A0BF.2CEEEDD0] That causes everything afterwards to not execute. If you use jQuery instead of document.querySelector then the problem should go away: $('select[id="borrower_branchcode"]').prop('disabled', true) Best, ERIC PHETTEPLACE Systems Librarian libraries.cca.edu<http://libraries.cca.edu> | vault.cca.edu<http://vault.cca.edu> | 510.594.3660 [https://www.cca.edu/sites/default/files/images/2017/02/cca-sig-logo.png] 5212 Broadway, Oakland, CA 94618 1111 8th St., San Francisco, CA 94107 Preferred Pronoun(s): he/him :(){ :|: & };: On Wed, Feb 7, 2018 at 9:51 AM, Holger Meissner <Holger.Meissner(a)hs-gesundheit.de<mailto:Holger.Meissner@hs-gesundheit.de>> wrote: Hi Eric, thank you, but #password-recovery has the same problem. It works in scratchpad, but not in OPACUserJS. #opac-password-recovery is the ID of <body>. Right now, I tried with just alert('Hello'); and even though it shows up in the source, it’s not executed. Best Holger Von: Eric Phetteplace [mailto:ephetteplace@cca.edu<mailto:ephetteplace@cca.edu>] Gesendet: Mittwoch, 7. Februar 2018 18:06 An: Holger Meissner Cc: koha-devel(a)lists.koha-community.org<mailto:koha-devel@lists.koha-community.org> Betreff: Re: [Koha-devel] OPACUserJS, password recovery form Hi Holger, Looking at your password reset page, I think you need to update your selectors to target the "#password-recovery" <div>. There is no element with ID "opac-password-recovery". I'm not sure how the code is working in scratchpad but if you fix the jQuery selectors, you should get the intended effect. Best, ERIC PHETTEPLACE Systems Librarian libraries.cca.edu<http://libraries.cca.edu> | vault.cca.edu<http://vault.cca.edu> | 510.594.3660<tel:(510)%20594-3660> 5212 Broadway, Oakland, CA 94618 1111 8th St., San Francisco, CA 94107 Preferred Pronoun(s): he/him :(){ :|: & };: On Wed, Feb 7, 2018 at 5:33 AM, Holger Meissner <Holger.Meissner(a)hs-gesundheit.de<mailto:Holger.Meissner@hs-gesundheit.de>> wrote: Dear koha devs, login and email are identical for our patrons. I'd like to simplify password recovery by hiding one of the two inputs. $(document).ready(function(){ $("#opac-password-recovery label[for='username']").hide(); $("#opac-password-recovery label[for='email']").hide(); $("#opac-password-recovery #email").hide(); $("#opac-password-recovery #username").before('<br /><br />'); }); This works fine in scratchpad, but has no effect in OPACUserJS. Can anyone give me a hint? ______________________________ Holger Meißner Bibliothek und Fachinformation Systembibliothekar Hochschule für Gesundheit - University of Applied Sciences Gesundheitscampus 6-8, D-44801 Bochum, Raum C-2306 Tel: +49 234 77727-154<tel:%2B49%20234%2077727-154>, Fax: +49 234 77727-254<tel:%2B49%20234%2077727-254> E-Mail: holger.meissner(a)hs-gesundheit.de<mailto:holger.meissner@hs-gesundheit.de>, Web: www.hs-gesundheit.de<http://www.hs-gesundheit.de> _______________________________________________ Koha-devel mailing list Koha-devel(a)lists.koha-community.org<mailto:Koha-devel@lists.koha-community.org> http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/ _______________________________________________ Koha-devel mailing list Koha-devel(a)lists.koha-community.org<mailto:Koha-devel@lists.koha-community.org> http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/

1 0

Late reminder: General IRC meeting 7 February 2018
by Katrin Fischer 07 Feb '18

07 Feb '18

Hi all, join us for February's general IRC meeting: https://wiki.koha-community.org/wiki/General_IRC_meeting_7_February_2018 Time: in about 45 minutes! https://www.timeanddate.com/worldclock/fixedtime.html?msg=Koha+General+IRC+… Hope to see you there, Katrin

1 0

OPACUserJS, password recovery form
by Holger Meissner 07 Feb '18

07 Feb '18

Dear koha devs, login and email are identical for our patrons. I'd like to simplify password recovery by hiding one of the two inputs. $(document).ready(function(){ $("#opac-password-recovery label[for='username']").hide(); $("#opac-password-recovery label[for='email']").hide(); $("#opac-password-recovery #email").hide(); $("#opac-password-recovery #username").before('<br /><br />'); }); This works fine in scratchpad, but has no effect in OPACUserJS. Can anyone give me a hint? ______________________________ Holger Meißner Bibliothek und Fachinformation Systembibliothekar Hochschule für Gesundheit - University of Applied Sciences Gesundheitscampus 6-8, D-44801 Bochum, Raum C-2306 Tel: +49 234 77727-154, Fax: +49 234 77727-254 E-Mail: holger.meissner(a)hs-gesundheit.de, Web: www.hs-gesundheit.de

2 2

Make our test suite returns green with new SQL modes
by Jonathan Druart 07 Feb '18

07 Feb '18

Hi devs, See bug 20144, I have provided a big stack of patches to make our test suite running successfully with new SQL modes (i.e. MySQL 5.7, but new MariaDB versions as well). This is only a first step, I will see how much love they get to see if I continue this work or not. Cheers, Jonathan

1 0

Koha & ElasticSearch
by Paul Poulain 06 Feb '18

06 Feb '18

Hello koha-devel, BibLibre want Koha-ElasticSearch to move forward, so we want to dedicate Alex to work on this 2 days a week for the next months. (disclaimer: if some funded development comes in, he will be switched back to paid work. Option : you can sponsor his work. Drop me an email ! ) -- Paul Poulain, Associé-gérant / co-owner BibLibre, Services en logiciels libres pour les bibliothèques BibLibre, Open Source software and services for libraries

1 0

git-bz: avoid storing unencrypted passwords in gitconfig
by Julian Maurice 06 Feb '18

06 Feb '18

Hi all, I recently shared an LXD container containing my Koha dev environment, and of course I forgot to remove my Bugzilla credentials from the git config... I immediately changed it, but for that not to happen again I searched for a way to not have to store unencrypted passwords for git-bz. The result is here https://github.com/jajm/git-bz/tree/git-credential It uses git-credential, so you can theoretically use any password manager you want, as long as you can write a git-credential helper for it (I use the builtin 'cache' helper, which stores passwords in memory) I thought it might interest some people here. For more information, see the commit message at https://github.com/jajm/git-bz/commit/efb06d8fe3033a83772d0294ab5f67c7f51ea… -- Julian Maurice <julian.maurice(a)biblibre.com> BibLibre

6 10

State of HTTP::OAI versions
by Jonathan Druart 05 Feb '18

05 Feb '18

Hi, Quick tests on master, hitting /cgi-bin/koha/ oai.pl?verb=GetRecord&identifier=KOHA-OAI-TEST:1&metadataPrefix=marcxml 3.27 => OK 3.28 => OK 4.02 => KO cannot install via cpan make: *** No rule to make target 'bin/oai_pmh.pl', needed by 'blib/script/ oai_pmh.pl'. Stop. 4.03 => KO Can't call method "start_element" on an undefined value at /root/.cpanm/work/1517493937.13902/HTTP-OAI-4.03/blib/lib/HTTP/OAI/Verb.pm line 53. with --force: Can't locate object method "xslt" via package "HTTP::OAI::GetRecord" at /home/vagrant/kohaclone/Koha/OAI/Server/Repository.pm line 147. 4.04 to 4.06 => KO Can't locate object method "xslt" via package "HTTP::OAI::GetRecord" at /home/vagrant/kohaclone/Koha/OAI/Server/Repository.pm line 147. We use this xslt method since bug 15527 (OAI-PMH should have a stylesheet to aid usability). It has been removed from HTTP::OAI::Response 4.03 If I comment the line in our codebase ($response->xslt( "/opac-tmpl/xslt/OAI.xslt" ); in Koha::OAI::Server::Repository->new), with 4.06 I get: Can't call method "start_element" on an undefined value at /usr/local/share/perl/5.20.2/HTTP/OAI/Verb.pm line 55. Next? I do not know :) Cheers, Jonathan

5 6