[Bug 9207] New: Improve z39.50 speed slowdowns for sites with many records
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=9207 Bug ID: 9207 Summary: Improve z39.50 speed slowdowns for sites with many records Classification: Unclassified Change sponsored?: --- Product: Koha Version: unspecified Hardware: All OS: All Status: NEW Severity: enhancement Priority: P5 - low Component: Cataloging Assignee: gmcharlt@gmail.com Reporter: kyle@bywatersolutions.com CC: m.de.rooy@rijksmuseum.nl Sites with very large numbers of imported records may experience increasingly slow z39.50 searches. This is cause by the triggering of the subroutine _update_batch_record_counts for each and every result of a z39.50 search. Fixing this will be very difficult though. However, I have discovered a much simpler solution that, while not as good as bypassing _update_batch_record_counts, still gives a dramatic boost to speed, adding an index to import_records for import_batch_id/record_type ALTER TABLE import_records ADD INDEX batch_id__record_type ( import_batch_id, record_type ) -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=9207 --- Comment #1 from Kyle M Hall <kyle@bywatersolutions.com> --- Created attachment 13872 --> http://bugs.koha-community.org/bugzilla3/attachment.cgi?id=13872&action=edit Bug 9207 - Improve z39.50 speed slowdowns for sites with many records -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=9207 Kyle M Hall <kyle@bywatersolutions.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |Needs Signoff Patch complexity|--- |Trivial patch -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=9207 Kyle M Hall <kyle@bywatersolutions.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|gmcharlt@gmail.com |kyle@bywatersolutions.com -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=9207 --- Comment #2 from Jared Camins-Esakov <jcamins@cpbibliography.com> --- Depending on the number of servers that are being searched, there may be a lesser slowdown caused by ZOOM not releasing the resultsets and connections after it's done. Whether this is making a difference in your particular case, of course, I couldn't say. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=9207 --- Comment #3 from M. de Rooy <m.de.rooy@rijksmuseum.nl> --- Created attachment 15967 --> http://bugs.koha-community.org/bugzilla3/attachment.cgi?id=15967&action=edit Bug 9207 - Improve z39.50 speed slowdowns for sites with many records Signed-off-by: Marcel de Rooy <m.de.rooy@rijksmuseum.nl> -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=9207 M. de Rooy <m.de.rooy@rijksmuseum.nl> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Needs Signoff |Signed Off -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=9207 M. de Rooy <m.de.rooy@rijksmuseum.nl> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Signed Off |Passed QA --- Comment #4 from M. de Rooy <m.de.rooy@rijksmuseum.nl> --- I tested the new index, but it is hard to say if it is really faster with just a few thousand records in import_records. I have timed with Time::HiRes a few times, and got slightly better results. But just running the queries like _update_batch_record_counts does in mysql did not really make a difference. Nevertheless, I can imagine that this index makes a difference when you have much more records. Tested the upgrade. Tested the install by running kohastructure partially from command-line. Amended the patch for a small detail: there is no index in Koha with two underscores in the name. So I removed one underscore. No further QA comments: Passed QA -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=9207 M. de Rooy <m.de.rooy@rijksmuseum.nl> changed: What |Removed |Added ---------------------------------------------------------------------------- Version|unspecified |master -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=9207 M. de Rooy <m.de.rooy@rijksmuseum.nl> changed: What |Removed |Added ---------------------------------------------------------------------------- QA Contact| |m.de.rooy@rijksmuseum.nl -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=9207 Kyle M Hall <kyle@bywatersolutions.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #13872|0 |1 is obsolete| | -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=9207 Jared Camins-Esakov <jcamins@cpbibliography.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Passed QA |Pushed to Master --- Comment #5 from Jared Camins-Esakov <jcamins@cpbibliography.com> --- This patch has been pushed to master. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=9207 Chris Cormack <chris@bigballofwax.co.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Pushed to Master |Pushed to Stable CC| |chris@bigballofwax.co.nz --- Comment #6 from Chris Cormack <chris@bigballofwax.co.nz> --- Pushed to 3.10.x and 3.8.x will be in 3.10.4 and 3.8.11 -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=9207 Chris Cormack <chris@bigballofwax.co.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Severity|enhancement |minor -- You are receiving this mail because: You are watching all bug changes.
participants (1)
-
bugzilla-daemon＠bugs.koha-community.org