[Koha-bugs] [Bug 27584] Improve OAI-PMH provider performance

[bugzilla-daemon at bugs.koha-community.org]

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=27584

--- Comment #13 from Ere Maijala <ere.maijala at helsinki.fi> ---
Some benchmarking results:

My test system is intentionally memory-constrained, items are included and
OAI-PMH:MaxCount = 1000. All values are measured from 100 requests starting at
offset 190341 when doing a full harvesting without date limits. The database
contains 0.97 million biblios and 2.4 million items. Reported times are
averages with standard deviation in parentheses.

Full duration of oai.pl: 12.98s (0.94s)
Biblionumber query: 0.0024s (0.0024s)
Fetch+create record: 6.84s (0.51s)
Creating response: 4.97s (0.50s)

As far as I can see, this represents the full harvesting run pretty well, so it
doesn't slow down anymore when getting to higher biblionumbers. As the results
indicate, query duration for a set of results is now pretty much meaningless.
We spend most of the time collecting the record metadata and creating a DOM for
it, and then writing the actual response, which is part of the HTTP::OAI
module.

So to sum it up: with these changes the biblionumber query is no longer a
bottleneck. Previously, it easily took 15 to 20 seconds on my test system.

-- 
You are receiving this mail because:
You are watching all bug changes.