[Koha-bugs] [Bug 27463] OAI-PMH date handling in ListBase.pm

[bugzilla-daemon at bugs.koha-community.org]

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=27463

Ere Maijala <ere.maijala at helsinki.fi> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |ASSIGNED
           Assignee|koha-bugs at lists.koha-commun |ere.maijala at helsinki.fi
                   |ity.org                     |

--- Comment #8 from Ere Maijala <ere.maijala at helsinki.fi> ---
(In reply to Rudolf Byker from comment #7)
> Indeed. I re-read my original post, and can't find a way to say it any
> clearer than I did. Please also read the linked IRC chat. :)(In reply to Ere
> Maijala from comment #6)

Oh, there's a bug indeed. Sorry, not sure how I missed it then and now. It all
works fine when you have `include_items: 1` in the conf file specified by
preference OAI-PMH:ConfFile, but the item timestamps should be ignored when
that's not the case. I'll post a patch. 

The thing with joins is that they are indeed quite terrible. If you only
consider a range of one day, it all looks ok, but the way OAI-PMH harvesting
usually works is that the initial harvest is done without date limits to get
all the records, and then incremental harvesting is done with just a 'from'
date (since the beginning of the previous harvesting). That means the date
limits may include millions of records, and joins on such large sets are better
avoided. I'll contact you off-bug for further discussion on the topic.

You can check the history for these files to see how things have evolved in an
attempt to improve functionality and performance.

Also, I've just posted bug 27584 with a further refinement trying to address
performance issues when there are millions of biblios.

-- 
You are receiving this mail because:
You are watching all bug changes.
You are the assignee for the bug.