[Koha-bugs] [Bug 35438] Importing records can create too large transactions

[bugzilla-daemon at bugs.koha-community.org]

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=35438

--- Comment #1 from David Cook <dcook at prosentient.com.au> ---
(In reply to Nick Clemens from comment #0)
> When importing a staged file we commit only every 50 records
> 
> For an authority import we are also merging, which can affect many more
> biblios, and these all end up in the transaction.
> 
> This can cause tables locks and issues across Koha
> 
> Why do we not commit each record as we go?

Historically, it was probably for speed reasons, but since we're using
background jobs I think committing each record as we go should be fine in terms
of performance. Back in the day, we didn't use transactions either, so they
wouldn't have been an issue back then.

I work on another system which is quite busy, and I've had to commit more
frequently to avoid deadlocks and other transaction related issues. It is much
slower but it's much more reliable.

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.