[Koha-bugs] [Bug 26996] Elasticsearch: Multiprocess reindexing sometimes doesn't reindex all records
bugzilla-daemon at bugs.koha-community.org
bugzilla-daemon at bugs.koha-community.org
Wed Dec 23 16:40:45 CET 2020
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=26996
Nick Clemens <nick at bywatersolutions.com> changed:
What |Removed |Added
----------------------------------------------------------------------------
Attachment #114232|0 |1
is obsolete| |
--- Comment #5 from Nick Clemens <nick at bywatersolutions.com> ---
Created attachment 114679
-->
https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=114679&action=edit
Bug 26996: Convert Elasticsearch indexer commit buffer size to integer
When multithreaded indexing is used, the commit size for children are spread
out resulting in them being of type float. When records are processed and the
commit counter decreased it may then never reach *exactly* 0. This means
records
are never commited. This patch makes sure the counter is an integer to avoid
the
problem.
To test you must find a set of circumstances that causes the issue. For me:
1. Run: ./rebuild_elasticsearch -v -b -p 2 -c 400
2. Note that only one process is logging "Committing xxx records..."
3. Kill processes.
4. Apply patch.
5. Repeat 1
6. Note that both processes are logging "Committing xxx records..."
Sponsored-by: Lund University Library
Signed-off-by: Joonas Kylmälä <joonas.kylmala at helsinki.fi>
Signed-off-by: Nick Clemens <nick at bywatersolutions.com>
--
You are receiving this mail because:
You are watching all bug changes.
More information about the Koha-bugs
mailing list