[Koha-bugs] [Bug 35086] Koha::SearchEngine::Elasticsearch::Indexer->update_index needs to commit in batches

[bugzilla-daemon at bugs.koha-community.org]

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=35086

David Nind <david at davidnind.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
  Text to go in the|This enables breaking large |This enables breaking large
      release notes|Elasticsearch or Open       |Elasticsearch or Open
                   |Search indexing requests    |Search indexing requests
                   |into smaller chunks (for    |into smaller chunks (for
                   |example, from batch         |example, when updating many
                   |modifications). It adds a   |records using batch
                   |chunk_size configuration to |modifications).
                   |the elasticsearch section   |
                   |in koha-conf.xml (the       |This means
                   |default is 5,000:           |that instead of sending a
                   |<chunk_size>5000</chunk_siz |single background request
                   |e>). So instead of sending  |for indexing, which could
                   |a single background request |exceed the limits of the
                   |for indexing, which could   |search server or take up
                   |exceed the limits of the    |too many resources, it
                   |search server or take up    |limits index update
                   |too many resources, this    |requests to a more
                   |limits index update         |manageable size.
                   |requests to a more          |
                   |manageable size.
           |The
                   |
                           |default chunk size is
                   |NOTE:                       |5,000. To configure a
                   |This doesn't change the     |different chunk size, add a
                   |command line indexing       |<chunk_size> directive to
                   |script, as this already     |the elasticsearch section
                   |allows passing a commit     |of the instance's
                   |size defining how many      |koha-conf.xml (for example:
                   |records to send.            |<chunk_size>2000</chunk_siz
                   |                            |e>).
                   |                            |
                   |                            |NOTE: This doesn't
                   |                            |change the command line
                   |                            |indexing script, as this
                   |                            |already allows passing a
                   |                            |commit size defining how
                   |                            |many records to send.

--- Comment #23 from David Nind <david at davidnind.com> ---
Tweaked the release notes text - feel free to improve!

-- 
You are receiving this mail because:
You are watching all bug changes.