[Koha-bugs] [Bug 21872] New: Elasticsearch indexing faster by making it multi-threaded

[bugzilla-daemon at bugs.koha-community.org]

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21872

            Bug ID: 21872
           Summary: Elasticsearch indexing faster by making it
                    multi-threaded
 Change sponsored?: ---
           Product: Koha
           Version: master
          Hardware: All
                OS: All
            Status: NEW
          Severity: enhancement
          Priority: P5 - low
         Component: Searching - Elasticsearch
          Assignee: koha-bugs at lists.koha-community.org
          Reporter: joonas.kylmala at helsinki.fi
                CC: ere.maijala at helsinki.fi, glasklas at gmail.com

The record prosessing in misc/search_tools/rebuild_elastic_search.pl happens
currently single threadeadly, it could be made multithreaded to take full
advantage of multicore systems.

<ere> says on IRC following about this: "[..] a simple way would be to add
start offset and skip count to the indexing script so you could run multiple in
parallel"

So in the line "while ( my $record = $next->() ) {" the next->() function gets
called and that should be possible to multithread.

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.