[Koha-bugs] [Bug 26128] Proxy Error while importing a large number of patrons (e.g. 6000 patrons) with Plack

[bugzilla-daemon at bugs.koha-community.org]

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=26128

--- Comment #10 from David Cook <dcook at prosentient.com.au> ---
I'm going to try to reproduce in Plack using koha-testing-docker first without
the patch:

Test plan:
1) Upload file with 2000 patrons (majority of columns filled)
2) "Cardnumber" used for matching
3) "Overwrite the existing one with this" for matching
4) "Replace all patron attributes" for attributes

Got the following message in my UI:

Import results :
0 imported records
0 overwritten
0 not imported because already in borrowers table and overwrite disabled
2415 not imported because they are not in the expected format
2415 records parsed

1) Replacing "branchcode" with CPL
2) Replacing "categorycode" with "PT"
3) Deleting dateenrolled (date format), dateexpiry (date format), borrowernotes
(the script apparently can't handle double quotes), opacnotes (double quotes),
contact note (double quotes), updated_on (date format)

I got the proxy error after importing 678 rows.

After reviewing the code and watching the database, this code is just really
really slow. The code is 326 lines long and really inefficient. 

Using a bit of debugging code, I can see that the file is uploaded almost
immediately the Koha server (I can see it at /tmp/H9VmB7xkED).

Trying again and I'm up to 1877 rows imported/updated before getting the error. 

I'm thinking this isn't a Plack vs CGI issue but rather a proxy issue...

Ohhhhh... this is a 502 and not a 504. I kept thinking it was a 504 Gateway
Timeout, but it's actually a 502 Proxy Error:

Proxy Error
The proxy server received an invalid response from an upstream server.
The proxy server could not handle the request

Reason: Error reading from remote server

I notice I am still getting some database errors. I wonder what kind of
response it is generating...

-- 
You are receiving this mail because:
You are watching all bug changes.