[Koha-bugs] [Bug 35598] selenium/authentication_2fa.t is still failing randomly

[bugzilla-daemon at bugs.koha-community.org]

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=35598

David Nind <david at davidnind.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |david at davidnind.com
             Status|Needs Signoff               |Failed QA

--- Comment #2 from David Nind <david at davidnind.com> ---
The tests are failing for me after applying the patch (and keeping the wait),
started KTD with: ktd --selenium up.

Here is the result after
~~~~~~~~~~~~~~~~~~~~~~~~

prove t/db_dependent/selenium/authentication_2fa.t
t/db_dependent/selenium/authentication_2fa.t .. 2/5 
    #   Failed test 'Email not sent will display an error'
    #   at t/db_dependent/selenium/authentication_2fa.t line 215.
    #                   ''
    #     doesn't match '(?^u:Email not sent)'
    # Looks like you failed 1 test of 3.

#   Failed test 'Send OTP code'
#   at t/db_dependent/selenium/authentication_2fa.t line 234.
    # Looks like you planned 7 tests but ran 2.
t/db_dependent/selenium/authentication_2fa.t .. 4/5 
#   Failed test 'Enforce 2FA setup on first login'
#   at t/db_dependent/selenium/authentication_2fa.t line 296.
Cannot wait more for element '//*[@id="registration-form"]' to be visible at
/kohadevbox/koha/t/lib/Selenium.pm line 189.
# Looks like your test exited with 255 just after 4.
t/db_dependent/selenium/authentication_2fa.t .. Dubious, test returned 255
(wstat 65280, 0xff00)
Failed 3/5 subtests 

Test Summary Report
-------------------
t/db_dependent/selenium/authentication_2fa.t (Wstat: 65280 Tests: 4 Failed: 2)
  Failed tests:  3-4
  Non-zero exit status: 255
  Parse errors: Bad plan.  You planned 5 tests but ran 4.
Files=1, Tests=4, 73 wallclock secs ( 0.01 usr  0.02 sys +  1.46 cusr  0.28
csys =  1.77 CPU)
Result: FAIL


Here is the result after - with -v
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

prove -v t/db_dependent/selenium/authentication_2fa.t
t/db_dependent/selenium/authentication_2fa.t .. 
1..5
# Subtest: Setup
    1..13
    ok 1 - Hitting the main page should redirect to the login form
    ok 2 - Patron with flags superlibrarian should be able to login
    ok 3 - Must be redirected to 404 is the pref is off
    ok 4 - Must be on the page with the pref on
    ok 5 - 2FA is disabled
    ok 6 - 2FA is disabled
    ok 7 - There is a QR code
    ok 8
    ok 9
    ok 10 - secret is not set in DB yet
    ok 11 - 2FA is enabled
    ok 12 - 2FA is enabled
    ok 13 - encrypted secret is set in DB
ok 1 - Setup
# Subtest: Login
    1..18
    ok 1 - Must be on the first auth screen
    ok 2 - Must be on the second auth screen
    ok 3
    ok 4 - Must be redirected to the original page
    ok 5 - Must be on the first auth screen
    ok 6 - Must be on the second auth screen
    ok 7
    ok 8
    ok 9 - Must still be on the second auth screen
    ok 10
    ok 11 - Must be on the first auth screen
    ok 12
    ok 13 - Must be on the first auth screen
    ok 14
    ok 15 - Must be on the second auth screen
    ok 16
    ok 17
    ok 18 - Must be redirected to the original page
ok 2 - Login
# Subtest: Send OTP code
    1..3
    ok 1 - Must be on the first auth screen
    ok 2 - Must be on the second auth screen
    not ok 3 - Email not sent will display an error

    #   Failed test 'Email not sent will display an error'
    #   at t/db_dependent/selenium/authentication_2fa.t line 215.
    #                   ''
    #     doesn't match '(?^u:Email not sent)'
    # Looks like you failed 1 test of 3.
not ok 3 - Send OTP code

#   Failed test 'Send OTP code'
#   at t/db_dependent/selenium/authentication_2fa.t line 234.
# Subtest: Enforce 2FA setup on first login
    1..7
    ok 1 - Must be on the first auth screen
    ok 2 - Must be on the 2FA auth setup screen
    # Looks like you planned 7 tests but ran 2.
not ok 4 - Enforce 2FA setup on first login

#   Failed test 'Enforce 2FA setup on first login'
#   at t/db_dependent/selenium/authentication_2fa.t line 296.
Cannot wait more for element '//*[@id="registration-form"]' to be visible at
/kohadevbox/koha/t/lib/Selenium.pm line 189.
# Looks like your test exited with 255 just after 4.
Dubious, test returned 255 (wstat 65280, 0xff00)
Failed 3/5 subtests 

Test Summary Report
-------------------
t/db_dependent/selenium/authentication_2fa.t (Wstat: 65280 Tests: 4 Failed: 2)
  Failed tests:  3-4
  Non-zero exit status: 255
  Parse errors: Bad plan.  You planned 5 tests but ran 4.
Files=1, Tests=4, 72 wallclock secs ( 0.01 usr  0.01 sys +  1.47 cusr  0.33
csys =  1.82 CPU)
Result: FAIL

-- 
You are receiving this mail because:
You are watching all bug changes.