[Bug 29285] New: UI tests: Selenium 4 support
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 Bug ID: 29285 Summary: UI tests: Selenium 4 support Change sponsored?: --- Product: Koha Version: master Hardware: All OS: All Status: NEW Severity: normal Priority: P5 - low Component: Test Suite Assignee: chris@bigballofwax.co.nz Reporter: victor@tuxayo.net QA Contact: testopia@bugs.koha-community.org Now v4 is the default when getting the docker image selenium/standalone-firefox . For Selenium 4, the maintainer of our current perl bindings wrote another client: https://metacpan.org/pod/Selenium::Client -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 Victor Grousset/tuxayo <victor@tuxayo.net> changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|chris@bigballofwax.co.nz |victor@tuxayo.net Status|NEW |ASSIGNED -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 Victor Grousset/tuxayo <victor@tuxayo.net> changed: What |Removed |Added ---------------------------------------------------------------------------- Depends on| |27055 Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=27055 [Bug 27055] Update Firefox version used in Selenium GUI tests -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 Katrin Fischer <katrin.fischer@bsz-bw.de> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jonathan.druart+koha@gmail. | |com --- Comment #1 from Katrin Fischer <katrin.fischer@bsz-bw.de> --- Is this one still valid? -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 Victor Grousset/tuxayo <victor@tuxayo.net> changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|UI tests: Selenium 4 |UI tests: Selenium 4 |support |support or setup Cypress to | |make them rewritable with | |it --- Comment #2 from Victor Grousset/tuxayo <victor@tuxayo.net> --- Unfortunately yes and no. Yes because Firefox is stuck at some old version (2 or 3 years old) because only Selenium 4 supports recent ones. No because Selenium tests are less reliable so higher maintenance. So the work (kinda unpredictable like from Selenium 2 to 3) to change our Selenium lib would not be worth for just prolonging their use. The alternative is setting up Cypress to be able to replace Selenium. As opposed to today. Jonathan told me a few months what are the limitations: No DB access to inject and delete/rollback data. That's why current Cypress usage mocks all network queries. Path forward would be to read koha-conf and use cypress-mysql (see cypress-studio in Jonathan's GitLab repo) Then the issue is data generation (no TestBuilder!) and cleaning. «IMO there shouldn't be time spent on a migration to Selenium (at least for now)» That doesn't look a small task to find a trick to use TestBuilder or recode it plus the rest so we are kinda stuck at the crossroads between the two ways. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 --- Comment #3 from Victor Grousset/tuxayo <victor@tuxayo.net> ---
Yes because Firefox is stuck at some old version
In case someone needs the info, it's Firefox 92, from September 2021. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 Victor Grousset/tuxayo <victor@tuxayo.net> changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.koha-community | |.org/bugzilla3/show_bug.cgi | |?id=38503 -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 --- Comment #4 from Victor Grousset/tuxayo <victor@tuxayo.net> --- Moving here a discussion where I erroneously thought Bug 38503 would allow to replace TestBuilder.
Bug 38503 won't help much here.
Now that there is an easy way to have well populated json objects (in sync with the tables because the API is kept well in sync) in the Cypress tests, is there much to do to feed them to the API? Most TestBuilder usage should be on tables that are well covered by the API. Here is what I found in the Selenium tests: - Koha::Patrons - biblio record - Koha::Libraries - Koha::Virtualshelves (Bug 38050) - items - Koha::ItemTypes - Koha::Patron::Categories "that are well covered by the API" => nope >_< Only the 1st group has the add endpoint and only one of the others has work in progress on it. There is also the need to have something else added to easily cleanup data. Like truncating tables. And since it seems not possible to use transactions there nor mock sysprefs, the more subtle data to cleanup like circ rules and sysprefs need more crafty ways. Maybe using an SQL connector[1], getting an SQL dump of a table and on cleanup truncating and inserting would do the trick? [1] https://www.npmjs.com/package/mariadb or maybe there is a more generic one. To not add yet another DBMS specific thing. Is there a shorter path forward? Whether it's using Bug 38503 or not. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 Victor Grousset/tuxayo <victor@tuxayo.net> changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.koha-community | |.org/bugzilla3/show_bug.cgi | |?id=38506 -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 Victor Grousset/tuxayo <victor@tuxayo.net> changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.koha-community | |.org/bugzilla3/show_bug.cgi | |?id=36607 -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 Jake Deery <jake.deery@openfifth.co.uk> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jake.deery@openfifth.co.uk --- Comment #5 from Jake Deery <jake.deery@openfifth.co.uk> --- This discussion is possibly going to become more pressing, soon. Open Fifth operates Docker_8 through to Docker_15 (eight runners) on Jenkins. We are currently experimenting with the idea of replacing half, or even six, of these nodes with lower-cost and (we're still testing, but maybe) higher performance ARM64 nodes. As Selenium 3.x doesn't support ARM64 CPUs, we could end up with nodes on Jenkins that fail the suite! We could run Selenium only on the AMD64 nodes, but this feels like kicking a can down a road it has already seen a few times over, already… Ta, Jake (D) -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 Jonathan Druart <jonathan.druart@gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|UI tests: Selenium 4 |[OMNIBUS] Rewrite Selenium |support or setup Cypress to |tests using Cypress |make them rewritable with | |it | Severity|normal |enhancement Assignee|victor@tuxayo.net |jonathan.druart@gmail.com -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 Jonathan Druart <jonathan.druart@gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.koha-community | |.org/bugzilla3/show_bug.cgi | |?id=19384 -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 Jonathan Druart <jonathan.druart@gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Depends on| |42748 Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=42748 [Bug 42748] Rewrite selenium/administration_tasks.t using Cypress -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 Paul Derscheid <paul.derscheid@lmscloud.de> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |paul.derscheid@lmscloud.de -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=29285 --- Comment #6 from Jonathan Druart <jonathan.druart@gmail.com> --- If you want to see Selenium tests rewritten with Cypress, it's happening now. See bug 42748 for the first rewrite. I can continue with the other Selenium tests once it's pushed. -- You are receiving this mail because: You are watching all bug changes.
participants (1)
-
bugzilla-daemon＠bugs.koha-community.org