[Koha-bugs] [Bug 18238] New: Test harness/suite/"test runner"

[bugzilla-daemon at bugs.koha-community.org]

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=18238

            Bug ID: 18238
           Summary: Test harness/suite/"test runner"
 Change sponsored?: ---
           Product: Koha
           Version: master
          Hardware: All
                OS: All
            Status: NEW
          Severity: enhancement
          Priority: P5 - low
         Component: Test Suite
          Assignee: chris at bigballofwax.co.nz
          Reporter: olli-antti.kivilahti at jns.fi
        QA Contact: gmcharlt at gmail.com

There is no smart interface for running different types of tests in Koha and
covering code coverage metrics from those.

This bug introduces one way of running various test suites.

+my $usage = <<USAGE;
+
+Runs a ton of tests with other metrics if needed
+
+  -h --help             This friendly help!
+
+  -v --verbose          Integer, the level of verbosity
+
+  --tar                 Create a testResults.tar.gz from all tests and
deliverables
+
+  --dry-run             Don't run tests or other metrics. Simply show what
would happen.
+
+  --clover              Run Devel::Cover and output Clover-reports
+
+  -a --all              Run all tests.
+
+  -b --basic            Basic tests t/*.t
+
+  -x --xt               XT tests
+
+  -s --sip2             SIP2 tests
+
+  -d --db               db_dependent tests
+
+  --git                 Integer, look for this many git commits from HEAD and
run
+                        all '.t'-files that they have changed.
+                        This is meaningful as a quick smoke test to verify
that
+                        the latest changes haven't been broken or work as
expected.
+                        Thus where the most probably reason for breakage
occurs,
+                        is tested first, before executing more lengthy test
suites.
+
+EXAMPLE
+
+    ##First run a smoke test for latest changes
+    ks-test-harness.pl --git 5 --tar
+    ##Then run a big test suite
+    ks-test-harness.pl --all --tar

-- 
You are receiving this mail because:
You are watching all bug changes.