[Koha-bugs] [Bug 23073] wiki.koha-community.org needs updating to a later version

[bugzilla-daemon at bugs.koha-community.org]

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=23073

--- Comment #31 from Thomas Dukleth <td-koha-bugs at agogme.com> ---
Using Debian 8 for database migration from Postgres to MySQL avoids warnings
and errors from pg_restore which is better than having some potential
unidentified problem.  The MySQL wiki dump is copied from Debian 8 to Debian 10
or 11.  Debian 10 has been tested for wiki upgrade using the MySQL wiki dump
from and should work with Debian 11.

A test run of the Canasta MediaWiki Docker image for fairly fulsome use of
MediaWiki pending.  If the test run with Canasta works, we should upgrade for
production the next available day.

Code and configuration files to test migrating the MediaWiki database and
upgrading the wiki are currently available at the same location,
git://test01.agogme.com/koha-migrate-mwiki-db-and-upgrade-test.git .  Files
excluded as inappropriate for version control are currently available at the
same location,
https://test01.agogme.com/koha-migrate-mwiki-db-and-upgrade-test.tgz .

Anyone interested in testing the code would need to separately obtain a full
dump of the Koha Wiki to avoid publicly compromising Koha Wiki usernames and
passwords which are not contained in the published archive.  The issue of
resetting wgSecretKey in LocalSettings.php could be avoided by obtaining a copy
of the Koha Wiki LocalSettings.php .  I have prepared a special nonpublic tar
archive for Koha developers interested in testing.

Please note as before that newly reinstalled MediaWiki instances take time for
indexing etc. to catch up over multiple days and indexing requires actual use
to weight the result set properly.  They may frequently go down or become slow
when: regenerated for code testing; or excess RAM or CPU use running some
memory intensive processes unrelated to Koha on the VPS.  Non-Koha use of the
VPS starting too many processes still occasionally leads the OOM killer to stop
mysqld for which I should add a monitoring and restart service for when I
forget to check after such excess RAM usage.

Reinstalled test instance of the Koha Wiki using Postgres on Debian 8 with
Nginx at https://koha-mw-pg-test02.agogme.com/ .

Koha test wiki migrated to MySQL on Debian 8 with Nginx at
https://koha-mw-my-test02.agogme.com/ .

Koha MySQL test wiki upgraded to MediaWiki 1.35 LTS on Debian 10 with Nginx at
https://koha-mw-my-test00-upgr.agogme.com/ .

We will likely continue to use Apache in production until or unless we have the
resolution for wiki full image page working in Ngnix which currently returns a
404 error for such pages.  For any deficiency of Nginx, try Apache by adding
port 9443 to any page such as
https://koha-mw-my-test00-upgr.agogme.com:9443/wiki/Some_Page .  MediaWiki
configuration will force the port back to the port back to the configured HTTPS
port 443 and does not support running the same wiki instance simultaneously for
different webservers on different ports.

Please note that some adjustment of the upgraded wiki, such as the superseded
language change template at the bottom of the home page, may be outside the
ordinary scope of an automated upgrade process and require manual correction. 
The job queue may be full for an extended period after reinstalling or
upgrading a test wiki instance because reindexing is necessary.  Ordering of
search query result set improves with actual use but may be partly ordered by
page creation initially after reindexing rather than page modification or other
potentially more useful relevancy ranking which develops over time as the wiki
instance is used.  Postgres based queries to which we may be accustomed do
automatic word stemming and index page titles.  MySQL based MediaWiki allows
support for many options including Apache Lucene indexing via Elastic Search or
Open Search.

Dynamic archiving to exclude obsolete pages using "-[[Category:Obsolete]]"
requires all pages to have at least one category which is generally necessary
in any case even if there is insufficient time to select an appropriate
category assigning a placeholder category for category unselected such as
[[Category:Empty]] would be helpful which can later be replaced with an
appropriate choice.

>From the current changelog.

In /etc examples
----------------

Moved example files in the /etc directory to os-variants directory for
Debian version specific use.

In README.txt
-------------

Added apt instruction for packages libconfig-simple-perl rsync gnupg
postgresql-contrib libdbd-pg-perl python python-psycopg2 python-mysqldb
python3 .

Added additional package installation for several php and other packages
which had been configured manually in advance of previous testing where
they had been selected from packages filing requirements for the Debian
distribution mediawiki package.

Correction for Debian 10 and later substitute libnode-dev for nodejs-dev .

Added os-variants.

Added tested operating system version divided use where database migration
from Postgres to MySQL is done in Debian 8 to avoid warnings and errors
from using pg_restore for restoring the Postgres production database
starting point.  Wiki upgrade is then done on Debian 10 which has been
tested using the MySQL databse dumped from Debian 8.  Upgrade could also
be done on Debian 11 untested.

Clarified language and instruction variously.

In koha_migrate_mwiki_db_and_upgrade.ini
---------------------------------------

Added human readable postupgrade MySQL dump path.

In koha-migrate-mwiki-db-and-upgrade-startup.sh
-----------------------------------------------

Added support for additional necessary automatic package installation
for libconfig-simple-perl .

Added option for using database dump from old operating system version.

Added upgrade option now used for automated upgrade.

In koha-migrate-mwiki-db-and-upgrade.pl
---------------------------------------

Changed use of underscore to hyphen for automatically created Apache
Casandra apt repository list file.

Added support for additional necessary automatic package installation
for rsync gnupg libdbd-pg-perl python-psycopg2 python-mysqldb.

Corrected misspelling with extra dash in automated installation of
packages php5.6-mysql php5.6-pgsql php7.4-mysql php7.4-pgsql .

Added support for additional necessary automatic package installation
for several php and other packages which had been configured manually
in advance of previous testing where they had been selected from
packages filing requirements for the Debian distribution mediawiki
package.

Correction for Debian 10 and later substitute libnode-dev for nodejs-dev .

Corrected for some instances missing apt-get -y option to ensure package
installation works non-interactively.

Corrected automated Apache configuration for Debian 8 using php-fpm.

Commented out call to
koha-mediawiki-mysql-alter-col-for-migration-from-postgres.sql .

Added os-variants directory for installation use.

Added option for using database dump from old operating system version.

Added upgrade option now used for automated upgrade.

Added additional postupgrade MySQL dumps.

In koha-mediawiki-pgsqltomysql.py
---------------------------------

Corrected for file exists error when creating a directory which already
exists for log files.

Activated additional file truncation code to avoid need to increase
any column sizes as the Perl script call to
koha-mediawiki-mysql-alter-col-for-migration-from-postgres.sql is
now commented out.

In koha-mwiki-instances-postinstall.sh
--------------------------------------

Added prospective --server argument to update.php calls to avoid
possible "PHP Notice: Undefined index: SERVER_NAME".

In LocalSettings.php
--------------------

Added !isset condition for REMOTE_ADDR to update.php reporting
"PHP Notice: Undefined index: REMOTE_ADDR".

Moved LocalSettings.php files to os-variants directory.

In koha-migrate-mwiki-db_and-upgrade-forexport.sh
-------------------------------------------------

Added path variables for files in os-variants directory.

------------------------------------------

Pending Bug Fixes.

Full View of Saved Files Not Displaying.

The full view of image files in the form of /wiki/File:some_file are not
displaying.  The suggested Nginx fix requires more attention.  The easy
workaround is to revert to Apache.

Maintenance Job Control.

I added some support for running MediaWiki maintenance/runJobs.php to the post
install shell script for MediaWiki test instances but I need to add control for
maintenance/runJobs.php as an additional separate recurring process which is
actually fairly trivial.  Using the Canasta Docker image for MediaWiki provides
some convenient default configuration for some things such as job control.

-- 
You are receiving this mail because:
You are watching all bug changes.