[Koha-bugs] [Bug 23073] wiki.koha-community.org needs updating to a later version

bugzilla-daemon at bugs.koha-community.org bugzilla-daemon at bugs.koha-community.org
Thu Feb 6 23:44:04 CET 2020


https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=23073

--- Comment #15 from Thomas Dukleth <td-koha-bugs at agogme.com> ---
As is well known, databases such as MySQL and Postgres do not have any magical
diff friendly dump which would have appropriate granularity to use in an
automated comparison to find any actual problem without being overwhelmed with
noise from necessary differences between databases where the essential data is
the same for relevant columns but where there are necessary database specific
differences such as an extra indexing column, etc.  Similar to what I had done
for some part of debugging the Python script for the database migration, I am
working on API based automated select of for every column and every row to
write out each row equivalent of data between the two databases so that actual
data is compared with appropriate granularity and not whole rows.  Such an
approach should be helpful to automatically check that the migrated data is
complete and spot any unlikely but possible issues, such as with encoding of
names from CJK languages which some users have, which would never be a problem
for true UTF8 in Postgres but for which the MediaWiki solution to historic
MySQL 3 byte limit for MySQL uft8 character set encoding is using binary data
type for MySQL columns.

[Encoding differences have been well addressed by insertion to MediaWiki
supported binary data type columns for use in MySQL some time ago as will be
explained retrospectively in a more detailed comment complete with references
to an old version Debian time machine allowing the MySQL database to be created
correctly for where we landed with MediaWiki when apprehending the database
choice mistake.]

The issue here is about an automated test for data comparison in which data has
been read from both the originating Postgres database and the migrated MySQL
database, then granularly saved in full UTF8 for diff comparison.

-- 
You are receiving this mail because:
You are watching all bug changes.


More information about the Koha-bugs mailing list