[Koha-bugs] [Bug 2246] Label printing doesn't work with Unicode characters

[bugzilla-daemon at bugs.koha-community.org]

http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=2246

--- Comment #16 from wajasu <matted-34813 at mypacks.net> 2011-10-06 06:41:36 UTC ---
(In reply to comment #15)
> I am a bit confused about your example - because I had tested German umlauts
> like 'Jürgen' with one of the last patches that got into master for this bug
> and it worked nicely. Could your problem here be related to unicode
> normalization?

It could be because of unicode normalization.  I faintly recall making a
decision to call or not call some unicode normalization routine when I wrote a
program to convert to marcxml records from a legacy library syste 3 years ago. 
It might have been a windows cp1252 encoding originally, with characters
mapping to utf8.

I did this query against my database for diacritics:
With mysql I run:
select author,HEX(author),CHAR_LENGTH(author) from biblio where HEX(author)
like '%C3BC%';
and get lots of records like:
Moltmann, Jürgen.  | 4D6F6C746D616E6E2C204AC3BC7267656E2E | 17 
where the C3BC represents ü. 

The C3BC is what get written to the PDF file with out my patch. Maybe you can
use a hex editor and see if your label export has C3BC.  If so it might be the
PDF reader that is able to map that.  If yours is F9, then there must be a
difference in the perl version/compile options or module code.

Also, I saved a biblio as marcxml, and the xml contained  J&#xFX;rgen in
subfield code "a", so thats an XML entity.
Saving marc.utf8 it has JuCC88rgen  in the text areao of my hex editor.

Another specific query I did for my test record.
select author,HEX(author),CHAR_LENGTH(author) from biblio where author like
'%Habermas%';

mysql version: 5.5.16
mysql> SHOW SESSION VARIABLES LIKE 'character_set%';
+--------------------------+----------------------------+
| Variable_name            | Value                      |
+--------------------------+----------------------------+
| character_set_client     | utf8                       |
| character_set_connection | utf8                       |
| character_set_database   | utf8                       |
| character_set_filesystem | binary                     |
| character_set_results    | utf8                       |
| character_set_server     | utf8                       |
| character_set_system     | utf8                       |
| character_sets_dir       | /usr/share/mysql/charsets/ |
+--------------------------+----------------------------+


Note: These are barcode labels I'm printing.

-- 
Configure bugmail: http://bugs.koha-community.org/bugzilla3/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA Contact for the bug.