[Koha-devel] Extending MARC::Charset::Table ?

[Philippe Blouin]

Thanks Galen, Paul,

I'm sorry I just noticed your answers in my inbox.

Galen, I tried your solution (the record is in fact a utf8 encoded xml 
document), but it made no difference.  But it did lead me to some nice 
places in the code (and documentation) where I now specify the 
BinaryEncoding => 'utf8' in the 'use Marc::File::XML'.  It will probably 
break another migration, but this fixes my problem for now.

Thanks again!
Philippe



On 06/04/2014 06:49 PM, Galen Charlton wrote:
> Hi,
>
> On Wed, Jun 4, 2014 at 11:56 AM, Philippe Blouin 
> <philippe.blouin at inlibro.com <mailto:philippe.blouin at inlibro.com>> wrote:
>
>     We're using the MARC library for some migration, as usual, but we
>     encountered some new issue with some arabic title: the key code 703
>     0x02BF 	703 	MODIFIER LETTER LEFT HALF RING 	ʿ
>
>      is not part of the Table db, which cause the whole subfield to
>     disappear and causing us headaches.
>
>
>
> What is the source character encoding of the records?  If the records 
> are already in UTF-8, then it is not necessary to transcode them to 
> MARC8, then back to UTF8 for loading into Koha.  Adding the following 
> line to whatever code you're using to pre-process the records might help:
>
> MARC::Charset->assume_unicode(1);
>
> As an alternative, you could adjust change the records to use 0x02bb 
> rather than 0x02bf.  I'm assuming that the strings in question are 
> transliterated Arabic following the ALA-LC Arabic romanization.  If 
> so, back in 1999, the mapping of the "ayn" character was changed from 
> 0x02bf to 0x02bb. [1]
>
> [1] http://www.loc.gov/marc/marbi/2005/2005-05.html
>
> Regards,
>
> Galen
> -- 
> Galen Charlton
> Manager of Implementation
> Equinox Software, Inc. / The Open Source Experts
> email: gmc at esilibrary.com <mailto:gmc at esilibrary.com>
> direct: +1 770-709-5581
> cell:   +1 404-984-4366
> skype:  gmcharlt
> web: http://www.esilibrary.com/
> Supporting Koha and Evergreen: http://koha-community.org & 
> http://evergreen-ils.org

-- 
Philippe Blouin,
Responsable du développement informatique

Tél.  : (888) 604-2627
philippe.blouin at inLibro.com <mailto:philippe.blouin at inLibro.com>

inLibro | pour esprit libre | www.inLibro.com <http://www.inLibro.com>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.koha-community.org/pipermail/koha-devel/attachments/20140606/e5938214/attachment.html>