[Bug 8062] New: Cart email broken for non english templates
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Priority: P5 - low Change sponsored?: --- Bug ID: 8062 Assignee: frederic@tamil.fr Summary: Cart email broken for non english templates Severity: critical Classification: Unclassified OS: All Reporter: katrin.fischer@bsz-bw.de Hardware: All Status: NEW Version: rel_3_6 Component: I18N/L10N Product: Koha Sending an email with the contents of your cart is broken in non english templates. To reproduce: - Search OPAC - Add some titles to your cart - Open cart and try to send you the contents - log in, if you didn't before - Send cart to any email address - Check email text and attachements The mail sent from the translated templats has subject "no subject" and is empty. The marc files are attached. The mail sent from the english templates is all correct. This is an important OPAC feature for some libraries. Bug has been confirmed in 3.6.3 with German templates and in 3.6.4 with Arabic templates. Still has to be confirmed against master and 3.8. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Owen Leonard <oleonard@myacpl.org> changed: What |Removed |Added ---------------------------------------------------------------------------- Version|rel_3_6 |master --- Comment #1 from Owen Leonard <oleonard@myacpl.org> --- Confirmed in master using fresh nb-NO templates. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #2 from Katrin Fischer <katrin.fischer@bsz-bw.de> --- Ok, I compared the English with the translated German templates. The translated file is missing all line breaks after line 7 <MESSAGE> and is broken because of that. I am not sure how to fix it as it seems to be a problem with the translation scripts not preserving the line breaks correctly. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #3 from Katrin Fischer <katrin.fischer@bsz-bw.de> --- Ok, the error is starting even before line 7. Still investigating. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #4 from Katrin Fischer <katrin.fischer@bsz-bw.de> --- After giving it some thought I think the main problem here is that our translation scripts are not made to parse a plain text file, but TT and HTML. I also tried adding the line breaks back in Poedit, but they get taken out again on saving the file. We can also not use \n or similar, because that will also cause problems (bug 4883) Without the line breaks the formatting is broken and the regex searching for the markers (<SUBJECT><END_SUBJECT> etc) are not working. I am a bit out of ideas right now on how to fix that. This is a big problem for every translated Koha installation. It's not only affecting the OPAC cart, but also staff cart and sending lists from both staff and cart. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #5 from Frédéric Demians <frederic@tamil.fr> --- I confirm the bug, its severity, and your diagnostic. There should be already get an issue before 3.8. Email sent by Koha comes from a template which isn't strictly a template. There is a pseudo-syntax allowing subject/message extraction. But this mini-templating system isn't compliant with our current translation system which doesn't preserve new lines: it doesn't matter in HTML; it's important in raw text, which is used in basket email. We must rewrite in HTML the email sent by OPAC Send your Basket functionality. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #6 from Frédéric Demians <frederic@tamil.fr> --- Created attachment 9551 --> http://bugs.koha-community.org/bugzilla3/attachment.cgi?id=9551&action=edit Proposed patch Bug 8062 Cart email broken for non english templates Fix basket email sent from OPAC. The email is now in HTML. To test that it works in other language than English, you have to update your language .po file: perl translate update de-DE Then, translated strings coming from opac-sendbasket.tt, and install the translation: perl translate install de-DE -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Frédéric Demians <frederic@tamil.fr> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |Needs Signoff -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #7 from Katrin Fischer <katrin.fischer@bsz-bw.de> --- Hi Frederic, thank you for providing a patch! I have tried to find out when the feature broke and tracked it back to the switch to TT. I am not sure how it could go unnoticed for so long. I am a bit worried about switching to HTML, because normally Koha is sending text mails. Is there a way we could make it work as text mail still? We could perhaps trick the translation tools by using <br/> and a paragraph in the notice template, but remove those (HTML::Scrubber?) before sending the mail out. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #8 from Frédéric Demians <frederic@tamil.fr> ---
I am a bit worried about switching to HTML, because normally Koha is sending text mails.
Take a look a the resulting mail. It's not that bad.
Is there a way we could make it work as text mail still?
We could fix the translator, and get it preserving new line characters. But it's not that easy.
We could perhaps trick the translation tools by using <br/> and a paragraph in the notice template, but remove those (HTML::Scrubber?) before sending the mail out.
I fear that chunk of HTML finish in the .po file, and so disturb translators. We could also transform the HTML into Text just before sending the email. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #9 from Frédéric Demians <frederic@tamil.fr> --- Created attachment 9572 --> http://bugs.koha-community.org/bugzilla3/attachment.cgi?id=9572&action=edit Proposed patch 2nd version Fix basket email sent from OPAC. The email body is now generated HTML (to be translatable), and converted into TEXT before being sent by email. To test that it works in other language than English, you have to update your language .po file: perl translate update de-DE Then, translated strings coming from opac-sendbasket.tt, and install the translation: perl translate install de-DE New dependency: Template::Plugin::HtmlToText -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Jonathan Druart <jonathan.druart@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #9551|0 |1 is obsolete| | Attachment #9572|0 |1 is obsolete| | --- Comment #10 from Jonathan Druart <jonathan.druart@biblibre.com> --- Created attachment 9875 --> http://bugs.koha-community.org/bugzilla3/attachment.cgi?id=9875&action=edit Bug 8062 [SIGNED-OFF] Cart email broken for non english templates Fix basket email sent from OPAC. The email body is now generated HTML (to be translatable), and converted into TEXT before beeing sent by email. To test that it works in other language than English, you have to update your language .po file: perl translate update de-DE Then, translated strings coming from opac-sendbasket.tt, and install the translation: perl translate install de-DE New dependency: Template::Plugin::HtmlToText Signed-off-by: Jonathan Druart <jonathan.druart@biblibre.com> -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Jonathan Druart <jonathan.druart@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Needs Signoff |Signed Off CC| |jonathan.druart@biblibre.co | |m --- Comment #11 from Jonathan Druart <jonathan.druart@biblibre.com> --- It works fine :) Perharps a followup is required to specified the new dependency (in C4/Installer/PerlDependencies.pm ?) -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #12 from Frédéric Demians <frederic@tamil.fr> ---
Perharps a followup is required to specified the new dependency (in C4/Installer/PerlDependencies.pm ?)
The template contains a 'USE HtmlToText' directive, which use a Template::Toolkit module. It's not a Perl module, and it's included by default with Template::Toolkit. Is it the dependency we were thinking about? -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #13 from Jonathan Druart <jonathan.druart@biblibre.com> --- To test your patch, I had to install the Template::Plugin::HtmlToText module via cpan. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #14 from Frédéric Demians <frederic@tamil.fr> --- Created attachment 9908 --> http://bugs.koha-community.org/bugzilla3/attachment.cgi?id=9908&action=edit Add Perl module dependency My fault... You're correct, this a new required Perl module. Here it is. Thanks. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Jonathan Druart <jonathan.druart@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #9908|0 |1 is obsolete| | --- Comment #15 from Jonathan Druart <jonathan.druart@biblibre.com> --- Created attachment 9940 --> http://bugs.koha-community.org/bugzilla3/attachment.cgi?id=9940&action=edit Bug 8062 [SIGNED-OFF] Perl module dependency Template::Plugin::HtmlToText Signed-off-by: Jonathan Druart <jonathan.druart@biblibre.com> -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Paul Poulain <paul.poulain@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Signed Off |Passed QA CC| |paul.poulain@biblibre.com --- Comment #16 from Paul Poulain <paul.poulain@biblibre.com> --- QA comment: * small patch, that uses a T::T plugin to fix an annoying problem * introduces a new dependency that could be usefull in other circumstances, so it's OK * remove some commented/dead code ++ * opac/opac-sendbasket.pl still passes perlcritic passed QA -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Paul Poulain <paul.poulain@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Version|master |rel_3_8 --- Comment #17 from Paul Poulain <paul.poulain@biblibre.com> --- critical problem in non-english languages, worth porting it to 3.8 -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Paul Poulain <paul.poulain@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Passed QA |Pushed to Master -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Chris Cormack <chris@bigballofwax.co.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Pushed to Master |Pushed to Stable CC| |chris@bigballofwax.co.nz --- Comment #18 from Chris Cormack <chris@bigballofwax.co.nz> --- pushed to 3.8.x will be in 3.8.2 -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #19 from Jared Camins-Esakov <jcamins@cpbibliography.com> --- The patch for this major bug will require a few things for inclusion in 3.6.x: 1. A new patch that does not conflict on koha-tmpl/opac-tmpl/prog/en/modules/opac-sendbasket.tt 2. A follow-up patch that adds instructions for installing the new Perl module via CPAN and/or the debian.koha-community.org apt repository 3. A packaged version of libtemplate-plugin-htmltotext-perl for the oldstable distribution on debian.koha-community.org 4. An explanation of what the new dependency is required for so that I can put it in the release notes. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #20 from Frédéric Demians <frederic@tamil.fr> --- I have no time now for your points 1-3.
4. An explanation of what the new dependency is required for so that I can put it in the release notes.
With Template::Plugin::HtmlToText, it's possible to transform HTML into Text! as suggested by the module name. It allows Koha developers to use standard (for Koha) Template::Toolkit templating system to generate HTML, and then, if necessary to transform this HTML into raw text. This is required for example for email sent by Koha, which use to be in Text. Benefits: --email templates can have a rich HTML-base layout, but still being sent in Text ; --email templates are translatable like Koha web pages -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Robin Sheat <robin@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |robin@catalyst.net.nz --- Comment #21 from Robin Sheat <robin@catalyst.net.nz> --- I think this patch introduces a bug: +use HTML::FormatText; this isn't mentioned in the dependency list, and doesn't appear to be used in the code. Thus, opac-sendbasket.pl breaks unless you happen to have that module installed. Can someone confirm that this is the case? -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #22 from Robin Sheat <robin@catalyst.net.nz> --- OK, it is a dependency of Template::Plugin::HtmlToText, however that doesn't declare it as a dependency in the META.yml, so the packages don't either, and so it never gets installed. Guess I'll have to redo the packages some time soon to account for that. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 M. de Rooy <m.de.rooy@rijksmuseum.nl> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |m.de.rooy@rijksmuseum.nl --- Comment #23 from M. de Rooy <m.de.rooy@rijksmuseum.nl> --- (In reply to comment #21)
I think this patch introduces a bug:
+use HTML::FormatText;
this isn't mentioned in the dependency list, and doesn't appear to be used in the code. Thus, opac-sendbasket.pl breaks unless you happen to have that module installed. Can someone confirm that this is the case?
Confirmed: Can't locate HTML/FormatText.pm in @INC Paul: When you passed this through QA, you mentioned the new dependency. But nothing was done in a followup for dependency list, etc. ? -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Katrin Fischer <katrin.fischer@bsz-bw.de> changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |http://bugs.koha-community. | |org/bugzilla3/show_bug.cgi? | |id=8368 -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 M. de Rooy <m.de.rooy@rijksmuseum.nl> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Pushed to Stable |ASSIGNED Assignee|frederic@tamil.fr |m.de.rooy@rijksmuseum.nl -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 M. de Rooy <m.de.rooy@rijksmuseum.nl> changed: What |Removed |Added ---------------------------------------------------------------------------- Severity|critical |minor -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #24 from M. de Rooy <m.de.rooy@rijksmuseum.nl> --- I submitted a patch for the dependency under 7368. But Robin is right that the code in opac-basket does not directly use FormatText. So the use statement can be deleted. But note that the Template::Plugin::HtmlToText requires HTML::FormatText. So it is a core Koha dependency. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 M. de Rooy <m.de.rooy@rijksmuseum.nl> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #9875|0 |1 is obsolete| | -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 M. de Rooy <m.de.rooy@rijksmuseum.nl> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #9940|0 |1 is obsolete| | -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 --- Comment #25 from M. de Rooy <m.de.rooy@rijksmuseum.nl> --- Created attachment 10969 --> http://bugs.koha-community.org/bugzilla3/attachment.cgi?id=10969&action=edit Patch for HTML::FormatText Deletes use statement only in opac-sendbasket.pl Template::Plugin::HtmlToText does require it on its own. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 M. de Rooy <m.de.rooy@rijksmuseum.nl> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|ASSIGNED |Needs Signoff -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 M. de Rooy <m.de.rooy@rijksmuseum.nl> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Needs Signoff |Signed Off -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 M. de Rooy <m.de.rooy@rijksmuseum.nl> changed: What |Removed |Added ---------------------------------------------------------------------------- Version|rel_3_8 |master -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Jonathan Druart <jonathan.druart@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Signed Off |Passed QA --- Comment #26 from Jonathan Druart <jonathan.druart@biblibre.com> --- QA Comments: Bug 8062 introduced this new dependency in opac-sendbasket. But it did not call a routine of this module. As no new call have been added since, it's useless. Marking as Passed QA. -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Paul Poulain <paul.poulain@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Passed QA |Pushed to Master Version|master |rel_3_8 --- Comment #27 from Paul Poulain <paul.poulain@biblibre.com> --- Follow-up pushed (yikes : I wanted to remove the self-signoff & put mine, but pushed to quickly...) -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Chris Cormack <chris@bigballofwax.co.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Pushed to Master |Pushed to Stable --- Comment #28 from Chris Cormack <chris@bigballofwax.co.nz> --- Follow up pushed to 3.8.x, will be in 3.8.4 -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Katrin Fischer <katrin.fischer@bsz-bw.de> changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |http://bugs.koha-community. | |org/bugzilla3/show_bug.cgi? | |id=8621 -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 M. de Rooy <m.de.rooy@rijksmuseum.nl> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Pushed to Stable |RESOLVED Resolution|--- |FIXED -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Frédéric Demians <frederic@tamil.fr> changed: What |Removed |Added ---------------------------------------------------------------------------- Blocks| |9189 -- You are receiving this mail because: You are watching all bug changes.
http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8062 Fridolyn SOMERS <fridolyn.somers@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |http://bugs.koha-community. | |org/bugzilla3/show_bug.cgi? | |id=9218 -- You are receiving this mail because: You are watching all bug changes.
participants (1)
-
bugzilla-daemon＠bugs.koha-community.org