link_bibs_to_authorities.pl can corrupt records
Bug 5683 (link_bibs_to_authorities.pl can corrupt records) was signed off some months ago, but is perhaps a little too cryptic for me to follow in detail. Can someone help? As far as I can see, without remedial action, this is catastrophic. Following difficulties we have had migrating 3.2 to 3.6.1, someone on the users mailing list suggested we should run link_bibs_to_authorities.pl -- (db has ~10k authorities and ~15k biblios) -- so I did just that, and have APPARENTLY DEMOLISHED *EVERY* LINK IN THE DB. From my notes: paul@nelson:/usr/share/koha$ ./bin/link_bibs_to_authorities.pl Bib authority heading linking report ------------------------------------ Number of bibs checked: 14911 Number of bibs modified: 14886 Number of bibs with errors: 0 but - the staff interface no longer correctly finds authorities !!! [1] Manually link (staff client) auth "Lubbock" to bib "Arctic Whalers" -- now linked, 35 other Lubbock bibs not linked. Is this a question of zebra re-indexing? So: KOHA_CONF=/etc/koha/koha-conf.xml PERL5LIB=/usr/share/koha/lib ./bin/migration_tools/rebuild_zebra.pl -a -r -v and KOHA_CONF=/etc/koha/koha-conf.xml PERL5LIB=/usr/share/koha/lib ./bin/migration_tools/rebuild_zebra.pl -b -r -v -x koha@nelson:/usr/share/koha$ ./bin/link_bibs_to_authorities.pl ... processed 100 records / ... / ... processed 14900 records Bib authority heading linking report ------------------------------------ Number of bibs checked: 14911 Number of bibs modified: 1 Number of bibs with errors: 0 koha@nelson:/usr/share/koha$ All this did was to *un-link" the bib/auth link that I had manually entered at [1] above. Could someone involved with signing off bug 5683 please explain why link==unlink? Help - please. Paul
Im assuming you did this on your testing/staging server right? Id restore that from backup, then try applying the patch and see if you get better behaviour. If so, then do it on your production machine. Chris On 7 Jan 2012 08:47, "Paul" <paul.a@aandc.org> wrote:
Bug 5683 (link_bibs_to_authorities.pl can corrupt records) was signed off some months ago, but is perhaps a little too cryptic for me to follow in detail. Can someone help? As far as I can see, without remedial action, this is catastrophic.
Following difficulties we have had migrating 3.2 to 3.6.1, someone on the users mailing list suggested we should run link_bibs_to_authorities.pl -- (db has ~10k authorities and ~15k biblios) -- so I did just that, and have APPARENTLY DEMOLISHED *EVERY* LINK IN THE DB. From my notes:
paul@nelson:/usr/share/koha$ ./bin/link_bibs_to_**authorities.pl<http://link_bibs_to_authorities.pl>
Bib authority heading linking report ------------------------------**------ Number of bibs checked: 14911 Number of bibs modified: 14886 Number of bibs with errors: 0
but - the staff interface no longer correctly finds authorities !!!
[1] Manually link (staff client) auth "Lubbock" to bib "Arctic Whalers" -- now linked, 35 other Lubbock bibs not linked. Is this a question of zebra re-indexing?
So: KOHA_CONF=/etc/koha/koha-conf.**xml PERL5LIB=/usr/share/koha/lib ./bin/migration_tools/rebuild_**zebra.pl <http://rebuild_zebra.pl> -a -r -v and KOHA_CONF=/etc/koha/koha-conf.**xml PERL5LIB=/usr/share/koha/lib ./bin/migration_tools/rebuild_**zebra.pl <http://rebuild_zebra.pl> -b -r -v -x
koha@nelson:/usr/share/koha$ ./bin/link_bibs_to_**authorities.pl<http://link_bibs_to_authorities.pl> ... processed 100 records / ... / ... processed 14900 records
Bib authority heading linking report ------------------------------**------ Number of bibs checked: 14911 Number of bibs modified: 1 Number of bibs with errors: 0 koha@nelson:/usr/share/koha$
All this did was to *un-link" the bib/auth link that I had manually entered at [1] above. Could someone involved with signing off bug 5683 please explain why link==unlink?
Help - please.
Paul
______________________________**_________________ Koha-devel mailing list Koha-devel@lists.koha-**community.org<Koha-devel@lists.koha-community.org> http://lists.koha-community.**org/cgi-bin/mailman/listinfo/**koha-devel<http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel> website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.**org/ <http://bugs.koha-community.org/>
Paul, The link_bibs_to_authorities.pl script is hardcoded to ALWAYS erase manual links. I'm not sure what the reasoning is behind that. But, every time you run it, any link you've done manually that the script can't automatically figure out will be removed. Nature of the beast (for now, at least). -Ian 2012/1/6 Chris Cormack <chris@bigballofwax.co.nz>
Im assuming you did this on your testing/staging server right? Id restore that from backup, then try applying the patch and see if you get better behaviour.
If so, then do it on your production machine.
Chris On 7 Jan 2012 08:47, "Paul" <paul.a@aandc.org> wrote:
Bug 5683 (link_bibs_to_authorities.pl can corrupt records) was signed off some months ago, but is perhaps a little too cryptic for me to follow in detail. Can someone help? As far as I can see, without remedial action, this is catastrophic.
Following difficulties we have had migrating 3.2 to 3.6.1, someone on the users mailing list suggested we should run link_bibs_to_authorities.pl-- (db has ~10k authorities and ~15k biblios) -- so I did just that, and have APPARENTLY DEMOLISHED *EVERY* LINK IN THE DB. From my notes:
paul@nelson:/usr/share/koha$ ./bin/link_bibs_to_**authorities.pl<http://link_bibs_to_authorities.pl>
Bib authority heading linking report ------------------------------**------ Number of bibs checked: 14911 Number of bibs modified: 14886 Number of bibs with errors: 0
but - the staff interface no longer correctly finds authorities !!!
[1] Manually link (staff client) auth "Lubbock" to bib "Arctic Whalers" -- now linked, 35 other Lubbock bibs not linked. Is this a question of zebra re-indexing?
So: KOHA_CONF=/etc/koha/koha-conf.**xml PERL5LIB=/usr/share/koha/lib ./bin/migration_tools/rebuild_**zebra.pl <http://rebuild_zebra.pl> -a -r -v and KOHA_CONF=/etc/koha/koha-conf.**xml PERL5LIB=/usr/share/koha/lib ./bin/migration_tools/rebuild_**zebra.pl <http://rebuild_zebra.pl> -b -r -v -x
koha@nelson:/usr/share/koha$ ./bin/link_bibs_to_**authorities.pl<http://link_bibs_to_authorities.pl> ... processed 100 records / ... / ... processed 14900 records
Bib authority heading linking report ------------------------------**------ Number of bibs checked: 14911 Number of bibs modified: 1 Number of bibs with errors: 0 koha@nelson:/usr/share/koha$
All this did was to *un-link" the bib/auth link that I had manually entered at [1] above. Could someone involved with signing off bug 5683 please explain why link==unlink?
Help - please.
Paul
______________________________**_________________ Koha-devel mailing list Koha-devel@lists.koha-**community.org<Koha-devel@lists.koha-community.org> http://lists.koha-community.**org/cgi-bin/mailman/listinfo/**koha-devel<http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel> website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.**org/<http://bugs.koha-community.org/>
_______________________________________________ Koha-devel mailing list Koha-devel@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
-- Ian Walls Lead Development Specialist ByWater Solutions ALA Midwinter Booth #2048 Phone # (888) 900-8944 http://bywatersolutions.com ian.walls@bywatersolutions.com Twitter: @sekjal
Paul, Bug 5683 is a different problem. It results in your records being unrecoverably corrupted. You'd recognize the problem by the fact that after running link_bibs_to_authorities.pl you wouldn't be able to look at some records in your catalog. What you are encountering is the apparently-intended behavior of link_bibs_to_authorities.pl, as Ian says. I am currently working on bug 7284, which makes the linker actually work. However, until that is finished and pushed, running link_bibs_to_authorities.pl is most exceedingly not a good idea. If you're running this on a dev install, just to experiment, you could pull in my changes from https://github.com/jcamins/koha/commits/bug_7284 Regards, Jared 2012/1/6 Ian Walls <ian.walls@bywatersolutions.com>
Paul,
The link_bibs_to_authorities.pl script is hardcoded to ALWAYS erase manual links. I'm not sure what the reasoning is behind that. But, every time you run it, any link you've done manually that the script can't automatically figure out will be removed. Nature of the beast (for now, at least).
-Ian
2012/1/6 Chris Cormack <chris@bigballofwax.co.nz>
Im assuming you did this on your testing/staging server right? Id restore that from backup, then try applying the patch and see if you get better behaviour.
If so, then do it on your production machine.
Chris On 7 Jan 2012 08:47, "Paul" <paul.a@aandc.org> wrote:
Bug 5683 (link_bibs_to_authorities.pl can corrupt records) was signed off some months ago, but is perhaps a little too cryptic for me to follow in detail. Can someone help? As far as I can see, without remedial action, this is catastrophic.
Following difficulties we have had migrating 3.2 to 3.6.1, someone on the users mailing list suggested we should run link_bibs_to_authorities.pl -- (db has ~10k authorities and ~15k biblios) -- so I did just that, and have APPARENTLY DEMOLISHED *EVERY* LINK IN THE DB. From my notes:
paul@nelson:/usr/share/koha$ ./bin/link_bibs_to_**authorities.pl<http://link_bibs_to_authorities.pl>
Bib authority heading linking report ------------------------------**------ Number of bibs checked: 14911 Number of bibs modified: 14886 Number of bibs with errors: 0
but - the staff interface no longer correctly finds authorities !!!
[1] Manually link (staff client) auth "Lubbock" to bib "Arctic Whalers" -- now linked, 35 other Lubbock bibs not linked. Is this a question of zebra re-indexing?
So: KOHA_CONF=/etc/koha/koha-conf.**xml PERL5LIB=/usr/share/koha/lib ./bin/migration_tools/rebuild_**zebra.pl <http://rebuild_zebra.pl> -a -r -v and KOHA_CONF=/etc/koha/koha-conf.**xml PERL5LIB=/usr/share/koha/lib ./bin/migration_tools/rebuild_**zebra.pl <http://rebuild_zebra.pl> -b -r -v -x
koha@nelson:/usr/share/koha$ ./bin/link_bibs_to_**authorities.pl<http://link_bibs_to_authorities.pl> ... processed 100 records / ... / ... processed 14900 records
Bib authority heading linking report ------------------------------**------ Number of bibs checked: 14911 Number of bibs modified: 1 Number of bibs with errors: 0 koha@nelson:/usr/share/koha$
All this did was to *un-link" the bib/auth link that I had manually entered at [1] above. Could someone involved with signing off bug 5683 please explain why link==unlink?
Help - please.
Paul
______________________________**_________________ Koha-devel mailing list Koha-devel@lists.koha-**community.org<Koha-devel@lists.koha-community.org> http://lists.koha-community.**org/cgi-bin/mailman/listinfo/**koha-devel<http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel> website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.**org/<http://bugs.koha-community.org/>
_______________________________________________ Koha-devel mailing list Koha-devel@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
-- Ian Walls Lead Development Specialist ByWater Solutions ALA Midwinter Booth #2048 Phone # (888) 900-8944 http://bywatersolutions.com ian.walls@bywatersolutions.com Twitter: @sekjal
_______________________________________________ Koha-devel mailing list Koha-devel@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-devel website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
-- Jared Camins-Esakov Bibliographer, C & P Bibliography Services, LLC (phone) +1 (917) 727-3445 (e-mail) jcamins@cpbibliography.com (web) http://www.cpbibliography.com/
participants (4)
-
Chris Cormack -
Ian Walls -
Jared Camins-Esakov -
Paul