Anyone have a suggestion on how to get at least a count of these 856's in the MARC record in my database? David Schuster -- View this message in context: http://old.nabble.com/SQL-for-856-tag-in-marc-record-tp27329118p27329118.htm... Sent from the Koha - Dev mailing list archive at Nabble.com.
Anyone have a suggestion on how to get at least a count of these 856's in the MARC record in my database?
SELECT COUNT(url) FROM biblioitems; will give you the number of biblio records having at least one 856. A biblio record with several 856 tags will be count as 1 url. If you want something more efficient, you could try to add an index named 'url' to your zebra configuration pointing to 856$t (and even other MARC subfields containing URLs). Then re-index. This PQF search will return exactly all records having something in 'url' field: @attr 1=url @attr 2=103 "" But same problem than with MySQL alternative. Maybe a zebra scan command could help. Don't know how exactly. -- Frédéric
Well I'm getting closer, but that only provided me with a response of 40 and I know I have well over 3000 urls in records. Wonder why the rest didn't populate? They show up in the catalog... David Schuster Frederic Demians wrote:
Anyone have a suggestion on how to get at least a count of these 856's in the MARC record in my database?
SELECT COUNT(url) FROM biblioitems;
will give you the number of biblio records having at least one 856. A biblio record with several 856 tags will be count as 1 url.
If you want something more efficient, you could try to add an index named 'url' to your zebra configuration pointing to 856$t (and even other MARC subfields containing URLs). Then re-index. This PQF search will return exactly all records having something in 'url' field:
@attr 1=url @attr 2=103 ""
But same problem than with MySQL alternative. Maybe a zebra scan command could help. Don't know how exactly.
-- Frédéric
_______________________________________________ Koha-devel mailing list Koha-devel@lists.koha.org http://lists.koha.org/mailman/listinfo/koha-devel
-- View this message in context: http://old.nabble.com/SQL-for-856-tag-in-marc-record-tp27329118p27339116.htm... Sent from the Koha - Dev mailing list archive at Nabble.com.
Difference between the biblioitems.url field and the actual MARC 856 (in the xml)? I don't know what makes biblioitems.url get populated, but I suspect if you load data in bulk (outside the Tools import) it doesn't happen. Somebody had a neat trick on the IRC (chris_n?) for reading the actual MARC fields out of the XML. That might work better. Jane Wagner Library Systems Analyst PTFS Inc. Content Management and Library Solutions 6400 Goldsboro Road, Suite 200 Bethesda, MD 20817 (301) 654-8088 x 151 jwagner@ptfs.com -----Original Message----- From: koha-devel-bounces@lists.koha.org [mailto:koha-devel-bounces@lists.koha.org] On Behalf Of David Schuster Sent: Wednesday, January 27, 2010 8:32 AM To: koha-devel@lists.koha.org Subject: Re: [Koha-devel] SQL for 856 tag in marc record Well I'm getting closer, but that only provided me with a response of 40 and I know I have well over 3000 urls in records. Wonder why the rest didn't populate? They show up in the catalog... David Schuster Frederic Demians wrote:
Anyone have a suggestion on how to get at least a count of these 856's in the MARC record in my database?
SELECT COUNT(url) FROM biblioitems;
will give you the number of biblio records having at least one 856. A biblio record with several 856 tags will be count as 1 url.
If you want something more efficient, you could try to add an index named 'url' to your zebra configuration pointing to 856$t (and even other MARC subfields containing URLs). Then re-index. This PQF search will return exactly all records having something in 'url' field:
@attr 1=url @attr 2=103 ""
But same problem than with MySQL alternative. Maybe a zebra scan command could help. Don't know how exactly.
-- Frédéric
_______________________________________________ Koha-devel mailing list Koha-devel@lists.koha.org http://lists.koha.org/mailman/listinfo/koha-devel
-- View this message in context: http://old.nabble.com/SQL-for-856-tag-in-marc-record-tp27329118p27339116.htm... Sent from the Koha - Dev mailing list archive at Nabble.com. _______________________________________________ Koha-devel mailing list Koha-devel@lists.koha.org http://lists.koha.org/mailman/listinfo/koha-devel
2010/1/27 Wagner, Jane <jwagner@ptfs.com>:
Difference between the biblioitems.url field and the actual MARC 856 (in the xml)? I don't know what makes biblioitems.url get populated, but I suspect if you load data in bulk (outside the Tools import) it doesn't happen.
Isn't that the mapping defined under Administration -> MARC-links (/cgi-bin/koha/admin/koha2marclinks.pl)? I think this mapping is respected even if records are imported with bulkmarcimport.pl. But perhaps there is some difference in which subfield is actually used and which field Koha expects to find the URLs in?
Somebody had a neat trick on the IRC (chris_n?) for reading the actual MARC fields out of the XML. That might work better.
Could this be what you are thinking of? http://old.nabble.com/Re%3A-Koha3%2C-loading-locale-data%2C-contribs-and-%09... Regards, Magnus libriotech.no
-----Original Message----- From: koha-devel-bounces@lists.koha.org [mailto:koha-devel-bounces@lists.koha.org] On Behalf Of David Schuster Sent: Wednesday, January 27, 2010 8:32 AM To: koha-devel@lists.koha.org Subject: Re: [Koha-devel] SQL for 856 tag in marc record
Well I'm getting closer, but that only provided me with a response of 40 and I know I have well over 3000 urls in records.
Wonder why the rest didn't populate? They show up in the catalog...
David Schuster
Well turns out I think I had a bad backup and reload on the test server as the number of biblio - is about 100,000 off even... When I do the sql on the production server I got 16481 urls which would be more like it. If you are interested I put this up on the wiki for check-url.pl http://wiki.koha.org/doku.php?id=en:development:check-url_enhancements&s[]=check&s[]=url&s[]=pl I'm working with an in house programmer to make it a better utility... He's added information on where to place an output file so your cataloger can pull it up and look at it - fdemians had a great idea on how to speed up the URL check aspect of it, but need to install another dependancy to do that I believe. Still looking! open for comments! Magnus Enger wrote:
2010/1/27 Wagner, Jane <jwagner@ptfs.com>:
Difference between the biblioitems.url field and the actual MARC 856 (in the xml)? I don't know what makes biblioitems.url get populated, but I suspect if you load data in bulk (outside the Tools import) it doesn't happen.
Isn't that the mapping defined under Administration -> MARC-links (/cgi-bin/koha/admin/koha2marclinks.pl)? I think this mapping is respected even if records are imported with bulkmarcimport.pl. But perhaps there is some difference in which subfield is actually used and which field Koha expects to find the URLs in?
Somebody had a neat trick on the IRC (chris_n?) for reading the actual MARC fields out of the XML. That might work better.
Could this be what you are thinking of? http://old.nabble.com/Re%3A-Koha3%2C-loading-locale-data%2C-contribs-and-%09...
Regards, Magnus libriotech.no
-----Original Message----- From: koha-devel-bounces@lists.koha.org [mailto:koha-devel-bounces@lists.koha.org] On Behalf Of David Schuster Sent: Wednesday, January 27, 2010 8:32 AM To: koha-devel@lists.koha.org Subject: Re: [Koha-devel] SQL for 856 tag in marc record
Well I'm getting closer, but that only provided me with a response of 40 and I know I have well over 3000 urls in records.
Wonder why the rest didn't populate? They show up in the catalog...
David Schuster
Koha-devel mailing list Koha-devel@lists.koha.org http://lists.koha.org/mailman/listinfo/koha-devel
-- View this message in context: http://old.nabble.com/SQL-for-856-tag-in-marc-record-tp27329118p27340284.htm... Sent from the Koha - Dev mailing list archive at Nabble.com.
It would be nice to have the ability to check a range of bib numbers, or just the option to start at a specific bib number. (--beginbib 10000 --endbib 11000). Especially for checking new records that are imported into the system. Garry On Wed, Jan 27, 2010 at 9:28 AM, David Schuster <dschust1@tx.rr.com> wrote:
Well turns out I think I had a bad backup and reload on the test server as the number of biblio - is about 100,000 off even... When I do the sql on the production server I got 16481 urls which would be more like it.
If you are interested I put this up on the wiki for check-url.pl
http://wiki.koha.org/doku.php?id=en:development:check-url_enhancements&s[]=check&s[]=url&s[]=pl
I'm working with an in house programmer to make it a better utility... He's added information on where to place an output file so your cataloger can pull it up and look at it - fdemians had a great idea on how to speed up the URL check aspect of it, but need to install another dependancy to do that I believe. Still looking! open for comments!
Magnus Enger wrote:
2010/1/27 Wagner, Jane <jwagner@ptfs.com>:
Difference between the biblioitems.url field and the actual MARC 856 (in the xml)? I don't know what makes biblioitems.url get populated, but I suspect if you load data in bulk (outside the Tools import) it doesn't happen.
Isn't that the mapping defined under Administration -> MARC-links (/cgi-bin/koha/admin/koha2marclinks.pl)? I think this mapping is respected even if records are imported with bulkmarcimport.pl. But perhaps there is some difference in which subfield is actually used and which field Koha expects to find the URLs in?
Somebody had a neat trick on the IRC (chris_n?) for reading the actual MARC fields out of the XML. That might work better.
Could this be what you are thinking of? http://old.nabble.com/Re%3A-Koha3%2C-loading-locale-data%2C-contribs-and-%09...
Regards, Magnus libriotech.no
-----Original Message----- From: koha-devel-bounces@lists.koha.org [mailto:koha-devel-bounces@lists.koha.org] On Behalf Of David Schuster Sent: Wednesday, January 27, 2010 8:32 AM To: koha-devel@lists.koha.org Subject: Re: [Koha-devel] SQL for 856 tag in marc record
Well I'm getting closer, but that only provided me with a response of 40 and I know I have well over 3000 urls in records.
Wonder why the rest didn't populate? They show up in the catalog...
David Schuster
Koha-devel mailing list Koha-devel@lists.koha.org http://lists.koha.org/mailman/listinfo/koha-devel
-- View this message in context: http://old.nabble.com/SQL-for-856-tag-in-marc-record-tp27329118p27340284.htm... Sent from the Koha - Dev mailing list archive at Nabble.com.
_______________________________________________ Koha-devel mailing list Koha-devel@lists.koha.org http://lists.koha.org/mailman/listinfo/koha-devel
participants (5)
-
David Schuster -
Frederic Demians -
Garry Collum -
Magnus Enger -
Wagner, Jane