trying to understand zebra results
Hello all! Here at PBC, I'm in the process of trying to relink all of our biblios to the right authority files. Somehow, they were an /incredible/ mess. I've created the authority records okay, but when trying to run link_bibs_to_authorities.pl, it links them to the wrong places. Investigating, it seems like zebra isn't giving the right search results back. I can confirm this in yaz-client using the query that is created by koha. Searching for "Bentley, Peter, Ed." returns 4 results, only two of which are close. Actually, the record I'm trying to match is "Bentley, Peter, (Ed.)" - the last option. Interestingly enough, if I search for "Bentley, 3432531531532513985735981<anything at all here>" it will also show me the same four results. So does searching for "Bentley 513513531513515151". But searching for "Bentleyr435435151551251" shows no results, as I would expect. Am afraid I'm stumped here. PQF seems quite horrendously confusing. What do the numbers mean, in what context etc. Tried reading the indexdata manual, and still have no clue! Can anyone shed any light? Nick Z> find @or @attr 1=Local-Number @attr 7=1 0 @and @attr 1=authtype @attr 5=100 @attr 4=6 "PERSO_NAME" @attr 1=Match-heading @attr 4=1 @attr 5=100 @attr 6=3 "Bentley, Peter, Ed." Sent searchRequest. Received SearchResponse. Search was a success. Number of hits: 4, setno 2 SearchResult-1: term=PERSONAME cnt=16429, term=Bentley cnt=4 records returned: 0 Elapsed: 0.006522 Z> show 1 Sent presentRequest (1+1). Records: 1 [authorities]Record type: USmarc 00236naa a2200109 4500 001 1979 003 aukapbc 005 20160623125213.0 008 160623|| aca||aabn | a|a d 040 $a aukapbc $c aukapbc 100 $a Bentley, James 942 $a PERSO_NAME nextResultSetPosition = 2 Elapsed: 0.001677 Z> show 2 Sent presentRequest (2+1). Records: 1 [authorities]Record type: USmarc 00245naa a2200109 4500 001 1980 003 aukapbc 005 20160623125213.0 008 160623|| aca||aabn | a|a d 040 $a aukapbc $c aukapbc 100 $a Bentley, Michael $d 1935- 942 $a PERSO_NAME nextResultSetPosition = 3 Elapsed: 0.001511 Z> show 3 Sent presentRequest (3+1). Records: 1 [authorities]Record type: USmarc 00236naa a2200109 4500 001 1981 003 aukapbc 005 20160623125213.0 008 160623|| aca||aabn | a|a d 040 $a aukapbc $c aukapbc 100 $a Bentley, Peter 942 $a PERSO_NAME nextResultSetPosition = 4 Elapsed: 0.001448 Z> show 4 Sent presentRequest (4+1). Records: 1 [authorities]Record type: USmarc 00243naa a2200109 4500 001 1982 003 aukapbc 005 20160623125213.0 008 160623|| aca||aabn | a|a d 040 $a aukapbc $c aukapbc 100 $a Bentley, Peter, (Ed.) 942 $a PERSO_NAME nextResultSetPosition = 5 Elapsed: 0.001382
Hmmmm - if I modify Heading.pm, changing sub authorities { my $self = shift; my $skipmetadata = shift; my ( $results, $total ) = _search( $self, 'match-heading', $skipmetadata ); return $results; } to sub authorities { my $self = shift; my $skipmetadata = shift; my ( $results, $total ) = _search( $self, 'heading', $skipmetadata ); return $results; } Things seem to start making a bit more sense... I only get the one, expected result... Is this the right thing to do? I imagine it's been set to match-heading for a reason... Nick On 23/06/16 14:56, Nicholas van Oudtshoorn wrote:
Hello all!
Here at PBC, I'm in the process of trying to relink all of our biblios to the right authority files. Somehow, they were an /incredible/ mess. I've created the authority records okay, but when trying to run link_bibs_to_authorities.pl, it links them to the wrong places.
Investigating, it seems like zebra isn't giving the right search results back.
I can confirm this in yaz-client using the query that is created by koha. Searching for "Bentley, Peter, Ed." returns 4 results, only two of which are close. Actually, the record I'm trying to match is "Bentley, Peter, (Ed.)" - the last option.
Interestingly enough, if I search for "Bentley, 3432531531532513985735981<anything at all here>" it will also show me the same four results. So does searching for "Bentley 513513531513515151". But searching for "Bentleyr435435151551251" shows no results, as I would expect.
Am afraid I'm stumped here. PQF seems quite horrendously confusing. What do the numbers mean, in what context etc. Tried reading the indexdata manual, and still have no clue!
Can anyone shed any light?
Nick
Z> find @or @attr 1=Local-Number @attr 7=1 0 @and @attr 1=authtype @attr 5=100 @attr 4=6 "PERSO_NAME" @attr 1=Match-heading @attr 4=1 @attr 5=100 @attr 6=3 "Bentley, Peter, Ed." Sent searchRequest. Received SearchResponse. Search was a success. Number of hits: 4, setno 2 SearchResult-1: term=PERSONAME cnt=16429, term=Bentley cnt=4 records returned: 0 Elapsed: 0.006522 Z> show 1 Sent presentRequest (1+1). Records: 1 [authorities]Record type: USmarc 00236naa a2200109 4500 001 1979 003 aukapbc 005 20160623125213.0 008 160623|| aca||aabn | a|a d 040 $a aukapbc $c aukapbc 100 $a Bentley, James 942 $a PERSO_NAME
nextResultSetPosition = 2 Elapsed: 0.001677 Z> show 2 Sent presentRequest (2+1). Records: 1 [authorities]Record type: USmarc 00245naa a2200109 4500 001 1980 003 aukapbc 005 20160623125213.0 008 160623|| aca||aabn | a|a d 040 $a aukapbc $c aukapbc 100 $a Bentley, Michael $d 1935- 942 $a PERSO_NAME
nextResultSetPosition = 3 Elapsed: 0.001511 Z> show 3 Sent presentRequest (3+1). Records: 1 [authorities]Record type: USmarc 00236naa a2200109 4500 001 1981 003 aukapbc 005 20160623125213.0 008 160623|| aca||aabn | a|a d 040 $a aukapbc $c aukapbc 100 $a Bentley, Peter 942 $a PERSO_NAME
nextResultSetPosition = 4 Elapsed: 0.001448 Z> show 4 Sent presentRequest (4+1). Records: 1 [authorities]Record type: USmarc 00243naa a2200109 4500 001 1982 003 aukapbc 005 20160623125213.0 008 160623|| aca||aabn | a|a d 040 $a aukapbc $c aukapbc 100 $a Bentley, Peter, (Ed.) 942 $a PERSO_NAME
nextResultSetPosition = 5 Elapsed: 0.001382
Scratch that. It's a lot better than it was - but still doesn't get me the results I want. "match-heading" only searches on the first word in the search term. "match-heading" searches on all of the words in the search, but not as a phrase." For instance, we have an PERSO_NAME authority with nothing but 100a=T (I know, that data sucks, and is a mistake. But it highlights the problem nicely.) Searching for that with "heading" using the query: find @or @attr 1=Local-Number @attr 7=1 0 @and @attr 1=authtype @attr 5=100 @attr 4=6 "PERSO_NAME" @attr 1=Heading @attr 4=1 "T" nets me 207 results - including things like "Manley, G. T.", "Manson, T. W." etc. Searching for that "match-heading" using the query: find @or @attr 1=Local-Number @attr 7=1 0 @and @attr 1=authtype @attr 5=100 @attr 4=6 "PERSO_NAME" @attr 1=Match-heading @attr 4=1 @attr 5=100 @attr 6=3 "T" nets me 104 results, including some of the ones in the previous heading. What is stumping me is how to get it to return simply the one authority record that actually matches completely: 00224naa a2200109 4500 001 14894 003 aukapbc 005 20160623154209.0 008 160623|| aca||aabn | a|a d 040 $a aukapbc $c aukapbc 100 $a T 942 $a PERSO_NAME Nick On 23/06/16 15:21, Nicholas van Oudtshoorn wrote:
Hmmmm - if I modify Heading.pm, changing
sub authorities { my $self = shift; my $skipmetadata = shift; my ( $results, $total ) = _search( $self, 'match-heading', $skipmetadata ); return $results; }
to
sub authorities { my $self = shift; my $skipmetadata = shift; my ( $results, $total ) = _search( $self, 'heading', $skipmetadata ); return $results; }
Things seem to start making a bit more sense... I only get the one, expected result...
Is this the right thing to do? I imagine it's been set to match-heading for a reason...
Nick
On 23/06/16 14:56, Nicholas van Oudtshoorn wrote:
Hello all!
Here at PBC, I'm in the process of trying to relink all of our biblios to the right authority files. Somehow, they were an /incredible/ mess. I've created the authority records okay, but when trying to run link_bibs_to_authorities.pl, it links them to the wrong places.
Investigating, it seems like zebra isn't giving the right search results back.
I can confirm this in yaz-client using the query that is created by koha. Searching for "Bentley, Peter, Ed." returns 4 results, only two of which are close. Actually, the record I'm trying to match is "Bentley, Peter, (Ed.)" - the last option.
Interestingly enough, if I search for "Bentley, 3432531531532513985735981<anything at all here>" it will also show me the same four results. So does searching for "Bentley 513513531513515151". But searching for "Bentleyr435435151551251" shows no results, as I would expect.
Am afraid I'm stumped here. PQF seems quite horrendously confusing. What do the numbers mean, in what context etc. Tried reading the indexdata manual, and still have no clue!
Can anyone shed any light?
Nick
Z> find @or @attr 1=Local-Number @attr 7=1 0 @and @attr 1=authtype @attr 5=100 @attr 4=6 "PERSO_NAME" @attr 1=Match-heading @attr 4=1 @attr 5=100 @attr 6=3 "Bentley, Peter, Ed." Sent searchRequest. Received SearchResponse. Search was a success. Number of hits: 4, setno 2 SearchResult-1: term=PERSONAME cnt=16429, term=Bentley cnt=4 records returned: 0 Elapsed: 0.006522 Z> show 1 Sent presentRequest (1+1). Records: 1 [authorities]Record type: USmarc 00236naa a2200109 4500 001 1979 003 aukapbc 005 20160623125213.0 008 160623|| aca||aabn | a|a d 040 $a aukapbc $c aukapbc 100 $a Bentley, James 942 $a PERSO_NAME
nextResultSetPosition = 2 Elapsed: 0.001677 Z> show 2 Sent presentRequest (2+1). Records: 1 [authorities]Record type: USmarc 00245naa a2200109 4500 001 1980 003 aukapbc 005 20160623125213.0 008 160623|| aca||aabn | a|a d 040 $a aukapbc $c aukapbc 100 $a Bentley, Michael $d 1935- 942 $a PERSO_NAME
nextResultSetPosition = 3 Elapsed: 0.001511 Z> show 3 Sent presentRequest (3+1). Records: 1 [authorities]Record type: USmarc 00236naa a2200109 4500 001 1981 003 aukapbc 005 20160623125213.0 008 160623|| aca||aabn | a|a d 040 $a aukapbc $c aukapbc 100 $a Bentley, Peter 942 $a PERSO_NAME
nextResultSetPosition = 4 Elapsed: 0.001448 Z> show 4 Sent presentRequest (4+1). Records: 1 [authorities]Record type: USmarc 00243naa a2200109 4500 001 1982 003 aukapbc 005 20160623125213.0 008 160623|| aca||aabn | a|a d 040 $a aukapbc $c aukapbc 100 $a Bentley, Peter, (Ed.) 942 $a PERSO_NAME
nextResultSetPosition = 5 Elapsed: 0.001382
participants (1)
-
Nicholas van Oudtshoorn