[Bug 36724] New: Add cartographic mathematical data to Elasticsearch index mappings
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Bug ID: 36724 Summary: Add cartographic mathematical data to Elasticsearch index mappings Change sponsored?: --- Product: Koha Version: unspecified Hardware: All OS: All Status: NEW Severity: enhancement Priority: P5 - low Component: Searching - Elasticsearch Assignee: koha-bugs@lists.koha-community.org Reporter: aleisha@catalyst.net.nz Search whole 255 field https://www.loc.gov/marc/bibliographic/bd255.html Test with values like * Scale 1:22,000,000 * Conic proj. -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 --- Comment #1 from Danyon Sewell <danyonsewell@catalyst.net.nz> --- Created attachment 167426 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=167426&action=edit Bug: 36724 Add cartographic mathematical data to Elasticsearch index mappings Have written a patch to allow cartographic mathematical data to be searched using the default keyword search index. Testing plan: 1. Start up KTD with Elasticsearch: ktd --es8 up 2. Apply the patch and restart everything (restart_all). 3. Reset the mappings: Administration > Catalog > Search engine configuration (Elasticsearch) > Reset mappings (at the bottom of the page) 4. Reindex: koha-elasticsearch --rebuild -d -b -a kohadev 5. Alternative to steps 3 and 4: reset_all 6. Update the visibility for 255$a & 255$b in the default framework so that it is visible in the Editor. 7. Add a new record using the default framework and put a unique term in both field 255$a and 255$b. 8. Using the basic keyword search, search for the terms you put in step 7. -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Danyon Sewell <danyonsewell@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|koha-bugs@lists.koha-commun |danyonsewell@catalyst.net.n |ity.org |z CC| |danyonsewell@catalyst.net.n | |z Status|NEW |Needs Signoff -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Aleisha Amohia <aleisha@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Needs Signoff |Failed QA --- Comment #2 from Aleisha Amohia <aleisha@catalyst.net.nz> --- Hey Danyon, this looks great and is almost there. Just a few changes to make: 1. Rename the patch to: Bug 36724: Add cartographic mathematical data to Elasticsearch index mappings (just moving the colon) 2. the `label` of the index needs to have no spaces, it's the name of the index. For eg: cartographic-mathematical-data 3. When a mapping uses multiple subfields from the same tag, you can consolidate them like this: marc_field: '255ab' Can you please make those changes and reattach the patch? -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Danyon Sewell <danyonsewell@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #167426|Bug: 36724 Add cartographic |Bug 36724: Add cartographic description|mathematical data to |mathematical data to |Elasticsearch index |Elasticsearch index |mappings |mappings -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Danyon Sewell <danyonsewell@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #167426|0 |1 is obsolete| | --- Comment #3 from Danyon Sewell <danyonsewell@catalyst.net.nz> --- Created attachment 167428 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=167428&action=edit Bug 36724: Add cartographic mathematical data to Elasticsearch index mappings ah my mistake, thanks for the pointers. Have gone ahead and made the requested changes. Testing plan: 1. Start up KTD with Elasticsearch: ktd --es8 up 2. Apply the patch and restart everything (restart_all). 3. Reset the mappings: Administration > Catalog > Search engine configuration (Elasticsearch) > Reset mappings (at the bottom of the page) 4. Reindex: koha-elasticsearch --rebuild -d -b -a kohadev 5. Alternative to steps 3 and 4: reset_all 6. Update the visibility for 255$a & 255$b in the default framework so that it is visible in the Editor. 7. Add a new record using the default framework and put a unique term in both field 255$a and 255$b. 8. Using the basic keyword search, search for the terms you put in step 7. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Danyon Sewell <danyonsewell@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Failed QA |Needs Signoff -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 David Nind <david@davidnind.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Needs Signoff |Patch doesn't apply CC| |david@davidnind.com --- Comment #4 from David Nind <david@davidnind.com> --- There is a sha1/fake ancestor error when applying the patch: git bz apply 36724 Bug 36724 - Add cartographic mathematical data to Elasticsearch index mappings 167428 - Bug 36724: Add cartographic mathematical data to Elasticsearch index mappings Apply? [(y)es, (n)o, (i)nteractive] y Applying: Bug 36724: Add cartographic mathematical data to Elasticsearch index mappings error: sha1 information is lacking or useless (admin/searchengine/elasticsearch/mappings.yaml). error: could not build fake ancestor Patch failed at 0001 Bug 36724: Add cartographic mathematical data to Elasticsearch index mappings -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Danyon Sewell <danyonsewell@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Patch doesn't apply |Needs Signoff -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Danyon Sewell <danyonsewell@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #167428|0 |1 is obsolete| | --- Comment #5 from Danyon Sewell <danyonsewell@catalyst.net.nz> --- Created attachment 167647 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=167647&action=edit Bug 36724: Add cartographic mathematical data to Elasticsearch index mappings Have reattached the patch hopefully this time without any sha1/fake ancestor errors. Testing plan: 1. Start up KTD with Elasticsearch: ktd --es8 up 2. Apply the patch and restart everything (restart_all). 3. Reset the mappings: Administration > Catalog > Search engine configuration (Elasticsearch) > Reset mappings (at the bottom of the page) 4. Reindex: koha-elasticsearch --rebuild -d -b -a kohadev 5. Alternative to steps 3 and 4: reset_all 6. Update the visibility for 255$a & 255$b in the default framework so that it is visible in the Editor. 7. Add a new record using the default framework and put a unique term in both field 255$a and 255$b. 8. Using the basic keyword search, search for the terms you put in step 7. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Laurence Rault <laurence.rault@biblibre.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |laurence.rault@biblibre.com --- Comment #6 from Laurence Rault <laurence.rault@biblibre.com> --- Testing plan works as expected. However, I don't understand why the index cartographic-mathematical-data is added as a new label in "abstract" search field in the mappings.yaml file instead of being apart : biblios: abstract: label: abstract mandatory: ~ mappings: - facet: '' marc_field: '520' marc_type: marc21 sort: 1 suggestible: '' opac: 1 staff_client: 1 type: '' label: cartographic-mathematical-data mandatory: ~ mappings: - facet: '' marc_field: '255ab' marc_type: marc21 sort: 1 suggestible: '' opac: 1 staff_client: 1 type: '' -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Wainui Witika-Park <wainuiwitikapark@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |wainuiwitikapark@catalyst.n | |et.nz -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Janusz Kaczmarek <januszop@gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |januszop@gmail.com --- Comment #7 from Janusz Kaczmarek <januszop@gmail.com> --- IMO the patch lacks the name of the new search-field. The insert starts from label: while it should add a new search field one level above. But, since we already have the 'map-scale' search-field, the indexing of 255 field could be added there. What do you think? -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Aleisha Amohia <aleisha@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #167647|0 |1 is obsolete| | --- Comment #8 from Aleisha Amohia <aleisha@catalyst.net.nz> --- Created attachment 185255 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=185255&action=edit Bug 36724: Add cartographic mathematical data to Elasticsearch index mappings Testing plan: 1. Start up KTD with Elasticsearch: ktd --es8 up 2. Apply the patch and restart everything (restart_all). 3. Reindex and reset mappings: koha-elasticsearch --rebuild -r -b -a kohadev 4. Go to Koha administration -> MARC bibliographic frameworks and edit the Default framework. Edit the subfields for the 255 tag. Update the visibility for 255$a & 255$b so that it is visible in the Editor. 5. Add a new record using the default framework and put a unique term in both field 255$a and 255$b. 6. Using the basic keyword search, search for the terms you put in step 7. Confirm your new record is returned in the results. Sponsored-by: Education Services Australia SCIS -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Aleisha Amohia <aleisha@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Patch complexity|--- |Small patch Assignee|danyonsewell@catalyst.net.n |aleisha@catalyst.net.nz |z | Change sponsored?|--- |Sponsored -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Aleisha Amohia <aleisha@catalyst.net.nz> changed: What |Removed |Added ---------------------------------------------------------------------------- Text to go in the| |Values in 255$a and 255$b release notes| |in MARC21 bibliographic | |records are now indexed and | |searchable in | |Elasticsearch. -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 David Nind <david@davidnind.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Needs Signoff |Signed Off -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 David Nind <david@davidnind.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #185255|0 |1 is obsolete| | --- Comment #9 from David Nind <david@davidnind.com> --- Created attachment 185435 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=185435&action=edit Bug 36724: Add cartographic mathematical data to Elasticsearch index mappings Testing plan: 1. Start up KTD with Elasticsearch: ktd --es8 up 2. Apply the patch and restart everything (restart_all). 3. Reindex and reset mappings: koha-elasticsearch --rebuild -r -b -a kohadev 4. Go to Koha administration -> MARC bibliographic frameworks and edit the Default framework. Edit the subfields for the 255 tag. Update the visibility for 255$a & 255$b so that it is visible in the Editor. 5. Add a new record using the default framework and put a unique term in both field 255$a and 255$b. 6. Using the basic keyword search, search for the terms you put in step 7. Confirm your new record is returned in the results. Sponsored-by: Education Services Australia SCIS Signed-off-by: David Nind <david@davidnind.com> -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Janusz Kaczmarek <januszop@gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.koha-community | |.org/bugzilla3/show_bug.cgi | |?id=40618 -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Nick Clemens (kidclamp) <nick@bywatersolutions.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #185435|0 |1 is obsolete| | --- Comment #10 from Nick Clemens (kidclamp) <nick@bywatersolutions.com> --- Created attachment 191514 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=191514&action=edit Bug 36724: Add cartographic mathematical data to Elasticsearch index mappings Testing plan: 1. Start up KTD with Elasticsearch: ktd --es8 up 2. Apply the patch and restart everything (restart_all). 3. Reindex and reset mappings: koha-elasticsearch --rebuild -r -b -a kohadev 4. Go to Koha administration -> MARC bibliographic frameworks and edit the Default framework. Edit the subfields for the 255 tag. Update the visibility for 255$a & 255$b so that it is visible in the Editor. 5. Add a new record using the default framework and put a unique term in both field 255$a and 255$b. 6. Using the basic keyword search, search for the terms you put in step 7. Confirm your new record is returned in the results. Sponsored-by: Education Services Australia SCIS Signed-off-by: David Nind <david@davidnind.com> Signed-off-by: Nick Clemens <nick@bywatersolutions.com> -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 --- Comment #11 from Nick Clemens (kidclamp) <nick@bywatersolutions.com> --- Created attachment 191515 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=191515&action=edit Bug 36724: (QA follow-up) Add as map scale and map projection Signed-off-by: Nick Clemens <nick@bywatersolutions.com> -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Nick Clemens (kidclamp) <nick@bywatersolutions.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |nick@bywatersolutions.com --- Comment #12 from Nick Clemens (kidclamp) <nick@bywatersolutions.com> --- I think if these are distinct data point, we should really add them as distinct indexes - if Aleisha approves I think this can go to PQA -- You are receiving this mail because: You are watching all bug changes.
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36724 Lucas Gass (lukeg) <lucas@bywatersolutions.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |lucas@bywatersolutions.com --- Comment #13 from Lucas Gass (lukeg) <lucas@bywatersolutions.com> --- (In reply to Nick Clemens (kidclamp) from comment #12)
I think if these are distinct data point, we should really add them as distinct indexes - if Aleisha approves I think this can go to PQA
Aleisha, if you can approve of Nick's follow-up I think we can move this to PQA. -- You are receiving this mail because: You are watching all bug changes.
participants (1)
-
bugzilla-daemon@bugs.koha-community.org