]> git.evergreen-ils.org Git - working/Evergreen.git/log
working/Evergreen.git
4 years agostripdots and spacedots analyzers collab/berick/lp1844418-elastic user/berick/el-integrate-circa-3.4
Bill Erickson [Tue, 15 Oct 2019 20:10:56 +0000 (16:10 -0400)]
stripdots and spacedots analyzers

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoadd pubdate to suggested default set
Bill Erickson [Thu, 10 Oct 2019 21:29:08 +0000 (17:29 -0400)]
add pubdate to suggested default set

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoMetarecord constituants search uses ES
Bill Erickson [Thu, 10 Oct 2019 20:52:39 +0000 (16:52 -0400)]
Metarecord constituants search uses ES

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agostatic or dynamic search props based on config
Bill Erickson [Wed, 9 Oct 2019 18:57:55 +0000 (14:57 -0400)]
static or dynamic search props based on config

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agomore in-db field migration
Bill Erickson [Thu, 3 Oct 2019 15:05:29 +0000 (11:05 -0400)]
more in-db field migration

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoMove to in-db field configs
Bill Erickson [Thu, 3 Oct 2019 14:46:39 +0000 (10:46 -0400)]
Move to in-db field configs

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agomore dynamic repairs
Bill Erickson [Wed, 2 Oct 2019 19:23:21 +0000 (15:23 -0400)]
more dynamic repairs

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agocustom mapping continued; fixes
Bill Erickson [Wed, 2 Oct 2019 18:53:13 +0000 (14:53 -0400)]
custom mapping continued; fixes

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoextract metabib fields at populate time
Bill Erickson [Wed, 2 Oct 2019 18:20:45 +0000 (14:20 -0400)]
extract metabib fields at populate time

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoConsolidate bib search index builder
Bill Erickson [Wed, 2 Oct 2019 18:03:32 +0000 (14:03 -0400)]
Consolidate bib search index builder

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoIgnore inactive elastic nodes
Bill Erickson [Tue, 1 Oct 2019 18:45:31 +0000 (14:45 -0400)]
Ignore inactive elastic nodes

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoavoid indexing dupe data
Bill Erickson [Mon, 30 Sep 2019 18:17:54 +0000 (14:17 -0400)]
avoid indexing dupe data

This came up when some test records had links to multiple metarecords,
causing the data to double-up on the join to the MR table.

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agocustom mapping file repair
Bill Erickson [Fri, 27 Sep 2019 20:33:52 +0000 (16:33 -0400)]
custom mapping file repair

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoAvoid passing non-indexed fields to save disk space
Bill Erickson [Fri, 27 Sep 2019 19:44:34 +0000 (15:44 -0400)]
Avoid passing non-indexed fields to save disk space

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agosupport custom index mappings from file
Bill Erickson [Fri, 27 Sep 2019 17:14:00 +0000 (13:14 -0400)]
support custom index mappings from file

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoSupport metarecord indexing and searching
Bill Erickson [Wed, 25 Sep 2019 20:48:26 +0000 (16:48 -0400)]
Support metarecord indexing and searching

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoSupport metarecord indexing and searching
Bill Erickson [Wed, 25 Sep 2019 18:56:47 +0000 (14:56 -0400)]
Support metarecord indexing and searching

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoSupport metarecord indexing and searching
Bill Erickson [Wed, 25 Sep 2019 18:56:10 +0000 (14:56 -0400)]
Support metarecord indexing and searching

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoSupport bib record transcendance
Bill Erickson [Tue, 24 Sep 2019 15:36:43 +0000 (11:36 -0400)]
Support bib record transcendance

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoLP1840982 Replace troublesome catalog icons
Bill Erickson [Wed, 21 Aug 2019 21:18:09 +0000 (17:18 -0400)]
LP1840982 Replace troublesome catalog icons

Replace 'arrow_right' icon with 'keyboard_arrow_right' (ditto left) in
the Angular catalog holdings maintenance grid.  This resolves an issue
where the 'arrow_right' icon presents with excess padding, causing the
barcode / call number values to appear to be empty in the
'Location/Barcode' column of the holdings grid.

See also LP1830912 for icon padding issues.

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agosupport query_string queries from keyword
Bill Erickson [Fri, 20 Sep 2019 16:19:26 +0000 (12:19 -0400)]
support query_string queries from keyword

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agopkey changes continued
Bill Erickson [Thu, 19 Sep 2019 18:38:02 +0000 (14:38 -0400)]
pkey changes continued

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoindexer batch size fixes
Bill Erickson [Thu, 19 Sep 2019 17:10:23 +0000 (13:10 -0400)]
indexer batch size fixes

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoremove bib field primary key, not necessarily unique
Bill Erickson [Wed, 18 Sep 2019 21:44:56 +0000 (17:44 -0400)]
remove bib field primary key, not necessarily unique

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoprevent dynamic mapping; avoid large raw keyword values
Bill Erickson [Wed, 18 Sep 2019 21:13:09 +0000 (17:13 -0400)]
prevent dynamic mapping; avoid large raw keyword values

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoinline init() to avoid cstore startup race condition
Bill Erickson [Wed, 18 Sep 2019 19:57:13 +0000 (15:57 -0400)]
inline init() to avoid cstore startup race condition

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoimplement journal title search
Bill Erickson [Wed, 18 Sep 2019 19:25:32 +0000 (15:25 -0400)]
implement journal title search

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoGlobal flag is part of base context
Bill Erickson [Wed, 18 Sep 2019 16:13:54 +0000 (12:13 -0400)]
Global flag is part of base context

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoexact/prefix leverage new field class indexes
Bill Erickson [Wed, 18 Sep 2019 16:01:25 +0000 (12:01 -0400)]
exact/prefix leverage new field class indexes

No need to fetch the bib fields anymore, since we can use the new meta
indexes for term searches.

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoTech notes continued
Bill Erickson [Wed, 18 Sep 2019 14:36:37 +0000 (10:36 -0400)]
Tech notes continued

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoTech notes continued
Bill Erickson [Wed, 18 Sep 2019 14:33:28 +0000 (10:33 -0400)]
Tech notes continued

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoTech notes continued
Bill Erickson [Wed, 18 Sep 2019 14:30:03 +0000 (10:30 -0400)]
Tech notes continued

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoTech notes continued
Bill Erickson [Wed, 18 Sep 2019 14:19:41 +0000 (10:19 -0400)]
Tech notes continued

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoTech notes continued
Bill Erickson [Tue, 17 Sep 2019 18:56:16 +0000 (14:56 -0400)]
Tech notes continued

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoElastic integration high-level tech notes
Bill Erickson [Tue, 17 Sep 2019 18:09:12 +0000 (14:09 -0400)]
Elastic integration high-level tech notes

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoCopy location filter
Bill Erickson [Tue, 17 Sep 2019 16:20:33 +0000 (12:20 -0400)]
Copy location filter

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoskip browse entry searches
Bill Erickson [Tue, 17 Sep 2019 15:28:37 +0000 (11:28 -0400)]
skip browse entry searches

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agosearch script improvements
Bill Erickson [Mon, 16 Sep 2019 14:34:07 +0000 (10:34 -0400)]
search script improvements

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoexplicit facet field, facet repairs
Bill Erickson [Fri, 13 Sep 2019 21:18:35 +0000 (17:18 -0400)]
explicit facet field, facet repairs

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoupdate sample queries for combo fields
Bill Erickson [Fri, 13 Sep 2019 20:11:48 +0000 (16:11 -0400)]
update sample queries for combo fields

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agocreate some query_string shortcuts
Bill Erickson [Fri, 13 Sep 2019 17:21:57 +0000 (13:21 -0400)]
create some query_string shortcuts

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoleverage copy_to for grouped fields
Bill Erickson [Fri, 13 Sep 2019 17:13:30 +0000 (13:13 -0400)]
leverage copy_to for grouped fields

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agofix deprecated imports / uses
Bill Erickson [Thu, 12 Sep 2019 17:41:58 +0000 (13:41 -0400)]
fix deprecated imports / uses

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoquery string runner
Bill Erickson [Thu, 12 Sep 2019 15:37:18 +0000 (11:37 -0400)]
query string runner

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoRename; add utf8 bits
Bill Erickson [Thu, 12 Sep 2019 15:36:07 +0000 (11:36 -0400)]
Rename; add utf8 bits

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoadd more sample searches
Bill Erickson [Wed, 11 Sep 2019 21:30:31 +0000 (17:30 -0400)]
add more sample searches

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoMake text index name more precise
Bill Erickson [Wed, 11 Sep 2019 21:30:03 +0000 (17:30 -0400)]
Make text index name more precise

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoISBN variations sanity checks
Bill Erickson [Wed, 11 Sep 2019 20:32:23 +0000 (16:32 -0400)]
ISBN variations sanity checks

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoRevert "eager global ordinals on facet fields"
Bill Erickson [Wed, 11 Sep 2019 19:01:17 +0000 (15:01 -0400)]
Revert "eager global ordinals on facet fields"

This reverts commit 950f72d935218ef949b70eaee709c03551744a30.

4 years agoremove deprecated code
Bill Erickson [Wed, 11 Sep 2019 17:06:38 +0000 (13:06 -0400)]
remove deprecated code

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoremove deprecated code
Bill Erickson [Wed, 11 Sep 2019 17:02:13 +0000 (13:02 -0400)]
remove deprecated code

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoeager global ordinals on facet fields
Bill Erickson [Wed, 11 Sep 2019 16:46:00 +0000 (12:46 -0400)]
eager global ordinals on facet fields

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoboost and score sorting repairs
Bill Erickson [Wed, 11 Sep 2019 15:58:10 +0000 (11:58 -0400)]
boost and score sorting repairs

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoBetter defined node unique constraint
Bill Erickson [Wed, 11 Sep 2019 15:01:53 +0000 (11:01 -0400)]
Better defined node unique constraint

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoIdentifier searches / isbn issn normalizers
Bill Erickson [Tue, 10 Sep 2019 20:03:31 +0000 (16:03 -0400)]
Identifier searches / isbn issn normalizers

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agomisc tidying and docs
Bill Erickson [Mon, 9 Sep 2019 21:15:49 +0000 (17:15 -0400)]
misc tidying and docs

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agomore docs
Bill Erickson [Mon, 9 Sep 2019 20:39:48 +0000 (16:39 -0400)]
more docs

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agomore docs, query clensing
Bill Erickson [Mon, 9 Sep 2019 20:06:18 +0000 (16:06 -0400)]
more docs, query clensing

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agomove away from mapper to pure client
Bill Erickson [Mon, 9 Sep 2019 19:24:26 +0000 (15:24 -0400)]
move away from mapper to pure client

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoexact/prefix searches continued
Bill Erickson [Mon, 9 Sep 2019 19:01:43 +0000 (15:01 -0400)]
exact/prefix searches continued

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoelastic service continued
Bill Erickson [Mon, 9 Sep 2019 16:26:27 +0000 (12:26 -0400)]
elastic service continued

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoelastic-builder / marc search
Bill Erickson [Fri, 6 Sep 2019 22:10:45 +0000 (18:10 -0400)]
elastic-builder / marc search

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoelastic-builder in action
Bill Erickson [Fri, 6 Sep 2019 20:36:38 +0000 (16:36 -0400)]
elastic-builder in action

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoelastic bib field IDL class mod
Bill Erickson [Fri, 6 Sep 2019 18:43:49 +0000 (14:43 -0400)]
elastic bib field IDL class mod

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agomore catalog integration experiements / elastic-builder
Bill Erickson [Fri, 6 Sep 2019 14:37:38 +0000 (10:37 -0400)]
more catalog integration experiements / elastic-builder

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agotighter catalog integration WIP
Bill Erickson [Tue, 3 Sep 2019 21:29:42 +0000 (17:29 -0400)]
tighter catalog integration WIP

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agotighter catalog integration WIP
Bill Erickson [Tue, 3 Sep 2019 19:24:05 +0000 (15:24 -0400)]
tighter catalog integration WIP

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoinitial tighter catalog integration / cat side needs more data
Bill Erickson [Fri, 30 Aug 2019 16:26:04 +0000 (12:26 -0400)]
initial tighter catalog integration / cat side needs more data

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoadd label to bib_fields list
Bill Erickson [Fri, 6 Sep 2019 14:41:29 +0000 (10:41 -0400)]
add label to bib_fields list

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoadditional index tidying
Bill Erickson [Fri, 6 Sep 2019 14:35:40 +0000 (10:35 -0400)]
additional index tidying

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoadditional index tidying
Bill Erickson [Thu, 5 Sep 2019 19:59:18 +0000 (15:59 -0400)]
additional index tidying

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoinitial support multiple lang analyzers; multi_match queries
Bill Erickson [Thu, 5 Sep 2019 16:42:18 +0000 (12:42 -0400)]
initial support multiple lang analyzers; multi_match queries

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoUpdated example search in test script
Bill Erickson [Thu, 5 Sep 2019 15:52:47 +0000 (11:52 -0400)]
Updated example search in test script

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoadd marc data to bib search index
Bill Erickson [Tue, 3 Sep 2019 21:33:19 +0000 (17:33 -0400)]
add marc data to bib search index

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoConsolidate some indexing code
Bill Erickson [Fri, 30 Aug 2019 21:08:31 +0000 (17:08 -0400)]
Consolidate some indexing code

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agobib marc record index / searching
Bill Erickson [Wed, 28 Aug 2019 21:41:39 +0000 (17:41 -0400)]
bib marc record index / searching

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agobib marc record index / searching
Bill Erickson [Wed, 28 Aug 2019 16:16:17 +0000 (12:16 -0400)]
bib marc record index / searching

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agobib marc record index
Bill Erickson [Tue, 27 Aug 2019 21:50:47 +0000 (17:50 -0400)]
bib marc record index

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agosupport es proxied path; indexes one at a time
Bill Erickson [Thu, 18 Jul 2019 19:20:13 +0000 (15:20 -0400)]
support es proxied path; indexes one at a time

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agodata sync continued / _id fix
Bill Erickson [Tue, 9 Jul 2019 14:31:04 +0000 (10:31 -0400)]
data sync continued / _id fix

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoworking on data sync
Bill Erickson [Mon, 8 Jul 2019 22:12:16 +0000 (18:12 -0400)]
working on data sync

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agodisabled marc indexer experiment
Bill Erickson [Mon, 8 Jul 2019 14:46:20 +0000 (10:46 -0400)]
disabled marc indexer experiment

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoRemove some TODO comments: done
Bill Erickson [Tue, 2 Jul 2019 20:51:13 +0000 (16:51 -0400)]
Remove some TODO comments: done

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoEL sample config superseded by per-index definitions
Bill Erickson [Fri, 31 May 2019 18:51:50 +0000 (14:51 -0400)]
EL sample config superseded by per-index definitions

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoforce-on ang7 cat for now
Bill Erickson [Tue, 12 Feb 2019 17:40:30 +0000 (17:40 +0000)]
force-on ang7 cat for now

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoAvoid huge index values
Bill Erickson [Tue, 12 Feb 2019 17:02:36 +0000 (17:02 +0000)]
Avoid huge index values

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoLog first/last bib ID of each indexed batch
Bill Erickson [Mon, 11 Feb 2019 19:05:01 +0000 (14:05 -0500)]
Log first/last bib ID of each indexed batch

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoIndexer orders by ID for batch consistency
Bill Erickson [Mon, 11 Feb 2019 17:11:10 +0000 (12:11 -0500)]
Indexer orders by ID for batch consistency

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoindexer start-date support
Bill Erickson [Tue, 6 Nov 2018 15:52:59 +0000 (10:52 -0500)]
indexer start-date support

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoES gets child init
Bill Erickson [Tue, 6 Nov 2018 15:20:02 +0000 (10:20 -0500)]
ES gets child init

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agocopy loc/stat filters
Bill Erickson [Tue, 6 Nov 2018 02:21:50 +0000 (21:21 -0500)]
copy loc/stat filters

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agocopy loc/stat filters wip
Bill Erickson [Mon, 5 Nov 2018 22:21:09 +0000 (17:21 -0500)]
copy loc/stat filters wip

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoGroup searches OR-based; lower kw normalizer
Bill Erickson [Fri, 2 Nov 2018 20:56:37 +0000 (16:56 -0400)]
Group searches OR-based; lower kw normalizer

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoQP comp continued
Bill Erickson [Fri, 2 Nov 2018 18:48:55 +0000 (14:48 -0400)]
QP comp continued

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoang6 catalog use correct search_format filter
Bill Erickson [Wed, 31 Oct 2018 21:34:07 +0000 (17:34 -0400)]
ang6 catalog use correct search_format filter

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agoQP based query compilation
Bill Erickson [Wed, 31 Oct 2018 21:30:43 +0000 (17:30 -0400)]
QP based query compilation

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agosearch_format filter; logging
Bill Erickson [Tue, 30 Oct 2018 15:07:04 +0000 (11:07 -0400)]
search_format filter; logging

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agofacets continued
Bill Erickson [Tue, 30 Oct 2018 14:51:46 +0000 (10:51 -0400)]
facets continued

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agobib search api wip
Bill Erickson [Mon, 29 Oct 2018 22:17:01 +0000 (18:17 -0400)]
bib search api wip

Signed-off-by: Bill Erickson <berickxx@gmail.com>
4 years agobib search api wip
Bill Erickson [Mon, 29 Oct 2018 22:02:32 +0000 (18:02 -0400)]
bib search api wip

Signed-off-by: Bill Erickson <berickxx@gmail.com>