]>
git.evergreen-ils.org Git - working/Evergreen.git/log
Bill Erickson [Wed, 5 Feb 2020 17:23:02 +0000 (12:23 -0500)]
LP1844418 Move isbn/issn extraction to Normilize mod
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Mon, 3 Feb 2020 22:42:39 +0000 (17:42 -0500)]
LP1844418 Support index activation
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Mon, 3 Feb 2020 22:12:44 +0000 (17:12 -0500)]
LP1844418 Decouple index class from index name
Allow for the creation of multiple indices for a given index class so
the user can toggle between them, e.g. to switch to newly built index.
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 17 Jan 2020 21:33:37 +0000 (16:33 -0500)]
LP1844418 Field highlight examples in EL test script
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 30 Oct 2019 22:10:23 +0000 (18:10 -0400)]
LP1844418 Elastic Z39.50 support
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 30 Oct 2019 21:06:27 +0000 (17:06 -0400)]
LP1844418 Tech note about enabling ES via new flag
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 23 Oct 2019 15:37:40 +0000 (11:37 -0400)]
LP1849523 Angular catalog split record batches
The result page of the Angular catalog now fetches the record info in 2
batches. The first batch is relatively small (currently 5 records) and
allows the results page to start rendering results earlier in the
display process. The second batch of records, which includes all the
rest of the results, then drops in as they arrive.
Note the first batch of records will be the first 5 results from the
search so the second batch of results can simply be appended and avoid
page shuffling.
Includes thinko fix for batched holds retrieval.
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 22 Oct 2019 15:31:14 +0000 (11:31 -0400)]
LP1849523 Ang cat holds batch retrieval
Angular catalog leverages the new batch versions of the bib / metabib
hold counts API to reduce the number of API calls needed per results
page.
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 22 Oct 2019 14:33:27 +0000 (10:33 -0400)]
LP1849523 Batch hold count streaming API
Provides a batch, streaming version of:
open-ils.circ.bre.holds.count.batch
open-ils.circ.mmr.holds.count.batch
Response include the record ID and the count per record.
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 23 Oct 2019 13:31:53 +0000 (09:31 -0400)]
LP1844418 Global flag to enable ES for bib-search
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 15 Oct 2019 20:10:56 +0000 (16:10 -0400)]
stripdots and spacedots analyzers
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Thu, 10 Oct 2019 21:29:08 +0000 (17:29 -0400)]
add pubdate to suggested default set
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Thu, 10 Oct 2019 20:52:39 +0000 (16:52 -0400)]
Metarecord constituants search uses ES
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 9 Oct 2019 18:57:55 +0000 (14:57 -0400)]
static or dynamic search props based on config
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Thu, 3 Oct 2019 15:05:29 +0000 (11:05 -0400)]
more in-db field migration
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Thu, 3 Oct 2019 14:46:39 +0000 (10:46 -0400)]
Move to in-db field configs
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 2 Oct 2019 19:23:21 +0000 (15:23 -0400)]
more dynamic repairs
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 2 Oct 2019 18:53:13 +0000 (14:53 -0400)]
custom mapping continued; fixes
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 2 Oct 2019 18:20:45 +0000 (14:20 -0400)]
extract metabib fields at populate time
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 2 Oct 2019 18:03:32 +0000 (14:03 -0400)]
Consolidate bib search index builder
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 1 Oct 2019 18:45:31 +0000 (14:45 -0400)]
Ignore inactive elastic nodes
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Mon, 30 Sep 2019 18:17:54 +0000 (14:17 -0400)]
avoid indexing dupe data
This came up when some test records had links to multiple metarecords,
causing the data to double-up on the join to the MR table.
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 27 Sep 2019 20:33:52 +0000 (16:33 -0400)]
custom mapping file repair
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 27 Sep 2019 19:44:34 +0000 (15:44 -0400)]
Avoid passing non-indexed fields to save disk space
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 27 Sep 2019 17:14:00 +0000 (13:14 -0400)]
support custom index mappings from file
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 25 Sep 2019 20:48:26 +0000 (16:48 -0400)]
Support metarecord indexing and searching
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 25 Sep 2019 18:56:47 +0000 (14:56 -0400)]
Support metarecord indexing and searching
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 25 Sep 2019 18:56:10 +0000 (14:56 -0400)]
Support metarecord indexing and searching
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 24 Sep 2019 15:36:43 +0000 (11:36 -0400)]
Support bib record transcendance
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 20 Sep 2019 16:19:26 +0000 (12:19 -0400)]
support query_string queries from keyword
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Thu, 19 Sep 2019 18:38:02 +0000 (14:38 -0400)]
pkey changes continued
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Thu, 19 Sep 2019 17:10:23 +0000 (13:10 -0400)]
indexer batch size fixes
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 18 Sep 2019 21:44:56 +0000 (17:44 -0400)]
remove bib field primary key, not necessarily unique
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 18 Sep 2019 21:13:09 +0000 (17:13 -0400)]
prevent dynamic mapping; avoid large raw keyword values
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 18 Sep 2019 19:57:13 +0000 (15:57 -0400)]
inline init() to avoid cstore startup race condition
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 18 Sep 2019 19:25:32 +0000 (15:25 -0400)]
implement journal title search
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 18 Sep 2019 16:13:54 +0000 (12:13 -0400)]
Global flag is part of base context
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 18 Sep 2019 16:01:25 +0000 (12:01 -0400)]
exact/prefix leverage new field class indexes
No need to fetch the bib fields anymore, since we can use the new meta
indexes for term searches.
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 18 Sep 2019 14:36:37 +0000 (10:36 -0400)]
Tech notes continued
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 18 Sep 2019 14:33:28 +0000 (10:33 -0400)]
Tech notes continued
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 18 Sep 2019 14:30:03 +0000 (10:30 -0400)]
Tech notes continued
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 18 Sep 2019 14:19:41 +0000 (10:19 -0400)]
Tech notes continued
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 17 Sep 2019 18:56:16 +0000 (14:56 -0400)]
Tech notes continued
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 17 Sep 2019 18:09:12 +0000 (14:09 -0400)]
Elastic integration high-level tech notes
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 17 Sep 2019 16:20:33 +0000 (12:20 -0400)]
Copy location filter
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 17 Sep 2019 15:28:37 +0000 (11:28 -0400)]
skip browse entry searches
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Mon, 16 Sep 2019 14:34:07 +0000 (10:34 -0400)]
search script improvements
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 13 Sep 2019 21:18:35 +0000 (17:18 -0400)]
explicit facet field, facet repairs
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 13 Sep 2019 20:11:48 +0000 (16:11 -0400)]
update sample queries for combo fields
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 13 Sep 2019 17:21:57 +0000 (13:21 -0400)]
create some query_string shortcuts
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 13 Sep 2019 17:13:30 +0000 (13:13 -0400)]
leverage copy_to for grouped fields
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Thu, 12 Sep 2019 17:41:58 +0000 (13:41 -0400)]
fix deprecated imports / uses
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Thu, 12 Sep 2019 15:37:18 +0000 (11:37 -0400)]
query string runner
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Thu, 12 Sep 2019 15:36:07 +0000 (11:36 -0400)]
Rename; add utf8 bits
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 11 Sep 2019 21:30:31 +0000 (17:30 -0400)]
add more sample searches
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 11 Sep 2019 21:30:03 +0000 (17:30 -0400)]
Make text index name more precise
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 11 Sep 2019 20:32:23 +0000 (16:32 -0400)]
ISBN variations sanity checks
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 11 Sep 2019 19:01:17 +0000 (15:01 -0400)]
Revert "eager global ordinals on facet fields"
This reverts commit
950f72d935218ef949b70eaee709c03551744a30 .
Bill Erickson [Wed, 11 Sep 2019 17:06:38 +0000 (13:06 -0400)]
remove deprecated code
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 11 Sep 2019 17:02:13 +0000 (13:02 -0400)]
remove deprecated code
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 11 Sep 2019 16:46:00 +0000 (12:46 -0400)]
eager global ordinals on facet fields
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 11 Sep 2019 15:58:10 +0000 (11:58 -0400)]
boost and score sorting repairs
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 11 Sep 2019 15:01:53 +0000 (11:01 -0400)]
Better defined node unique constraint
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 10 Sep 2019 20:03:31 +0000 (16:03 -0400)]
Identifier searches / isbn issn normalizers
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Mon, 9 Sep 2019 21:15:49 +0000 (17:15 -0400)]
misc tidying and docs
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Mon, 9 Sep 2019 20:39:48 +0000 (16:39 -0400)]
more docs
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Mon, 9 Sep 2019 20:06:18 +0000 (16:06 -0400)]
more docs, query clensing
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Mon, 9 Sep 2019 19:24:26 +0000 (15:24 -0400)]
move away from mapper to pure client
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Mon, 9 Sep 2019 19:01:43 +0000 (15:01 -0400)]
exact/prefix searches continued
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Mon, 9 Sep 2019 16:26:27 +0000 (12:26 -0400)]
elastic service continued
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 6 Sep 2019 22:10:45 +0000 (18:10 -0400)]
elastic-builder / marc search
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 6 Sep 2019 20:36:38 +0000 (16:36 -0400)]
elastic-builder in action
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 6 Sep 2019 18:43:49 +0000 (14:43 -0400)]
elastic bib field IDL class mod
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 6 Sep 2019 14:37:38 +0000 (10:37 -0400)]
more catalog integration experiements / elastic-builder
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 3 Sep 2019 21:29:42 +0000 (17:29 -0400)]
tighter catalog integration WIP
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 3 Sep 2019 19:24:05 +0000 (15:24 -0400)]
tighter catalog integration WIP
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 30 Aug 2019 16:26:04 +0000 (12:26 -0400)]
initial tighter catalog integration / cat side needs more data
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 6 Sep 2019 14:41:29 +0000 (10:41 -0400)]
add label to bib_fields list
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 6 Sep 2019 14:35:40 +0000 (10:35 -0400)]
additional index tidying
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Thu, 5 Sep 2019 19:59:18 +0000 (15:59 -0400)]
additional index tidying
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Thu, 5 Sep 2019 16:42:18 +0000 (12:42 -0400)]
initial support multiple lang analyzers; multi_match queries
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Thu, 5 Sep 2019 15:52:47 +0000 (11:52 -0400)]
Updated example search in test script
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 3 Sep 2019 21:33:19 +0000 (17:33 -0400)]
add marc data to bib search index
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 30 Aug 2019 21:08:31 +0000 (17:08 -0400)]
Consolidate some indexing code
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 28 Aug 2019 21:41:39 +0000 (17:41 -0400)]
bib marc record index / searching
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Wed, 28 Aug 2019 16:16:17 +0000 (12:16 -0400)]
bib marc record index / searching
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 27 Aug 2019 21:50:47 +0000 (17:50 -0400)]
bib marc record index
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Thu, 18 Jul 2019 19:20:13 +0000 (15:20 -0400)]
support es proxied path; indexes one at a time
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 9 Jul 2019 14:31:04 +0000 (10:31 -0400)]
data sync continued / _id fix
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Mon, 8 Jul 2019 22:12:16 +0000 (18:12 -0400)]
working on data sync
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Mon, 8 Jul 2019 14:46:20 +0000 (10:46 -0400)]
disabled marc indexer experiment
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 2 Jul 2019 20:51:13 +0000 (16:51 -0400)]
Remove some TODO comments: done
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Fri, 31 May 2019 18:51:50 +0000 (14:51 -0400)]
EL sample config superseded by per-index definitions
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 12 Feb 2019 17:40:30 +0000 (17:40 +0000)]
force-on ang7 cat for now
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 12 Feb 2019 17:02:36 +0000 (17:02 +0000)]
Avoid huge index values
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Mon, 11 Feb 2019 19:05:01 +0000 (14:05 -0500)]
Log first/last bib ID of each indexed batch
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Mon, 11 Feb 2019 17:11:10 +0000 (12:11 -0500)]
Indexer orders by ID for batch consistency
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 6 Nov 2018 15:52:59 +0000 (10:52 -0500)]
indexer start-date support
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 6 Nov 2018 15:20:02 +0000 (10:20 -0500)]
ES gets child init
Signed-off-by: Bill Erickson <berickxx@gmail.com>
Bill Erickson [Tue, 6 Nov 2018 02:21:50 +0000 (21:21 -0500)]
copy loc/stat filters
Signed-off-by: Bill Erickson <berickxx@gmail.com>