Bill Erickson [Wed, 6 Jul 2011 19:21:58 +0000 (15:21 -0400)]
Vandelay matching, quality, error reporting, and queue export additions
* Configuration of direct MARC field comparisons of incoming record to existing records
* Support for nested boolean MARC comparison expressions: e.g. 100a and (020a or 024a)
* Support for field-level match scores to create an overall per-record match score
* Support for best match merge/overlay
* Support for field-level quality metrics to determine overall record quality
* Support for enforcing a minimum quality ratio on import to prevent import of lower quality records
* Support for capturing and reporting record and item import failures.
* Support for exporting record queues and items as print, CSV, and email
* Various small display fixes and cleanup
Signed-off-by: Bill Erickson <berick@esilibrary.com>
Bill Erickson [Tue, 31 May 2011 16:16:16 +0000 (12:16 -0400)]
Repaired typo on schema and upgrade SQL
ARRAY_ACUM is not a defined function. Per Dan Scott, replaced with
ARRAY_AGG instead of the correctly spelled ARRAY_ACCUM, since we'll be
using that function in place of ARRAY_ACCUM going forward.
Thanks, Dan.
Minor syntax/cleanup repairs
Remove tmp seed data file. T'was replaced with upgrade script
Signed-off-by: Bill Erickson <berick@esilibrary.com>
berick [Thu, 19 May 2011 19:40:30 +0000 (15:40 -0400)]
Flexible TCN match configuration
If users do not want records with duplicate TCN values imported, users
should rely on match-sets to enforce this policy instead of a hard-coded
duplicate tcn block. This is done by automatically calling the 'override'
version of bib XML import. The only tcn-related failure that can now
occur is if no free, non-dupe TCN value can be extracted from the record.
berick [Thu, 19 May 2011 19:26:49 +0000 (15:26 -0400)]
Vandelay import improvements / bug fixes
* Allow for quality ratio control during import-on-1match
* Allow for 901c matching when no match-set is selected
* Tidy up some display strings
* Numerous small bug fixes
Jason Etheridge [Fri, 13 May 2011 01:42:43 +0000 (21:42 -0400)]
change the group field for these templates, though they weren't breaking anything before (these are called with fire_object_event and instead of create_events_for_hook, if that makes a difference)
Jason Etheridge [Fri, 13 May 2011 01:38:54 +0000 (21:38 -0400)]
templates for exporting authority queues, but needs testing. blockers here include importing authority records being broken, and possibly selection of an authority queue to inspect being broken
Jason Etheridge [Tue, 10 May 2011 04:29:56 +0000 (00:29 -0400)]
wire in the event firing, though we still need the templates. Put streaming back in for the print/csv/email export methods, since we can respond_complete for email and it to doesn't hurt the other two.
Jason Etheridge [Tue, 10 May 2011 03:50:31 +0000 (23:50 -0400)]
register the methods we're expecting for the print/csv/email exports in Vandelay, and remove limit/offset options for such methods, and expectation of streaming
berick [Thu, 5 May 2011 17:21:56 +0000 (13:21 -0400)]
expose new import options to queue interface importer dialog; mucho import bug fixes in the middle layer code; expose queued rec quality in matches interface
berick [Wed, 4 May 2011 21:15:03 +0000 (17:15 -0400)]
Best Match w/ quality ratio merging
* Mew Best Match option in merge/overlay
* support for upload time minimum record quality ratio
* We now /only/ create new records if no matches exist and the user
selected a match-free import
* Selecting a match-free import no longer trumps other merge imports.
They both work together now.
TODO: find out why queued record quality is not getting set at queued
rec creation time.
Mike Rylander [Wed, 4 May 2011 00:23:57 +0000 (20:23 -0400)]
Clean up uses of vandelay.incoming_record_quality to provide all required params; Remove matched_set on matches, just look at the match_set for the queue of the vandelay record in question
berick [Mon, 2 May 2011 16:52:30 +0000 (12:52 -0400)]
Vandelay file upload page cleanup
* Separate data configuration parameters from import actions
* Since import item profile is linked to queue, show the profile for
the selected queue and dissallow changing the profile for existing
queues in the UI (which has no effect)
added new stub actions for limit-to-import-errors and show all item import errors; displaying new summary info; much rearrangement to bettet fit the UI pieces
Mike Rylander [Fri, 22 Apr 2011 16:55:37 +0000 (12:55 -0400)]
Secondary sort by quality ratio (higher means incoming is more "good" than existing) instead of simple incoming quality, which is a no-op (all the same)