DWDS/Dialing Concordance Code

+ re-worked near/2 in preparation for real generalization to near/3 (mantis #646)

+ documented DefaultQueryIndex

v2.0.20-pre4 Tue, 18 Mar 2014 12:32:54 +0100 moocow
+ added *.opt options LemmaQueryUsesMorphPattern, DefaultQueryIndex
+ added parsing of boolean values for *.opt options to CConcIndexator::LoadOptionsFromString()
- this means we can finally override pre-specified boolean flags
+ added CConcIndexator::m_OpDefaultIndexNames : operator-specific default index names
- potentially useful to discriminate between _ (bareword TokInfl queries) vs. @_ (literal match) and /_/ (regex, globs)
- idea: map _ to Lemma, set default expander Lemma to some (CAB-based) external best-lemmatizer,
and avoid the traffic, computational load, and loss of both precision and recall associated with
the current all-inflected-forms strategy of CQTokInfl
+ cleaned up some lingering bigrams-index crud

+ improved default-offset selection for #left/#right/#context
- use NOINT (=INT_MIN) as missing-input indicator instead of 0

+ improved context-anchor selection for #left/#right/#context
- better solution might be to allow user specification of anchor-occurrence offset

+ updated Changes

+ fix sort-key selection for #left/#right on multi-token hits
- WAS: sort-key was always relative to 1st token in a multi-token hit (e.g. phrase)
- NOW: sort-key anchor depends on context-offset distance
~ anchor is 1st matching token of hit for #left and #by_context[0]
~ anchor is last matching token of hit for #right and #by_context[N>0]

+ use stable_sort() for subcorpus-local hit-sorting in ConcHolder.cpp
- attempt to fix goofy right-to-left return order within a single sentence under #separate_hits

* yyQParser cleanup

+ fixed subcorpus-crash bug caused by perl-style \x{...} escapes in escapeJsonString() [mantis #650]