DWDS/Dialing Concordance Code

merged -r953:957 svn+ssh://mukau@.../p/ddc-concordance/code/ddc/branches/ddc-2.1.9+deep-hints intro trunk: generic nested navigation hints

+ v2.1.9-pre2 ready for takeoff

+ disabled debuging macros NavHint.h:DEBUG_NAVCACHE, ConcSession.h:DEBUG_HIT_TRIM

* deep-hints branch appears to be working according to spec

+ generic deep navigation hints: work in progress

* created branch ddc-2.1.1+deep-hints

+ IndexSet.cpp: throw an exception if MaxRegExpExpansionSize is exceeded (old behavior just considered first N expansions)

v2.1.9-pre1 (still with debugging code)
* navigation cache, bandwidth & memory optimizations (mantis bugs #662 and #24816)
- added ConcordDmnLib/BranchNavCache.h
+ branch-server navigation cache for high-offset result-set "paging"
+ incorporated into BranchServer, CFirstHitsQueryResult (FHResult)
+ will probably NOT help much with "slow paging" scenario (user takes nap, makes coffee, etc.)
~ idea for future improvement: send generic full-depth "hints" in server responses, accept in requests,
and let client take care of hint-passing (e.g. via JavaScript, www server session cache, etc.)
+ future improvement: send generic full-depth "hints" in server responses,
let client take care of hint-passing (e.g. via JavaScript, www server user session cache, etc.)
- added 4- and 5-argument forms for "get_first_hits" requests
+ set via branch-server navigation cache
+ used by leaf corpora for memory & bandwith optimization
+ not used by count queries
- added result-set front-trimming in CConcSession::GetHits()/3
+ track number of trimmed hits in CConcSession::m_ResultOffset
- added period-wise result-set front-trimming in CConcSession::GetAllHits()/3
+ not for count queries
+ use new CConcSession::m_ResultMinKey as a lower-bound "hint" in the presence of a non-trivial sort operator
+ added CConcSession::SortKeyLB() to backtranslate from string sort-keys to integers
+ added cruft template my_upper_bound() in CConcSession.cpp for trimming over descending sorts
- improved period-wise back-trimming in CConcSession::GetAllHits()/3
+ use new CConcSession::m_ResultOffset and maybe even m_Hits.size() if applicable
* re-worked ddcConfigNoAuto.h generation a la gfsm (safer)
* added "get_first_hits" to branch-server m_noLogCommands for log-level < debug
- should greatly reduce log verbosity for "deep" branching server-trees
* disabled DDC_COUNT_KEY_COMPAT hacks introduced for ddc v2.0.38 transition (2015-05-20)
* update EndHitNo as output parameter in CConcSession::GetAllHits
- fixes protocol bug "get_first_hits always returns HITUB=0"
- needed for correct NavCache maintainence
* added server options NavCacheSize, VersionCompat

+ key-based pre-sorting in GetAllHits() seems to be working for integer and free-bibl sorts

+ attempt to implement period-local trimming using new m_ResultMinKey : pain and anguish