[go: up one dir, main page]

Menu

/ddc/trunk Commit Log


Commit Date  
[r1511] by mukau

* added new method CStringIndexator::IndexTokenFixLongColumns() for fallback repair of "greedy" tokens at indexing time
+ implicitly called by CStringIndexator::IndexOneToken() for overlong lines if new bool param tryFixErrors is true
+ tryFixErrors param is populated from CConcIndexator::m_bResumeOnIndexErrors on IndexOneToken() calls
+ truncates only "greedy" columns (those using more than MaxLen/nCols bytes)
+ truncates each "greedy" column indepdently, proportionate to its "greediness"
(the number of bytes by which its length exceeds MaxLen/nCols)
+ emits console warnings about truncation of line and each truncated column when invoked

2020-07-10 10:02:35 Tree
[r1510] by mukau

replaced various byte-length constants '4096' with DDC_STATIC_BUFLEN

2020-07-10 07:25:04 Tree
[r1509] by mukau

* Changelog tweaks

2020-07-09 14:01:59 Tree
[r1508] by mukau

v2.2.5-pre1
* fixed weird fatal "ERROR: CheckOccurrences failed! occurrences are not sorted" error for pathologically long token lines
+ v2.1.25 built a consistent index and emitted warnings, but assigned partially indexed file data to *next* corpus file
+ v2.1.26-delwin and later throw this error at end of indexing ("return-bool" -> throw/catch)
* failed document indexing now initiates a rollback of in-memory index buffers via net methods CConcIndexator::RollbackIndexOneFile(), CIndexSetForLoadingStage::RollbackLoadIndex()
+ fixes "orphaned" token data as produced by v2.1.25
* exceptions from CConcIndexator::IndexOneTableTextArea(), CConcIndexator::IndexOneFile() should now be propagated to console and to *._error_log file

2020-07-09 13:55:35 Tree
[r1500] by mukau

* ddc v2.2.4 release cleanup

2020-06-30 07:35:12 Tree
[r1493] by mukau

+ tagging v2.2.4-rc1

2020-06-29 13:05:13 Tree
[r1490] by mukau

+ query-lexer fine-tuning for negative dates (interference from fixes for mantis #19051 "6-er")

2020-06-29 13:01:57 Tree
[r1489] by mukau

* added linux kernel-style branch prediction macros likely(), unlikely()
* added index-compile-time negative-year support for CBibliography::ConvertDateToInt()
* hacked slice computation for negative years in CQCountKeyExprDateSlice::Evaluate()
+ slice labels always round *down*, even for negative slices, e.g. slice(1974/10)=1970 but slice(-1974/10)=-1980
+ without this hack, slice-label 0 would cover a 20-year interval (-10..9)

2020-06-29 11:55:48 Tree
[r1488] by mukau

+ updated scripts/{int2date,date2int}.perl for signed-year encoding

2020-06-29 10:56:03 Tree
[r1487] by mukau

+ added support for negative years in utilit.cpp date2int(), int2date()
- probably breaks date-savvy indexing & runtime code

2020-06-29 09:06:32 Tree
Older >