cunei-commits Mailing List for Cunei Machine Translation Platform
Status: Beta
Brought to you by:
aaronbphillips
Menu
▾
▴
cunei-commits — Notification of commits to the Subversion repository
You can subscribe to this list here.
| 2009 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
(96) |
Jul
(161) |
Aug
(12) |
Sep
(18) |
Oct
(17) |
Nov
(6) |
Dec
(8) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2010 |
Jan
(28) |
Feb
(18) |
Mar
(26) |
Apr
(37) |
May
(37) |
Jun
(10) |
Jul
(5) |
Aug
(41) |
Sep
(11) |
Oct
(32) |
Nov
(30) |
Dec
(28) |
| 2011 |
Jan
(29) |
Feb
(16) |
Mar
(23) |
Apr
(40) |
May
(15) |
Jun
(14) |
Jul
(24) |
Aug
(7) |
Sep
(16) |
Oct
(4) |
Nov
(12) |
Dec
|
| 2012 |
Jan
|
Feb
(4) |
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
| S | M | T | W | T | F | S |
|---|---|---|---|---|---|---|
|
|
|
|
1
|
2
|
3
|
4
|
|
5
|
6
|
7
(2) |
8
|
9
|
10
|
11
|
|
12
|
13
(1) |
14
(2) |
15
(1) |
16
(2) |
17
(1) |
18
(1) |
|
19
|
20
|
21
|
22
|
23
(1) |
24
|
25
|
|
26
|
27
(1) |
28
|
29
(2) |
30
|
|
|
|
From: <aar...@us...> - 2011-06-29 22:09:31
|
Revision: 759
http://cunei.svn.sourceforge.net/cunei/?rev=759&view=rev
Author: aaronbphillips
Date: 2011-06-29 22:09:25 +0000 (Wed, 29 Jun 2011)
Log Message:
-----------
More speed improvements when handling multiple sequence types. The largest bottleneck is now the FrequencyModel which can be quite slow when a translation includes a gap.
Modified Paths:
--------------
src/cunei/alignment/ChunkAlignment.java
src/cunei/alignment/PhraseAlignment.java
src/cunei/alignment/SubPhraseAlignment.java
src/cunei/corpus/MultilingualCorpus.java
src/cunei/translate/Match.java
src/cunei/translate/MatchLattice.java
src/cunei/translate/TranslationLattice.java
This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.
|
|
From: <aar...@us...> - 2011-06-29 03:37:15
|
Revision: 758
http://cunei.svn.sourceforge.net/cunei/?rev=758&view=rev
Author: aaronbphillips
Date: 2011-06-29 03:37:09 +0000 (Wed, 29 Jun 2011)
Log Message:
-----------
Updated handling of multiple sequence types
Modified Paths:
--------------
src/cunei/alignment/AlignmentIndex.java
src/cunei/translate/CoverageModel.java
src/cunei/translate/Match.java
src/cunei/translate/MatchLattice.java
src/cunei/translate/SimilarityModel.java
src/cunei/translate/TypeModel.java
This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.
|
|
From: <aar...@us...> - 2011-06-27 17:19:13
|
Revision: 757
http://cunei.svn.sourceforge.net/cunei/?rev=757&view=rev
Author: aaronbphillips
Date: 2011-06-27 17:19:07 +0000 (Mon, 27 Jun 2011)
Log Message:
-----------
Better error checking for command arguments
Modified Paths:
--------------
src/cunei/config/CommandArguments.java
src/cunei/config/ValueOfParameter.java
This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.
|
|
From: <aar...@us...> - 2011-06-23 19:26:44
|
Revision: 756
http://cunei.svn.sourceforge.net/cunei/?rev=756&view=rev
Author: aaronbphillips
Date: 2011-06-23 19:26:37 +0000 (Thu, 23 Jun 2011)
Log Message:
-----------
Simplified how multiple sequences and annotations could be specified on the command line. Added new LanguagePair class. The pipeline should now properly handle more than two languages, but this capability is not currently used.
Modified Paths:
--------------
src/cunei/cli/ARPALanguageModel.java
src/cunei/cli/CommandLineInterface.java
src/cunei/cli/Decode.java
src/cunei/cli/EstimateLexiconAlignment.java
src/cunei/cli/EstimateSentenceRatios.java
src/cunei/cli/Evaluate.java
src/cunei/cli/Frequencies.java
src/cunei/cli/IndexCorpus.java
src/cunei/cli/IndexLanguageModel.java
src/cunei/cli/IndexLexicon.java
src/cunei/cli/IndexMonolingualCorpus.java
src/cunei/cli/MultiFileArguments.java
src/cunei/cli/Optimize.java
src/cunei/cli/ProcessConfusion.java
src/cunei/cli/ProcessCorpus.java
src/cunei/cli/ProcessDocument.java
src/cunei/cli/ScoreLanguageModel.java
src/cunei/cli/Synonyms.java
src/cunei/cli/Translate.java
src/cunei/cli/Unknown.java
src/cunei/config/ClassListParameter.java
src/cunei/config/CollectionParameter.java
src/cunei/config/CommandArguments.java
src/cunei/config/FileListParameter.java
src/cunei/config/StringListParameter.java
src/cunei/config/StringSetParameter.java
src/cunei/confusion/CorpusAnnotator.java
src/cunei/confusion/InputReaders.java
src/cunei/confusion/XMLConfusionWriter.java
src/cunei/confusion/XMLInputReader.java
src/cunei/corpus/CorpusReader.java
src/cunei/corpus/CorpusReaders.java
src/cunei/corpus/CorpusWriter.java
src/cunei/corpus/CorpusWriters.java
src/cunei/corpus/IndexCorpusReader.java
src/cunei/corpus/Languages.java
src/cunei/corpus/MosesPhraseTableReader.java
src/cunei/corpus/MultiFileCorpus.java
src/cunei/corpus/MultiFileCorpusReader.java
src/cunei/corpus/MultiFileCorpusWriter.java
src/cunei/corpus/MultilingualCorpus.java
src/cunei/corpus/PanliteCorpusReader.java
src/cunei/corpus/PanliteCorpusWriter.java
src/cunei/corpus/SampledCorpusReader.java
src/cunei/decode/DecoderWriter.java
src/cunei/document/MultiFile.java
src/cunei/document/MultiFileDocument.java
src/cunei/document/MultiFileDocumentReader.java
src/cunei/document/NISTDocumentReader.java
src/cunei/document/SimpleDocumentReader.java
src/cunei/document/SimpleDocumentWriter.java
src/cunei/evaluation/TranslateAndDecodeEvaluator.java
src/cunei/lexicon/LexiconSerializer.java
src/cunei/lexicon/Lexicons.java
src/cunei/processors/DuplicateEliminator.java
src/cunei/processors/LengthRatioEliminator.java
src/cunei/translate/FrequencyModel.java
src/cunei/translate/Match.java
src/cunei/translate/TranslationLattice.java
src/cunei/translate/Translator.java
src/cunei/type/TypesOfTypes.java
src/cunei/ui/SentencesPanel.java
src/cunei/ui/Workbench.java
src/cunei/ui/WorkbenchWindow.java
Added Paths:
-----------
src/cunei/cli/MultiFileCorpusArguments.java
src/cunei/cli/MultiFileDocumentArguments.java
src/cunei/corpus/LanguagePair.java
src/cunei/corpus/LanguagePairs.java
src/cunei/corpus/MultiSentence.java
src/cunei/processors/LanguageProcessor.java
src/cunei/processors/MultiSentenceProcessor.java
src/cunei/processors/Processor.java
src/cunei/processors/Processors.java
Removed Paths:
-------------
src/cunei/corpus/SentencePair.java
src/cunei/processors/BilingualProcessor.java
src/cunei/processors/Mode.java
src/cunei/processors/Processor.java
src/cunei/processors/ReverseSourceNumbers.java
src/cunei/processors/SentencePairProcessor.java
This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.
|
|
From: <aar...@us...> - 2011-06-18 00:58:55
|
Revision: 755
http://cunei.svn.sourceforge.net/cunei/?rev=755&view=rev
Author: aaronbphillips
Date: 2011-06-18 00:58:49 +0000 (Sat, 18 Jun 2011)
Log Message:
-----------
Divide n-gram f1 scores by n
Modified Paths:
--------------
src/cunei/translate/SimilarityModel.java
This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.
|
|
From: <aar...@us...> - 2011-06-17 15:34:55
|
Revision: 754
http://cunei.svn.sourceforge.net/cunei/?rev=754&view=rev
Author: aaronbphillips
Date: 2011-06-17 15:34:48 +0000 (Fri, 17 Jun 2011)
Log Message:
-----------
Changed default scaling factor in ReferenceMatcher as the log scores were causing underflow on very long sentences
Modified Paths:
--------------
src/cunei/hypothesis/ReferenceMatcher.java
This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.
|
|
From: <aar...@us...> - 2011-06-16 21:05:29
|
Revision: 753
http://cunei.svn.sourceforge.net/cunei/?rev=753&view=rev
Author: aaronbphillips
Date: 2011-06-16 21:05:23 +0000 (Thu, 16 Jun 2011)
Log Message:
-----------
Several tweaks in decoding that should speed things up slightly. Added more features to SimilarityModel.
Modified Paths:
--------------
src/cunei/decode/Decoder.java
src/cunei/hypothesis/Derivation.java
src/cunei/hypothesis/ReferenceMatcher.java
src/cunei/translate/CoverageModel.java
src/cunei/translate/SimilarityModel.java
src/cunei/translate/TranslationLattice.java
src/cunei/type/TypeSequence.java
This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.
|
|
From: <aar...@us...> - 2011-06-16 03:49:29
|
Revision: 752
http://cunei.svn.sourceforge.net/cunei/?rev=752&view=rev
Author: aaronbphillips
Date: 2011-06-16 03:49:23 +0000 (Thu, 16 Jun 2011)
Log Message:
-----------
Reference similarity shares the same code as target similarity. The target similarity computation should be faster as well.
Modified Paths:
--------------
src/cunei/decode/Decoder.java
src/cunei/hypothesis/Derivation.java
src/cunei/hypothesis/ReferenceMatcher.java
src/cunei/translate/SimilarityModel.java
src/cunei/translate/TranslationLattice.java
This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.
|
|
From: <aar...@us...> - 2011-06-15 19:12:47
|
Revision: 751
http://cunei.svn.sourceforge.net/cunei/?rev=751&view=rev
Author: aaronbphillips
Date: 2011-06-15 19:12:41 +0000 (Wed, 15 Jun 2011)
Log Message:
-----------
Added length ratio to similarity model
Modified Paths:
--------------
src/cunei/hypothesis/ReferenceMatcher.java
src/cunei/translate/TranslationLattice.java
Added Paths:
-----------
src/cunei/translate/SimilarityModel.java
Removed Paths:
-------------
src/cunei/translate/PhraseNgramModel.java
This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.
|
|
From: <aar...@us...> - 2011-06-14 18:20:57
|
Revision: 750
http://cunei.svn.sourceforge.net/cunei/?rev=750&view=rev
Author: aaronbphillips
Date: 2011-06-14 18:20:51 +0000 (Tue, 14 Jun 2011)
Log Message:
-----------
Fixed bug where LogLinearModel.set() failed to update the score
Modified Paths:
--------------
src/cunei/model/LogLinearModel.java
This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.
|
|
From: <aar...@us...> - 2011-06-14 17:24:14
|
Revision: 749
http://cunei.svn.sourceforge.net/cunei/?rev=749&view=rev
Author: aaronbphillips
Date: 2011-06-14 17:24:08 +0000 (Tue, 14 Jun 2011)
Log Message:
-----------
Updated target-side similarity scoring and added a few additional speed improvements. The translation scores changed slightly and this will require further investigation (they should not have changed).
Modified Paths:
--------------
src/cunei/collections/ScoredSet.java
src/cunei/decode/Decoder.java
src/cunei/document/SimpleDocumentReader.java
src/cunei/lm/BackoffLanguageModelTrie.java
src/cunei/model/LogLinearModel.java
src/cunei/model/SumLogLinearModel.java
src/cunei/translate/MatchLattice.java
src/cunei/translate/TranslationLattice.java
src/cunei/ui/LatticePanel.java
This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.
|
|
From: <aar...@us...> - 2011-06-13 17:40:56
|
Revision: 748
http://cunei.svn.sourceforge.net/cunei/?rev=748&view=rev
Author: aaronbphillips
Date: 2011-06-13 17:40:50 +0000 (Mon, 13 Jun 2011)
Log Message:
-----------
Removed cunei.options package and integrated the command line options with the cunei.config package. A few command line options have changed so look at the '-help' output if things do not behave as expected. All programs now allow the user to set arbitrary configuration options with the syntax '-Xoption=value'.
Modified Paths:
--------------
.classpath
.settings/org.eclipse.jdt.core.prefs
.settings/org.eclipse.jdt.ui.prefs
src/cunei/cli/ARPALanguageModel.java
src/cunei/cli/CommandLineInterface.java
src/cunei/cli/Decode.java
src/cunei/cli/EstimateLexiconAlignment.java
src/cunei/cli/EstimateSentenceRatios.java
src/cunei/cli/Evaluate.java
src/cunei/cli/Frequencies.java
src/cunei/cli/IndexCorpus.java
src/cunei/cli/IndexLanguageModel.java
src/cunei/cli/IndexLexicon.java
src/cunei/cli/IndexMonolingualCorpus.java
src/cunei/cli/Optimize.java
src/cunei/cli/ProcessConfusion.java
src/cunei/cli/ProcessCorpus.java
src/cunei/cli/ProcessDocument.java
src/cunei/cli/ScoreLanguageModel.java
src/cunei/cli/Synonyms.java
src/cunei/cli/Translate.java
src/cunei/cli/Unknown.java
src/cunei/config/CommandArguments.java
src/cunei/config/EnumParameter.java
src/cunei/config/SavedConfig.java
src/cunei/config/SystemConfig.java
src/cunei/confusion/CorpusAnnotator.java
src/cunei/corpus/CorpusReaders.java
src/cunei/corpus/Language.java
src/cunei/corpus/MultiFileCorpusReader.java
src/cunei/corpus/MultiFileCorpusWriter.java
src/cunei/corpus/MultilingualCorpus.java
src/cunei/decode/DecoderWriters.java
src/cunei/document/DocumentReaders.java
src/cunei/document/MultiFileDocument.java
src/cunei/document/MultiFileDocumentReader.java
src/cunei/encoding/Unicode.java
src/cunei/lexicon/Lexicons.java
src/cunei/lm/BackoffLanguageModel.java
src/cunei/translate/MatchLattice.java
src/cunei/type/TypesOfTypes.java
src/cunei/ui/SplashScreen.java
src/cunei/ui/Workbench.java
src/cunei/util/Log.java
test/cunei/model/LogLinearModelTest.java
test/cunei/model/SumLogLinearModelTest.java
Added Paths:
-----------
src/cunei/cli/MultiFileArguments.java
src/cunei/config/FileListParameter.java
src/cunei/config/FileParameter.java
src/cunei/config/ValueOfParameter.java
src/cunei/corpus/Languages.java
src/cunei/corpus/MultiFileCorpus.java
src/cunei/document/MultiFile.java
src/cunei/ui/WorkbenchWindow.java
Removed Paths:
-------------
src/cunei/cli/MultiFileCorpus.java
src/cunei/cli/MultiFileDocument.java
src/cunei/options/
This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.
|
|
From: <aar...@us...> - 2011-06-07 03:33:26
|
Revision: 747
http://cunei.svn.sourceforge.net/cunei/?rev=747&view=rev
Author: aaronbphillips
Date: 2011-06-07 03:33:19 +0000 (Tue, 07 Jun 2011)
Log Message:
-----------
Document context features were in the wrong order (they functioned correctly, but were effectively mislabeled).
Modified Paths:
--------------
src/cunei/corpus/Context.java
This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.
|
|
From: <aar...@us...> - 2011-06-07 00:28:05
|
Revision: 746
http://cunei.svn.sourceforge.net/cunei/?rev=746&view=rev
Author: aaronbphillips
Date: 2011-06-07 00:27:59 +0000 (Tue, 07 Jun 2011)
Log Message:
-----------
Fixes a fairly serious bug introduced by the code that maintained only a maximum number of derivations in r744.
Modified Paths:
--------------
src/cunei/hypothesis/Derivation.java
src/cunei/optimize/Optimizer.java
This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.
|