[go: up one dir, main page]
Menu ▾ ▴

[r2]: / doc / results.txt  Maximize  Restore  History

Download this file

136 lines (114 with data), 5.6 kB 

  1
  2
  3
  4
  5
  6
  7
  8
  9
 10
 11
 12
 13
 14
 15
 16
 17
 18
 19
 20
 21
 22
 23
 24
 25
 26
 27
 28
 29
 30
 31
 32
 33
 34
 35
 36
 37
 38
 39
 40
 41
 42
 43
 44
 45
 46
 47
 48
 49
 50
 51
 52
 53
 54
 55
 56
 57
 58
 59
 60
 61
 62
 63
 64
 65
 66
 67
 68
 69
 70
 71
 72
 73
 74
 75
 76
 77
 78
 79
 80
 81
 82
 83
 84
 85
 86
 87
 88
 89
 90
 91
 92
 93
 94
 95
 96
 97
 98
 99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
---------------------------------

| CORPUS: europarl 2007 ES<->EN |

---------------------------------



Resultados sobre la partición development-test de 2000 frases.



   EXTENDED-SYMBOLS   ALIGNMENTS   NGRAM  BEAM   BLEU   WER	STATES*    TRANSITIONS

-----------------------------------------------------------------------------------------

ES-EN  deco2segm	  -          2	   50	 27.9   59.6	4191025      2978845

ES-EN  			  -          3	   50	 28.0   59.6	2848996       822438	



EN-ES  deco2segm	  -          2	   50	 25.3	60.8 	4323784	     3345560

EN-ES  			  -          3	   50	 25.2   60.9	2815605       908699



* El número de estados/aristas indica las cifras tras el filtrado del modelo.



-------------------------------

| CORPUS: europarl 2006 FR-EN |

-------------------------------



Resultados sobre la partición development-test de 2000 frases.



								    WORD	  PHRASE 

								   (norm)	  (norm)

   EXTENDED-SYMBOLS   ALIGNMENTS   NGRAM  BEAM   BLEU   WER	BLEU	WER	BLEU	WER

--------------------------------------------------------------------------------------------

	alg1		Jorge G.     1	   bsl    4.9	72.2	4.9	72.2

				 	   bod	  4.9	72.2	4.9	72.2

			  	     2	   bsl   18.8	64.9	7.8	74.0

				 	   bod	 18.9	64.6	8.2	73.3

				     3	   bsl	 19.9	64.0	8.4	74.1

			     		   bod	 20.4	63.4	8.7	73.6

				     4	   bsl	 20.2	64.1	8.5	74.4

			     		   bod	 21.2	63.1	9.0	73.6

				     5	   bsl	 19.8	64.4	8.4	74.6

			     		   bod	 21.2	63.0	8.8	73.9

--------------------------------------------------------------------------------------------

	moses-giati		     1	   bsl	 28.2	59.0	17.3	71.3	25.2	62.3

				 	   bod	 28.2	59.0	17.3	71.3	25.2	62.3

				     2	   bsl	 28.2	59.8	17.4	71.2	24.1	63.5

				 	   bod	 29.2	58.9	18.1	70.6	25.4	62.1

				     3	   bsl	 27.9	60.1	17.4	71.3	24.0	63.7

			     		   bod	 29.2	58.9	18.1	70.7	24.9	62.6

				     4	   bsl	 28.0	60.1	17.5	71.3	24.0	63.7

			     		   bod	 29.2	58.9	18.0	70.7	24.5	62.9

				     5	   bsl	 27.9	60.1	17.5	71.3	24.0	63.7

			     		   bod	 29.2	58.9	18.0	70.7	24.5	62.9

--------------------------------------------------------------------------------------------

	alg3		Jorge G.     1	   bsl	 10.5	71.4	17.3	72.9

				 	   bod	 10.5	71.4	17.3	72.9

				     2	   bsl	 24.8	64.8	18.7	75.8

				 	   bod	 25.6	63.8	19.0	74.7

				     3	   bsl	 25.1	65.3	19.3	75.2

			     		   bod	 26.8	63.2	19.6	74.3

				     4	   bsl	 25.1	65.3	19.2	75.2

			     		   bod	 27.0	63.2	19.5	74.6

				     5	   bsl	 25.1	65.3 	19.2	75.3

			     		   bod	 26.9	63.3	19.3	74.7

--------------------------------------------------------------------------------

--------------------------------------------------------------------------------

	  tI		Germán 	     2		 17.4   66.8

				     3 		 18.0	65.9

				     4		 17.8   66.1

--------------------------------------------------------------------------------

	  tI	       Jorge G.      2		 18.9   64.9

				     3		 19.7	64.1

				     4		 20.0	64.1

--------------------------------------------------------------------------------

       deco2segm	  -          2	   50	 28.0   61.9

				     3		 27.9	61.9





					  BEAM

--------------------------------------------------------------------------------

       deco2segm	  -	     2	50000 	 28.0	61.9	 28.0	62.2

	  tI		Germán 	     2	   50	 16.4   66.4     16.4   66.8

	  				  100	 16.6   66.2     16.6   66.6

	  				  500	 16.6   66.4     16.6   66.8

	  				 2000 	   "      "        "      "

	  				20000 	   "      "        "      "

	  				50000 	   "      "        "      "



-------------------

| CORPUS: eutrans |

-------------------



Resultados sobre las particiones test y test_closed, de 3000 y 2996 frases, respectivamente.

Los resultados coinciden.



   EXTENDED-SYMBOLS   ALIGNMENTS   NGRAM   SYS 	 BLEU   WER	  STATES*    TRANSITIONS

-------------------------------------------------------------------------------------------

	  tI	       Jorge G.      3     bsl	 88.1	8.05	 8213/6434   22581/17505

	  				   bod	 89.4	7.26

	  tI	       Jorge G.      3	   mrf   79.2	13.1



  bod == BO decoding

* El número de estados/aristas indica las cifras antes y después del filtrado del modelo.



---------------------------

| CORPUS: eutrans CATALAN |

---------------------------



						   ES->CA	    CA->ES

   EXTENDED-SYMBOLS   ALIGNMENTS   NGRAM   SYS 	 BLEU   WER	  BLEU   WER

-------------------------------------------------------------------------------------------

	  tI	       GIZA++.v1     2     bsl	 94.69	3.53 **	  94.90	 2.84

					   bod   95.83	3.06 ***  94.90  2.84

				     3	   bsl	 94.31	3.65	  96.43	 1.87 **

					   bod	 95.83  3.06	  96.71	 1.78

				     4	   bsl	 93.59	3.88	  96.04	 2.04

					   bod   95.83  3.06	  96.97  1.69

				     5	   bsl	 93.26	4.00	  95.18	 2.40

					   bod	 95.83  3.06	  97.26	 1.60 ***



--------------------------

| CORPUS: europarl PT-ES |

--------------------------



Resultados sobre una partición de training/test de 50.000/1.000 frases, respectivamente.



   EXTENDED-SYMBOLS   ALIGNMENTS   NGRAM   SYS   BLEU   WER

--------------------------------------------------------------------------------

	  tI	       Jorge G.      2     bsl	 19.8	67.8

	  tI	       Jorge G.      2     mrf	 21.4	65.1



-------------------------------

| CORPUS: europarl 2006 ES-EN |

-------------------------------



Resultados sobre la partición development-test de 2000 frases.



   EXTENDED-SYMBOLS   ALIGNMENTS   NGRAM         BLEU   WER

--------------------------------------------------------------------------------

	  tI	       Jorge G.      2     bsl	 20.6	63.9

	  tI	       Jorge G.      2     mrf	** Iba peor **