Commit
·
c705ae9
1
Parent(s):
bb132f2
readme update #8
Browse files
README.md
CHANGED
|
@@ -12,6 +12,8 @@ license: apache-2.0
|
|
| 12 |
language:
|
| 13 |
- ru
|
| 14 |
- kk
|
|
|
|
|
|
|
| 15 |
---
|
| 16 |
|
| 17 |
# kazRush-kk-ru
|
|
@@ -76,10 +78,10 @@ Current model was compared to another open-source translation model, [NLLB](<htt
|
|
| 76 |
The metrics - BLEU, chrF and COMET - were calculated on `devtest` part of [FLORES+ evaluation benchmark](<https://github.com/openlanguagedata/flores>), most recent evaluation benchmark for multilingual machine translation.
|
| 77 |
Calculation of BLEU and chrF follows the standart implementation from [sacreBLEU](<https://github.com/mjpost/sacrebleu>), and COMET is calculated using default model described in [COMET repository](<https://github.com/Unbabel/COMET>).
|
| 78 |
|
| 79 |
-
| Model | Size | BLEU | chrf |
|
| 80 |
|-----------------------------------------|-------|-----------------------------|------------------------|----------|
|
| 81 |
| [nllb-200-distilled-600M](https://huggingface.co/facebook/nllb-200-distilled-600M) | 600M | 18.0 | 47.3 | 85.6 |
|
| 82 |
-
| [This model
|
| 83 |
| [nllb-200-1.3B](https://huggingface.co/facebook/nllb-200-1.3B) | 1.3B | 20.4 | 49.3 | 87.9 |
|
| 84 |
| [nllb-200-distilled-1.3B](https://huggingface.co/facebook/nllb-200-distilled-1.3B) | 1.3B | 20.8 | 49.6 | 88.1 |
|
| 85 |
| [nllb-200-3.3B](https://huggingface.co/facebook/nllb-200-3.3B) | 3.3B | 21.5 | 50.7 | 88.7 |
|
|
|
|
| 12 |
language:
|
| 13 |
- ru
|
| 14 |
- kk
|
| 15 |
+
datasets:
|
| 16 |
+
- issai/kazparc
|
| 17 |
---
|
| 18 |
|
| 19 |
# kazRush-kk-ru
|
|
|
|
| 78 |
The metrics - BLEU, chrF and COMET - were calculated on `devtest` part of [FLORES+ evaluation benchmark](<https://github.com/openlanguagedata/flores>), most recent evaluation benchmark for multilingual machine translation.
|
| 79 |
Calculation of BLEU and chrF follows the standart implementation from [sacreBLEU](<https://github.com/mjpost/sacrebleu>), and COMET is calculated using default model described in [COMET repository](<https://github.com/Unbabel/COMET>).
|
| 80 |
|
| 81 |
+
| Model | Size | BLEU | chrf | COMET |
|
| 82 |
|-----------------------------------------|-------|-----------------------------|------------------------|----------|
|
| 83 |
| [nllb-200-distilled-600M](https://huggingface.co/facebook/nllb-200-distilled-600M) | 600M | 18.0 | 47.3 | 85.6 |
|
| 84 |
+
| [This model]() | 197M | 18.8 | 48.7 | 86.7 |
|
| 85 |
| [nllb-200-1.3B](https://huggingface.co/facebook/nllb-200-1.3B) | 1.3B | 20.4 | 49.3 | 87.9 |
|
| 86 |
| [nllb-200-distilled-1.3B](https://huggingface.co/facebook/nllb-200-distilled-1.3B) | 1.3B | 20.8 | 49.6 | 88.1 |
|
| 87 |
| [nllb-200-3.3B](https://huggingface.co/facebook/nllb-200-3.3B) | 3.3B | 21.5 | 50.7 | 88.7 |
|