manancode commited on
Commit
6feb97c
·
verified ·
1 Parent(s): e6ba452

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +66 -0
README.md ADDED
@@ -0,0 +1,66 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - translation
5
+ - opus-mt
6
+ - ctranslate2
7
+ - quantized
8
+ language:
9
+ - multilingual
10
+ pipeline_tag: translation
11
+ ---
12
+
13
+ # opus-mt-ja-ru-ctranslate2-android
14
+
15
+ This is a quantized INT8 version of `Helsinki-NLP/opus-mt-ja-ru` converted to CTranslate2 format for efficient inference.
16
+
17
+ ## Model Details
18
+
19
+ - **Original Model**: Helsinki-NLP/opus-mt-ja-ru
20
+ - **Format**: CTranslate2
21
+ - **Quantization**: INT8
22
+ - **Framework**: OPUS-MT
23
+ - **Converted by**: Automated conversion pipeline
24
+
25
+ ## Files Included
26
+
27
+ - CTranslate2 model files (quantized INT8)
28
+ - SentencePiece tokenizer files (`source.spm`, `target.spm`)
29
+ - Integration guide for Android deployment
30
+
31
+ ## Usage
32
+
33
+ ### With CTranslate2
34
+
35
+ ```python
36
+ import ctranslate2
37
+ import sentencepiece as spm
38
+
39
+ # Load the model
40
+ translator = ctranslate2.Translator("path/to/model")
41
+
42
+ # Load tokenizers
43
+ sp_source = spm.SentencePieceProcessor(model_file="source.spm")
44
+ sp_target = spm.SentencePieceProcessor(model_file="target.spm")
45
+
46
+ # Translate
47
+ source_tokens = sp_source.encode("Your text here", out_type=str)
48
+ results = translator.translate_batch([source_tokens])
49
+ translation = sp_target.decode(results[0].hypotheses[0])
50
+ ```
51
+
52
+ ### Android Integration
53
+
54
+ See the included `INTEGRATION_GUIDE.txt` for Android implementation details.
55
+
56
+ ## Performance
57
+
58
+ This INT8 quantized version provides:
59
+ - ~75% reduction in model size
60
+ - Faster inference speed
61
+ - Maintained translation quality
62
+ - Mobile-friendly deployment
63
+
64
+ ## Original Model
65
+
66
+ Based on the OPUS-MT project: https://github.com/Helsinki-NLP/Opus-MT