SO0529 commited on
Commit
8f2bd79
·
verified ·
1 Parent(s): 7588395

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +69 -3
README.md CHANGED
@@ -1,3 +1,69 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ language:
5
+ - ja
6
+ base_model:
7
+ - Qwen/Qwen2.5-7B-Instruct
8
+ pipeline_tag: text-generation
9
+ ---
10
+ ## ABEJA-Qwen2.5-7b-Japanese-v0.1
11
+
12
+ ABEJA-Qwen2.5-7b-Japanese-v0.1は[ここに説明文追加する]
13
+
14
+ 詳細はABEJAのテックブログを参照してください。
15
+
16
+
17
+
18
+ ## 使い方
19
+
20
+ ```Python
21
+ import torch
22
+ from transformers import AutoModelForCausalLM, AutoTokenizer
23
+
24
+ model_name = "abeja/ABEJA-Qwen2.5-7b-Japanese-v0.1"
25
+
26
+ model = AutoModelForCausalLM.from_pretrained(
27
+ model_name,
28
+ torch_dtype="auto",
29
+ device_map="auto"
30
+ )
31
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
32
+
33
+ prompt = "人とAIが協調するためには?"
34
+ messages = [
35
+ {"role": "system", "content": "You are Qwen, created by Alibaba Cloud. You are a helpful assistant."},
36
+ {"role": "user", "content": prompt}
37
+ ]
38
+ text = tokenizer.apply_chat_template(
39
+ messages,
40
+ tokenize=False,
41
+ add_generation_prompt=True
42
+ )
43
+ model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
44
+
45
+ generated_ids = model.generate(
46
+ **model_inputs,
47
+ max_new_tokens=512
48
+ )
49
+ generated_ids = [
50
+ output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
51
+ ]
52
+
53
+ response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
54
+
55
+ print(response)
56
+ ```
57
+
58
+ ## 開発者
59
+
60
+ - Hiroshi Kiyota
61
+ - Keisuke Fujimoto
62
+ - Kentaro Nakanishi
63
+ - Kyo Hattori
64
+ - Shinya Otani
65
+ - Shogo Muranushi
66
+ - Takuma Kume
67
+ - Tomoki Manabe
68
+
69
+ (*)アルファベット順