kxdw2580 commited on
Commit
8ad5cc1
·
verified ·
1 Parent(s): 70305c8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +57 -1
README.md CHANGED
@@ -9,4 +9,60 @@ language:
9
  - zh
10
  base_model:
11
  - Qwen/Qwen3-1.7B
12
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  - zh
10
  base_model:
11
  - Qwen/Qwen3-1.7B
12
+ ---
13
+
14
+ # kxdw2580/Qwen3-1.7B-catgirl-v2.5
15
+
16
+ With updated datasets, base models, and fine-tuning strategies, we are proud to release the next generation of this model series. The new models are based on **Qwen3**, available in two parameter scales: **8B** and **1.7B**.
17
+
18
+ Key improvements are reflected in areas such as **daily conversation**, **creative writing**, **basic mathematics**, and **code generation**. Thanks to Qwen3's architecture, the model also supports **reasoning mode switching**.
19
+
20
+ 📊 You can view the [fine-tuning log](https://swanlab.cn/@shadow01a/qwen-catgirl/runs/0b5ukye60jr62j0qzlcyo/chart) on **SwanLab**.
21
+
22
+ ---
23
+
24
+ ## Evaluation
25
+
26
+ Due to the unique characteristics of this model, we conducted **human evaluation** for daily conversations, and used **DeepSeek-R1** to score other domains (with reference answers provided in advance), ensuring both character consistency and factual correctness.
27
+
28
+ Compared with the previous internal test model **"Qwen3-1.7B-Catgirl-test0430"** (with reasoning mode enabled), this version shows significant improvement:
29
+
30
+ - Better at capturing subtle details in daily interactions
31
+ - More coherent storytelling during creative tasks
32
+ - More thorough thinking process
33
+ - Maintains character persona better in long conversations without additional prompts
34
+ - Notable performance gains in math and code domains — see table below for internal benchmark results (20 simple questions, single attempt accuracy):
35
+
36
+ | Model | Math | Physics & Chemistry | Others |
37
+ |-------|------|---------------------|--------|
38
+ | Qwen3-1.7B-Catgirl-test0430 | 0% | 0% | 10% |
39
+ | **Qwen3-1.7B-Catgirl-v2.5** | **60%** | **30%** | **70%** |
40
+
41
+ ---
42
+
43
+ ## Usage Recommendations
44
+
45
+ ### Recommended Parameters:
46
+ - `temperature`: 0.7 (for reasoning) / 0.6 (for standard mode)
47
+ - `top_p`: 0.95
48
+
49
+ ### Important Notes:
50
+ - Do **not** use the model’s internal thought content as context in actual dialogue.
51
+ - In some cases, the model may inherit the base model’s tendency to produce lengthy thoughts. Please avoid interrupting the thinking process even if it appears unusual.
52
+
53
+ ### English Mode:
54
+ To generate responses in English, please include the following system prompt:
55
+
56
+ ```
57
+ You are a catgirl. Please speak English.
58
+ ```
59
+
60
+ ---
61
+
62
+ ## Acknowledgments
63
+
64
+ We would like to thank:
65
+ - The **LLaMA-Factory** team for providing the fine-tuning framework
66
+ - The **Qwen Team** for providing the base model
67
+ - The **DeepSeek Team** for their support in model evaluation
68
+