Upload 2 files

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+distill_orpo.png filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,30 +1,28 @@
----
-license: mit
----
-## 数据集
-### 下载   
-```bash
-git lfs install
-git clone https://huggingface.co/datasets/juneup/PKU-SafeRLHF-orpo
-```
-**若不想克隆大型文件：
-```bash
-GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/datasets/juneup/PKU-SafeRLHF-orpo
-```
-
-## 模型
-
-### 下载
-```bash
-git lfs install
-git clone https://huggingface.co/juneup/internlm2.5_7b_distill_orpo
-```
-**若不想克隆大型文件
-```bash
-GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/juneup/internlm2.5_7b_distill_orpo
-```
-
-### 在Ollama下载
-```bash
-ollama run Juneup/internlm2.5_7b_distill:orpo_q4_k_m
-```
+---
+license: mit
+---
+# internlm2.5_7b_distill_orpo
+## Architecture
+<div align="center">
+  <img src="distill_orpo.png" width="800"/>
+</div>
+
+## Base model
+[internlm2_5-7b-chat](https://huggingface.co/internlm/internlm2_5-7b-chat)
+
+## Datasets used for training
+Created a [72k preference optimization dataset](https://huggingface.co/datasets/juneup/PKU-SafeRLHF-orpo-72k) from processed [PKU-SafeRLHF data](https://huggingface.co/datasets/PKU-Alignment/PKU-SafeRLHF-single-dimension) 。
+
+## Download model
+```bash
+git lfs install
+git clone https://huggingface.co/juneup/internlm2.5_7b_distill_orpo
+```
+If you want to clone without large files - just their pointers
+```bash
+GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/juneup/internlm2.5_7b_distill_orpo
+```
+
+### Download at Ollama
+```bash
+ollama run Juneup/internlm2.5_7b_distill:orpo_q4_k_m