juneup commited on
Commit
5cad1f4
·
verified ·
1 Parent(s): 5d3a868

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +28 -28
README.md CHANGED
@@ -1,28 +1,28 @@
1
- ---
2
- license: mit
3
- ---
4
- # internlm2.5_7b_distill_orpo
5
- ## Architecture
6
- <div align="center">
7
- <img src="distill_orpo.png" width="800"/>
8
- </div>
9
-
10
- ## Base model
11
- [internlm2_5-7b-chat](https://huggingface.co/internlm/internlm2_5-7b-chat)
12
-
13
- ## Datasets used for training
14
- Created a [72k preference optimization dataset](https://huggingface.co/datasets/juneup/PKU-SafeRLHF-orpo-72k) from processed [PKU-SafeRLHF data](https://huggingface.co/datasets/PKU-Alignment/PKU-SafeRLHF-single-dimension) 。
15
-
16
- ## Download model
17
- ```bash
18
- git lfs install
19
- git clone https://huggingface.co/juneup/internlm2.5_7b_distill_orpo
20
- ```
21
- If you want to clone without large files - just their pointers
22
- ```bash
23
- GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/juneup/internlm2.5_7b_distill_orpo
24
- ```
25
-
26
- ### Download at Ollama
27
- ```bash
28
- ollama run Juneup/internlm2.5_7b_distill:orpo_q4_k_m
 
1
+ ---
2
+ license: mit
3
+ ---
4
+ # internlm2.5_7b_distill_orpo
5
+ ## Architecture
6
+ <div align="center">
7
+ <img src="distill_orpo.png" width="800"/>
8
+ </div>
9
+
10
+ ## Base model
11
+ [internlm2_5-7b-chat](https://huggingface.co/internlm/internlm2_5-7b-chat)
12
+
13
+ ## Datasets used for training
14
+ Created a preference optimization dataset [**PKU-SafeRLHF-orpo-72k**](https://huggingface.co/datasets/juneup/PKU-SafeRLHF-orpo-72k) from [PKU-SafeRLHF-single-dimension](https://huggingface.co/datasets/PKU-Alignment/PKU-SafeRLHF-single-dimension) 。
15
+
16
+ ## Download model
17
+ ```bash
18
+ git lfs install
19
+ git clone https://huggingface.co/juneup/internlm2.5_7b_distill_orpo
20
+ ```
21
+ If you want to clone without large files - just their pointers
22
+ ```bash
23
+ GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/juneup/internlm2.5_7b_distill_orpo
24
+ ```
25
+
26
+ ### Download at Ollama
27
+ ```bash
28
+ ollama run Juneup/internlm2.5_7b_distill:orpo_q4_k_m