Update README.md
Browse files
README.md
CHANGED
|
@@ -1,28 +1,28 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: mit
|
| 3 |
-
---
|
| 4 |
-
# internlm2.5_7b_distill_orpo
|
| 5 |
-
## Architecture
|
| 6 |
-
<div align="center">
|
| 7 |
-
<img src="distill_orpo.png" width="800"/>
|
| 8 |
-
</div>
|
| 9 |
-
|
| 10 |
-
## Base model
|
| 11 |
-
[internlm2_5-7b-chat](https://huggingface.co/internlm/internlm2_5-7b-chat)
|
| 12 |
-
|
| 13 |
-
## Datasets used for training
|
| 14 |
-
Created a
|
| 15 |
-
|
| 16 |
-
## Download model
|
| 17 |
-
```bash
|
| 18 |
-
git lfs install
|
| 19 |
-
git clone https://huggingface.co/juneup/internlm2.5_7b_distill_orpo
|
| 20 |
-
```
|
| 21 |
-
If you want to clone without large files - just their pointers
|
| 22 |
-
```bash
|
| 23 |
-
GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/juneup/internlm2.5_7b_distill_orpo
|
| 24 |
-
```
|
| 25 |
-
|
| 26 |
-
### Download at Ollama
|
| 27 |
-
```bash
|
| 28 |
-
ollama run Juneup/internlm2.5_7b_distill:orpo_q4_k_m
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
---
|
| 4 |
+
# internlm2.5_7b_distill_orpo
|
| 5 |
+
## Architecture
|
| 6 |
+
<div align="center">
|
| 7 |
+
<img src="distill_orpo.png" width="800"/>
|
| 8 |
+
</div>
|
| 9 |
+
|
| 10 |
+
## Base model
|
| 11 |
+
[internlm2_5-7b-chat](https://huggingface.co/internlm/internlm2_5-7b-chat)
|
| 12 |
+
|
| 13 |
+
## Datasets used for training
|
| 14 |
+
Created a preference optimization dataset [**PKU-SafeRLHF-orpo-72k**](https://huggingface.co/datasets/juneup/PKU-SafeRLHF-orpo-72k) from [PKU-SafeRLHF-single-dimension](https://huggingface.co/datasets/PKU-Alignment/PKU-SafeRLHF-single-dimension) 。
|
| 15 |
+
|
| 16 |
+
## Download model
|
| 17 |
+
```bash
|
| 18 |
+
git lfs install
|
| 19 |
+
git clone https://huggingface.co/juneup/internlm2.5_7b_distill_orpo
|
| 20 |
+
```
|
| 21 |
+
If you want to clone without large files - just their pointers
|
| 22 |
+
```bash
|
| 23 |
+
GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/juneup/internlm2.5_7b_distill_orpo
|
| 24 |
+
```
|
| 25 |
+
|
| 26 |
+
### Download at Ollama
|
| 27 |
+
```bash
|
| 28 |
+
ollama run Juneup/internlm2.5_7b_distill:orpo_q4_k_m
|