Update README.md
Browse files
README.md
CHANGED
|
@@ -6,4 +6,6 @@ tags:
|
|
| 6 |
- merge
|
| 7 |
---
|
| 8 |
|
| 9 |
-
Merge of top 7B models with DARE method
|
|
|
|
|
|
|
|
|
| 6 |
- merge
|
| 7 |
---
|
| 8 |
|
| 9 |
+
Merge of top 7B models with DARE method
|
| 10 |
+
|
| 11 |
+
> mergekit is a toolkit for merging pre-trained language models. mergekit uses an out-of-core approach to perform unreasonably elaborate merges in resource-constrained situations. Merges can be run entirely on CPU or accelerated with as little as 8 GB of VRAM. Many merging algorithms are supported, with more coming as they catch my attention.
|