Hugging Face's logo

mradermacher
/
Qwen2.5-3B-Instruct-abliterated-SFT-i1-GGUF

Transformers
GGUF
English
text-generation-inference
unsloth
abliterated
uncensored
imatrix
conversational
Model card Files
xet
Community
mradermacher commited on
Commit
01a7365
·
verified ·
1 Parent(s): bb2b362

uploaded from marco

Browse files
Files changed (25) hide show
  1. .gitattributes +24 -0
  2. Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ1_M.gguf +3 -0
  3. Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ1_S.gguf +3 -0
  4. Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ2_M.gguf +3 -0
  5. Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ2_S.gguf +3 -0
  6. Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ2_XS.gguf +3 -0
  7. Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ2_XXS.gguf +3 -0
  8. Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ3_M.gguf +3 -0
  9. Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ3_S.gguf +3 -0
  10. Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ3_XS.gguf +3 -0
  11. Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ3_XXS.gguf +3 -0
  12. Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ4_NL.gguf +3 -0
  13. Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ4_XS.gguf +3 -0
  14. Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q2_K.gguf +3 -0
  15. Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q2_K_S.gguf +3 -0
  16. Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q3_K_L.gguf +3 -0
  17. Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q3_K_M.gguf +3 -0
  18. Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q3_K_S.gguf +3 -0
  19. Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q4_0.gguf +3 -0
  20. Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q4_1.gguf +3 -0
  21. Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q4_K_M.gguf +3 -0
  22. Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q4_K_S.gguf +3 -0
  23. Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q5_K_M.gguf +3 -0
  24. Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q5_K_S.gguf +3 -0
  25. Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8fcb3b423c92f904b1305b5a291cc4e0e18f4eeb97cca97849cce352a9cb2294
3
+ size 850028416
Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5085879f3bc2cb7adc053655966f98c3ab8d9c6cf4b75604e89c65893e763c43
3
+ size 791095168
Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c3c8c8847d385d7727340d0aee81486eee453e97e2d36b4b353e0131c0a1ca2
3
+ size 1140516736
Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1079cb067205059b48afa1fa1b0966035d0842488419daf28cecebb7be61bb68
3
+ size 1061939072
Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0adfc90722d9697860909ac64181015db923e6b435935080c374577d8274fc24
3
+ size 1031546752
Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:94374e8235b7d66762a94853a5d35209383c755dadf298b392755093f4ad7a38
3
+ size 948250496
Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7554d3b6f7fd71e674a53af98eeb9f05dbc720013ba63467873599b6f9ed633
3
+ size 1488895872
Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c65147d6fd406e87ea63d906120f248f7f9bc3a32f13a9670397ae6bf4ea440e
3
+ size 1456865152
Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:47723e8e00fad6e8350eb58a02525012907e7783b702fc1e990be84a9292dc25
3
+ size 1391837056
Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f5121473b5e80661cf09ca9d9872e22ffdc184718ecd428d9dc88ddb0379719
3
+ size 1282828160
Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:544ab8be15de69e2e5e02432cf52d3ad902d7416b53cc6260a4aa37daac2fe01
3
+ size 1825210240
Qwen2.5-3B-Instruct-abliterated-SFT.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4030e914d0f23ad1b34498c491981331bc86542524d40a1a339b5c088256a86
3
+ size 1739095936
Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a957e3152dd095ed12d34688f2369052ac4359bf19670dfa8070d13d8a351262
3
+ size 1274756992
Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83fe92ea8c3f448979c683afda430f9821fdc7053d73cf2544b49fca0dc4664c
3
+ size 1198129024
Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7031bd9183cfa65cf771ba478fe9ce115d25ff79e89a7f6de0fea2301f72a04
3
+ size 1707392896
Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc6d40143ca2f9656941740be5b87eb2e8a1b2043bf8db4812c6a24874a0cfd1
3
+ size 1590476672
Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e74370d982276c9caab61ef2f32a5e03a29be73648236793d4215275e3336e1e
3
+ size 1454358400
Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d09847fdebe1c691c3c8b0139730c906090db46773ba33d6a45f4cde674ba43e
3
+ size 1828487040
Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:179353e0fae370e1949a6cc6d5cb547faf105fab50e62e4f47cbc96397c997bf
3
+ size 1996259200
Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4da932c63cddc2d3caa51863c01d13887108e6af9cfae73f2caa1d22e786f44b
3
+ size 1929904000
Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5495c06ad8b0dc198f3274507af73de8ba3a99c7c147ced5d00ee789d57f557b
3
+ size 1834385280
Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5679ccbcd33fb0bf4a68448f0d797e6e0b897453e8a4d610a2f83d404ac992d7
3
+ size 2224816000
Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aef74e400937f683a53cb6aeb6393227a02210ff5e956e4e0a396067b3f7718a
3
+ size 2169667456
Qwen2.5-3B-Instruct-abliterated-SFT.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06be953497e97d36b81efad72898c27ca1dd7840f7d91388a9d4bf5654a580f7
3
+ size 2538160000