Hugging Face's logo

ArtusDev
/
LatitudeGames_Wayfarer-2-12B-EXL3

Transformers
English
text adventure
roleplay
exl3
Model card Files
xet
Community
ArtusDev commited on
Commit
1f1e56a
·
verified ·
1 Parent(s): 0cb916a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +230 -28
README.md CHANGED
@@ -11,37 +11,239 @@ tags:
11
  - exl3
12
  library_name: transformers
13
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
 
15
- ## EXL3 Quants of LatitudeGames/Wayfarer-2-12B
16
 
17
- EXL3 quants of [LatitudeGames/Wayfarer-2-12B](https://huggingface.co/LatitudeGames/Wayfarer-2-12B) using <a href="https://github.com/turboderp-org/exllamav3/">exllamav3</a> for quantization.
 
 
 
 
 
18
 
19
- ### Quants
20
- | Quant(Revision) | Bits per Weight | Head Bits |
21
- | -------- | ---------- | --------- |
22
- | [2.5_H6](https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/2.5bpw_H6) | 2.5 | 6 |
23
- | [3.0_H6](https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/3.0bpw_H6) | 3.0 | 6 |
24
- | [3.5_H6](https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/3.5bpw_H6) | 3.5 | 6 |
25
- | [4.0_H6](https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/4.0bpw_H6) | 4.0 | 6 |
26
- | [4.5_H6](https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/4.5bpw_H6) | 4.5 | 6 |
27
- | [5.0_H6](https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/5.0bpw_H6) | 5.0 | 6 |
28
- | [6.0_H6](https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/6.0bpw_H6) | 6.0 | 6 |
29
- | [8.0_H8](https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/8.0bpw_H8) | 8.0 | 8 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
 
31
- ### Downloading quants with huggingface-cli
 
 
 
 
 
 
 
 
 
 
 
 
 
32
 
33
- <details>
34
- <summary>Click to view download instructions</summary>
 
 
 
 
 
 
 
35
 
36
- Install hugginface-cli:
37
-
38
- ```bash
39
- pip install -U "huggingface_hub[cli]"
40
- ```
41
-
42
- Download quant by targeting the specific quant revision (branch):
43
-
44
- ```
45
- huggingface-cli download ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3 --revision "5.0bpw_H6" --local-dir ./
46
- ```
47
- </details>
 
11
  - exl3
12
  library_name: transformers
13
  ---
14
+ <style>
15
+ .container-dark {
16
+ font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", Arial, sans-serif;
17
+ line-height: 1.6;
18
+ color: #d4d4d4;
19
+ }
20
+ a {
21
+ color: #569cd6;
22
+ text-decoration: none;
23
+ font-weight: 600;
24
+ }
25
+ a:hover {
26
+ text-decoration: underline;
27
+ }
28
+ .card-dark {
29
+ background-color: #252526;
30
+ border-radius: 12px;
31
+ padding: 24px;
32
+ margin-bottom: 20px;
33
+ box-shadow: 0 4px 12px rgba(0,0,0,0.3);
34
+ border: 1px solid #3c3c3c;
35
+ }
36
+ .card-dark h1 {
37
+ font-size: 2.2em;
38
+ color: #ffffff;
39
+ text-align: center;
40
+ margin-bottom: 10px;
41
+ }
42
+ .card-dark.card-dark-title h1 {
43
+ font-size: 1.5em;
44
+ }
45
+ .card-dark .subtitle {
46
+ text-align: center;
47
+ font-size: 1.1em;
48
+ color: #a0a0a0;
49
+ }
50
+ .card-dark h2 {
51
+ font-size: 1.5em;
52
+ margin-top: 0;
53
+ padding-bottom: 10px;
54
+ border-bottom: 1px solid #3c3c3c;
55
+ color: #c586c0;
56
+ }
57
+ .card-dark h3 {
58
+ font-size: 1.2em;
59
+ color: #d4d4d4;
60
+ }
61
+ .styled-table {
62
+ display: table;
63
+ border: none;
64
+ width: 100%;
65
+ font-size: 0.95em;
66
+ margin-bottom: 0px;
67
+ }
68
+ .styled-table thead th {
69
+ background-color: #333333;
70
+ color: #c586c0;
71
+ text-align: left;
72
+ }
73
+ .styled-table th {
74
+ padding: 12px 15px;
75
+ }
76
+ .styled-table td {
77
+ padding: 0;
78
+ }
79
+ .styled-table table, .styled-table th, .styled-table td {
80
+ border-left: none;
81
+ border-right: none;
82
+ border-bottom: none;
83
+ }
84
+ .styled-table td {
85
+ border-bottom: 1px solid #3c3c3c;
86
+ }
87
+ .styled-table tbody tr {
88
+ transition: background-color 0.1s ease;
89
+ }
90
+ .styled-table tbody tr:hover {
91
+ background-color: #3a3a3a;
92
+ }
93
+ .styled-table tr:last-child td {
94
+ border-bottom: none;
95
+ }
96
+ .styled-table td a {
97
+ display: block;
98
+ padding: 12px 15px;
99
+ }
100
+ .styled-table td a.fake-link {
101
+ text-decoration:none;
102
+ color:inherit;
103
+ }
104
+ details {
105
+ margin-top: 20px;
106
+ border: 1px solid #3c3c3c;
107
+ border-radius: 8px;
108
+ overflow: hidden;
109
+ }
110
+ summary {
111
+ cursor: pointer;
112
+ padding: 12px 18px;
113
+ background-color: #6A5ACD;
114
+ font-weight: 600;
115
+ display: flex;
116
+ align-items: center;
117
+ gap: 10px;
118
+ justify-content: space-between;
119
+ list-style: none;
120
+ }
121
+ summary::-webkit-details-marker {
122
+ display: none;
123
+ }
124
+ summary:hover {
125
+ filter: brightness(1.1);
126
+ }
127
+ summary::after {
128
+ content: '';
129
+ display: inline-block;
130
+ width: 8px;
131
+ height: 8px;
132
+ border-bottom: 2px solid white;
133
+ border-right: 2px solid white;
134
+ transform: rotate(45deg);
135
+ transition: transform 0.3s ease;
136
+ }
137
+ details[open] > summary::after {
138
+ transform: rotate(225deg);
139
+ }
140
+ .details-content {
141
+ padding: 18px;
142
+ }
143
+ .btn-purple {
144
+ display: inline-block;
145
+ background-color: #6A5ACD;
146
+ color: white !important;
147
+ padding: 12px 24px;
148
+ border-radius: 8px;
149
+ text-decoration: none;
150
+ font-weight: 600;
151
+ transition: background-color 0.3s ease, transform 0.2s ease;
152
+ text-align: center;
153
+ }
154
+ .btn-purple:hover {
155
+ background-color: #7B68EE;
156
+ transform: translateY(-2px);
157
+ }
158
+ </style>
159
 
160
+ <div class="container-dark">
161
 
162
+ <div class="card-dark card-dark-title">
163
+ <h1>ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3</h1>
164
+ <p class="subtitle">
165
+ EXL3 quants of <a href="https://huggingface.co/LatitudeGames/Wayfarer-2-12B" target="_blank">LatitudeGames/Wayfarer-2-12B</a> using <a href="https://github.com/turboderp-org/exllamav3/" target="_blank">exllamav3</a> for quantization.
166
+ </p>
167
+ </div>
168
 
169
+ <div class="card-dark">
170
+ <h2>Quants</h2>
171
+ <table class="styled-table">
172
+ <thead>
173
+ <tr>
174
+ <th>Quant</th>
175
+ <th>BPW</th>
176
+ <th>Head Bits</th>
177
+ </tr>
178
+ </thead>
179
+ <tbody>
180
+ <tr>
181
+ <td><a href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/2.5bpw_H6" target="_blank">2.5_H6</a></td>
182
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/2.5bpw_H6" target="_blank">2.5</a></td>
183
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/2.5bpw_H6" target="_blank">6</a></td>
184
+ </tr>
185
+ <tr>
186
+ <td><a href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/3.0bpw_H6" target="_blank">3.0_H6</a></td>
187
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/3.0bpw_H6" target="_blank">3.0</a></td>
188
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/3.0bpw_H6" target="_blank">6</a></td>
189
+ </tr>
190
+ <tr>
191
+ <td><a href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/3.5bpw_H6" target="_blank">3.5_H6</a></td>
192
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/3.5bpw_H6" target="_blank">3.5</a></td>
193
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/3.5bpw_H6" target="_blank">6</a></td>
194
+ </tr>
195
+ <tr>
196
+ <td><a href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/4.0bpw_H6" target="_blank">4.0_H6</a></td>
197
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/4.0bpw_H6" target="_blank">4.0</a></td>
198
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/4.0bpw_H6" target="_blank">6</a></td>
199
+ </tr>
200
+ <tr>
201
+ <td><a href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/4.5bpw_H6" target="_blank">4.5_H6</a></td>
202
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/4.5bpw_H6" target="_blank">4.5</a></td>
203
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/4.5bpw_H6" target="_blank">6</a></td>
204
+ </tr>
205
+ <tr>
206
+ <td><a href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/5.0bpw_H6" target="_blank">5.0_H6</a></td>
207
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/5.0bpw_H6" target="_blank">5.0</a></td>
208
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/5.0bpw_H6" target="_blank">6</a></td>
209
+ </tr>
210
+ <tr>
211
+ <td><a href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/6.0bpw_H6" target="_blank">6.0_H6</a></td>
212
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/6.0bpw_H6" target="_blank">6.0</a></td>
213
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/6.0bpw_H6" target="_blank">6</a></td>
214
+ </tr>
215
+ <tr>
216
+ <td><a href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/8.0bpw_H8" target="_blank">8.0_H8</a></td>
217
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/8.0bpw_H8" target="_blank">8.0</a></td>
218
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3/tree/8.0bpw_H8" target="_blank">8</a></td>
219
+ </tr>
220
+ </tbody>
221
+ </table>
222
+ </div>
223
 
224
+ <div class="card-dark">
225
+ <h2>How to Download and Use Quants</h2>
226
+ <p>You can download quants by targeting specific size using the Hugging Face CLI.</p>
227
+ <details>
228
+ <summary>Click for download commands</summary>
229
+ <div class="details-content">
230
+ <b>1. Install huggingface-cli:</b>
231
+ <pre><code>pip install -U "huggingface_hub[cli]"</code></pre>
232
+ <b>2. Download a specific quant:</b>
233
+ <pre><code>huggingface-cli download ArtusDev/LatitudeGames_Wayfarer-2-12B-EXL3 --revision "5.0bpw_H6" --local-dir ./</code></pre>
234
+ </div>
235
+ </details>
236
+ <p>EXL3 quants can be run with any inference client that supports EXL3, such as <a href="https://github.com/theroyallab/tabbyapi" target="_blank"><b>TabbyAPI</b></a>. Refer to <a href="https://github.com/theroyallab/tabbyAPI/wiki/01.-Getting-Started" target="_blank">documentation</a> for set up instructions.</p>
237
+ </div>
238
 
239
+ <div class="card-dark">
240
+ <h2>Quant Requests</h2>
241
+ <div style="text-align: center; margin-top: 25px;">
242
+ <a href="https://huggingface.co/ArtusDev/requests-exl/discussions/new?title=[MODEL_NAME_HERE]&description=[MODEL_HF_LINK_HERE]" class="btn-purple" target="_blank">Request EXL3 Quants</a>
243
+ </div>
244
+ <p class="subtitle">
245
+ See <a href="https://huggingface.co/ArtusDev/requests-exl" target="_blank">EXL community hub</a> for request guidelines.
246
+ </p>
247
+ </div>
248
 
249
+ </div>