Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+UIGEN-T1.1-Qwen-14B-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+UIGEN-T1.1-Qwen-14B-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+UIGEN-T1.1-Qwen-14B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+UIGEN-T1.1-Qwen-14B-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+UIGEN-T1.1-Qwen-14B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+UIGEN-T1.1-Qwen-14B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+UIGEN-T1.1-Qwen-14B-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+UIGEN-T1.1-Qwen-14B-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+UIGEN-T1.1-Qwen-14B-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+UIGEN-T1.1-Qwen-14B-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+UIGEN-T1.1-Qwen-14B-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+UIGEN-T1.1-Qwen-14B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,89 @@
+---
+license: apache-2.0
+datasets:
+- smirki/UI_REASONING_v1.01
+language:
+- en
+base_model: smirki/UIGEN-T1.1-Qwen-14B
+tags:
+- code
+- ui
+- generation
+- uigen
+- TensorBlock
+- GGUF
+library_name: transformers
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## smirki/UIGEN-T1.1-Qwen-14B - GGUF
+
+This repo contains GGUF format model files for [smirki/UIGEN-T1.1-Qwen-14B](https://huggingface.co/smirki/UIGEN-T1.1-Qwen-14B).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4882](https://github.com/ggml-org/llama.cpp/commit/be7c3034108473beda214fd1d7c98fd6a7a3bdf5).
+
+<div style="text-align: left; margin: 20px 0;">
+    <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
+        Run them on the TensorBlock client using your local machine ↗
+    </a>
+</div>
+
+## Prompt template
+
+```
+<|im_start|>system
+{system_prompt}<|im_end|>
+<|im_start|>user
+{prompt}<|im_end|>
+<|im_start|>assistant
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [UIGEN-T1.1-Qwen-14B-Q2_K.gguf](https://huggingface.co/tensorblock/UIGEN-T1.1-Qwen-14B-GGUF/blob/main/UIGEN-T1.1-Qwen-14B-Q2_K.gguf) | Q2_K | 5.770 GB | smallest, significant quality loss - not recommended for most purposes |
+| [UIGEN-T1.1-Qwen-14B-Q3_K_S.gguf](https://huggingface.co/tensorblock/UIGEN-T1.1-Qwen-14B-GGUF/blob/main/UIGEN-T1.1-Qwen-14B-Q3_K_S.gguf) | Q3_K_S | 6.660 GB | very small, high quality loss |
+| [UIGEN-T1.1-Qwen-14B-Q3_K_M.gguf](https://huggingface.co/tensorblock/UIGEN-T1.1-Qwen-14B-GGUF/blob/main/UIGEN-T1.1-Qwen-14B-Q3_K_M.gguf) | Q3_K_M | 7.339 GB | very small, high quality loss |
+| [UIGEN-T1.1-Qwen-14B-Q3_K_L.gguf](https://huggingface.co/tensorblock/UIGEN-T1.1-Qwen-14B-GGUF/blob/main/UIGEN-T1.1-Qwen-14B-Q3_K_L.gguf) | Q3_K_L | 7.925 GB | small, substantial quality loss |
+| [UIGEN-T1.1-Qwen-14B-Q4_0.gguf](https://huggingface.co/tensorblock/UIGEN-T1.1-Qwen-14B-GGUF/blob/main/UIGEN-T1.1-Qwen-14B-Q4_0.gguf) | Q4_0 | 8.518 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [UIGEN-T1.1-Qwen-14B-Q4_K_S.gguf](https://huggingface.co/tensorblock/UIGEN-T1.1-Qwen-14B-GGUF/blob/main/UIGEN-T1.1-Qwen-14B-Q4_K_S.gguf) | Q4_K_S | 8.573 GB | small, greater quality loss |
+| [UIGEN-T1.1-Qwen-14B-Q4_K_M.gguf](https://huggingface.co/tensorblock/UIGEN-T1.1-Qwen-14B-GGUF/blob/main/UIGEN-T1.1-Qwen-14B-Q4_K_M.gguf) | Q4_K_M | 8.988 GB | medium, balanced quality - recommended |
+| [UIGEN-T1.1-Qwen-14B-Q5_0.gguf](https://huggingface.co/tensorblock/UIGEN-T1.1-Qwen-14B-GGUF/blob/main/UIGEN-T1.1-Qwen-14B-Q5_0.gguf) | Q5_0 | 10.267 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [UIGEN-T1.1-Qwen-14B-Q5_K_S.gguf](https://huggingface.co/tensorblock/UIGEN-T1.1-Qwen-14B-GGUF/blob/main/UIGEN-T1.1-Qwen-14B-Q5_K_S.gguf) | Q5_K_S | 10.267 GB | large, low quality loss - recommended |
+| [UIGEN-T1.1-Qwen-14B-Q5_K_M.gguf](https://huggingface.co/tensorblock/UIGEN-T1.1-Qwen-14B-GGUF/blob/main/UIGEN-T1.1-Qwen-14B-Q5_K_M.gguf) | Q5_K_M | 10.509 GB | large, very low quality loss - recommended |
+| [UIGEN-T1.1-Qwen-14B-Q6_K.gguf](https://huggingface.co/tensorblock/UIGEN-T1.1-Qwen-14B-GGUF/blob/main/UIGEN-T1.1-Qwen-14B-Q6_K.gguf) | Q6_K | 12.125 GB | very large, extremely low quality loss |
+| [UIGEN-T1.1-Qwen-14B-Q8_0.gguf](https://huggingface.co/tensorblock/UIGEN-T1.1-Qwen-14B-GGUF/blob/main/UIGEN-T1.1-Qwen-14B-Q8_0.gguf) | Q8_0 | 15.702 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/UIGEN-T1.1-Qwen-14B-GGUF --include "UIGEN-T1.1-Qwen-14B-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/UIGEN-T1.1-Qwen-14B-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```

UIGEN-T1.1-Qwen-14B-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d45d3773a59d7c169fe1cbd2b683d46d9d66f5624fcadd9d52d4c63fecbd03d
+size 5770498144

UIGEN-T1.1-Qwen-14B-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c131440a1774602bc56d7eae237a5fc96a29fd5e0e4477cf718b414a242fcbd6
+size 7924768864

UIGEN-T1.1-Qwen-14B-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:94be04293cba408768bda727752b067de603dd226abac6f05b53839973e6ffbc
+size 7339204704

UIGEN-T1.1-Qwen-14B-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2b1f79501820d162cb1556a5149060fcb4113d8efee946c1785c729a49269233
+size 6659596384

UIGEN-T1.1-Qwen-14B-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ebd8a65ce544e737fb46c222dbf61e4212680608a330babc10c9086840370a51
+size 8517726304

UIGEN-T1.1-Qwen-14B-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:408aa61877f82126c476c5ed9461a3d96014f56b16a9202e5291007d4017a579
+size 8988110944

UIGEN-T1.1-Qwen-14B-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:974ea1bab039cf2e043765c098d51332de89c3f80b44c84146457954d2662a0e
+size 8573431904

UIGEN-T1.1-Qwen-14B-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7018d1451e512ab5e97e844e2c309b63f2c0fa2bed11771169826b3073fbe243
+size 10266554464

UIGEN-T1.1-Qwen-14B-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:151c730432f51302e3b851d9a818b85bee4c07ddabdbf67059176722185da4de
+size 10508873824

UIGEN-T1.1-Qwen-14B-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ef4b1dcd0ff0ed3cceff282193ed89a8200fa0e282d26773159142514567da86
+size 10266554464

UIGEN-T1.1-Qwen-14B-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e2fe9b4932b94897a868d46ffe7e66064c0a23793540151eacecfcfd5871637
+size 12124684384

UIGEN-T1.1-Qwen-14B-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:38281cfb64d4e1e2415d8a6b05f988c9b3ab50aba0479180c214f500c4c0a349
+size 15701598304