Upload README.md with huggingface_hub

README.md

@@ -0,0 +1,30 @@
+---
+base_model: llmware/bling-qwen-1.5b
+license: apache-2.0
+tags:
+- llama-cpp
+- gguf-my-repo
+inference: false
+---
+
+# ApprikatAI/bling-qwen-1.5b-FP16-GGUF
+This model was converted to GGUF format from [`llmware/bling-qwen-1.5b`](https://huggingface.co/llmware/bling-qwen-1.5b) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
+Refer to the [original model card](https://huggingface.co/llmware/bling-qwen-1.5b) for more details on the model.
+
+## Use with llama.cpp
+Install llama.cpp through brew (works on Mac and Linux)
+
+```bash
+brew install llama.cpp
+```
+Invoke the llama.cpp server or the CLI.
+
+### CLI:
+```bash
+llama-cli --hf-repo ApprikatAI/bling-qwen-1.5b-FP16-GGUF --hf-file bling-qwen-1.5b-fp16.gguf -p "The meaning to life and the universe is"
+```
+
+### Server:
+```bash
+llama-server --hf-repo ApprikatAI/bling-qwen-1.5b-FP16-GGUF --hf-file bling-qwen-1.5b-fp16.gguf -c 2048
+```