Update README.md
Browse files
README.md
CHANGED
|
@@ -1,4 +1,47 @@
|
|
| 1 |
---
|
| 2 |
base_model:
|
| 3 |
- Qwen/Qwen3-Next-80B-A3B-Instruct
|
| 4 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
base_model:
|
| 3 |
- Qwen/Qwen3-Next-80B-A3B-Instruct
|
| 4 |
+
license: apache-2.0
|
| 5 |
+
pipeline_tag: text-generation
|
| 6 |
+
---
|
| 7 |
+
|
| 8 |
+
## Q4_0 Quantized Model
|
| 9 |
+
|
| 10 |
+
This Q4_0 quantized model was generated using the pull request [#16095](https://github.com/ggml-org/llama.cpp/pull/16095) on 2025-10-19 with commit `2fdbf16eb`.
|
| 11 |
+
|
| 12 |
+
### How to build and run
|
| 13 |
+
|
| 14 |
+
```bash
|
| 15 |
+
PR=16095
|
| 16 |
+
git clone https://github.com/ggml-org/llama.cpp llama.cpp-PR-$PR
|
| 17 |
+
cd llama.cpp-PR-$PR
|
| 18 |
+
gh pr checkout $PR
|
| 19 |
+
time cmake -B build
|
| 20 |
+
time cmake --build build --config Release --parallel $(nproc --all)
|
| 21 |
+
```
|
| 22 |
+
|
| 23 |
+
### Run examples
|
| 24 |
+
|
| 25 |
+
Run with Hugging Face model:
|
| 26 |
+
|
| 27 |
+
```bash
|
| 28 |
+
build/bin/llama-cli -hf lefromage/Qwen__Qwen3-Next-80B-A3B-Instruct-Q4_0.gguf --prompt 'What is the capital of France?' --no-mmap -st
|
| 29 |
+
```
|
| 30 |
+
|
| 31 |
+
Run with local model file:
|
| 32 |
+
|
| 33 |
+
```bash
|
| 34 |
+
build/bin/llama-cli -m Qwen__Qwen3-Next-80B-A3B-Instruct-Q4_0.gguf --prompt 'Write a paragraph about quantum computing' --no-mmap -st
|
| 35 |
+
```
|
| 36 |
+
|
| 37 |
+
### Example prompt and output
|
| 38 |
+
|
| 39 |
+
**User prompt:**
|
| 40 |
+
|
| 41 |
+
Write a paragraph about quantum computing
|
| 42 |
+
|
| 43 |
+
**Assistant output:**
|
| 44 |
+
|
| 45 |
+
Quantum computing represents a revolutionary leap in computational power by harnessing the principles of quantum mechanics, such as superposition and entanglement, to process information in fundamentally new ways. Unlike classical computers, which use bits that are either 0 or 1, quantum computers use quantum bits, or qubits, which can exist in a combination of both states simultaneously. This allows quantum computers to explore vast solution spaces in parallel, making them potentially exponentially faster for certain problems—like factoring large numbers, optimizing complex systems, or simulating molecular structures for drug discovery. While still in its early stages, with challenges including qubit stability, error correction, and scalability, quantum computing holds transformative promise for fields ranging from cryptography to artificial intelligence. As researchers and tech companies invest heavily in hardware and algorithmic development, the race to achieve practical, fault-tolerant quantum machines is accelerating, heralding a new era in computing technology.
|
| 46 |
+
|
| 47 |
+
[end of text]
|