geoffmunn commited on
Commit
dae69b0
·
verified ·
1 Parent(s): 3ac653b

f16 path changed

Browse files
{Qwen3-0.6B-Q6_K → Qwen3-0.6B-f16-Q6_K}/README.md RENAMED
@@ -17,7 +17,7 @@ base_model: Qwen/Qwen3-0.6B
17
  author: geoffmunn
18
  ---
19
 
20
- # Qwen3-0.6B:Q6_K
21
 
22
  Quantized version of [Qwen/Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B) at **Q6_K** level, derived from **f16** base weights.
23
 
@@ -99,7 +99,7 @@ Stop sequences: `<|im_end|>`, `<|im_start|>`
99
  Importing directly into Ollama should work, but you might encounter this error: `Error: invalid character '<' looking for beginning of value`.
100
  In this case try these steps:
101
 
102
- 1. `wget https://huggingface.co/geoffmunn/Qwen3-0.6B/resolve/main/Qwen3-0.6B-f16%3AQ6_K.gguf`
103
  2. `nano Modelfile` and enter these details:
104
  ```text
105
  FROM ./Qwen3-0.6B-f16:Q6_K.gguf
@@ -138,7 +138,7 @@ Here’s how you can query this model via API using `curl` and `jq`. Replace the
138
 
139
  ```bash
140
  curl http://localhost:11434/api/generate -s -N -d '{
141
- "model": "hf.co/geoffmunn/Qwen3-0.6B:Q6_K",
142
  "prompt": "Respond exactly as follows: Explain what gravity is in one sentence suitable for a child.",
143
  "temperature": 0.6,
144
  "top_p": 0.95,
 
17
  author: geoffmunn
18
  ---
19
 
20
+ # Qwen3-0.6B-f16:Q6_K
21
 
22
  Quantized version of [Qwen/Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B) at **Q6_K** level, derived from **f16** base weights.
23
 
 
99
  Importing directly into Ollama should work, but you might encounter this error: `Error: invalid character '<' looking for beginning of value`.
100
  In this case try these steps:
101
 
102
+ 1. `wget https://huggingface.co/geoffmunn/Qwen3-0.6B-f16/resolve/main/Qwen3-0.6B-f16%3AQ6_K.gguf`
103
  2. `nano Modelfile` and enter these details:
104
  ```text
105
  FROM ./Qwen3-0.6B-f16:Q6_K.gguf
 
138
 
139
  ```bash
140
  curl http://localhost:11434/api/generate -s -N -d '{
141
+ "model": "hf.co/geoffmunn/Qwen3-0.6B-f16:Q6_K",
142
  "prompt": "Respond exactly as follows: Explain what gravity is in one sentence suitable for a child.",
143
  "temperature": 0.6,
144
  "top_p": 0.95,