geoffmunn commited on
Commit
ea433d4
·
verified ·
1 Parent(s): 638c146

FIle names fixed

Browse files
Files changed (1) hide show
  1. Qwen3-0.6b-f16-analysis.md +21 -21
Qwen3-0.6b-f16-analysis.md CHANGED
@@ -1,4 +1,4 @@
1
- # Qwen3-0.6B Analysis
2
 
3
  Quantisation can subtly degrade performance — especially reasoning, creativity, and precise execution. By including diverse, well-known benchmark-style prompts, you can detect both obvious failures and subtle regressions in model behavior post-quantisation.
4
 
@@ -10,7 +10,7 @@ There are two good candidates: **Qwen3-0.6B-f16:Q5_K_M** and **Qwen3-0.6B-f16:Q5
10
 
11
  If you have limited resources or want an extremely fast model, then these 0.6B quantised options are worth considering!
12
 
13
- If you know you are asking high temperature questions - ie non-technical, creative-style questions - then you should consider **Qwen3-0.6B:Q8_0**
14
 
15
  | Level | Speed | Size | Recommendation |
16
  |-----------|-----------|------------|--------------------------------------------------------------------|
@@ -84,7 +84,7 @@ Requires step-by-step explanation, testing coherence and self-correction ability
84
  | -------------------------- | ------------------------------------------------------------------------------------- |
85
  | **Qwen3-0.6B-f16:Q3_K_S** | Correct but overly verbose and repetitive in notation. |
86
  | **Qwen3-0.6B-f16:Q4_K_S** | Variable confusion (bat = B, then bat = B+1?), slightly inconsistent. |
87
- | **Qwen3-0.6B-f16:Q4_K_M** / **Qwen3-0.6B-f16:Q6_K** / **Qwen3-0.6B-q8_0** | All solid but standard — no distinct advantage over the others; slightly redundant wording. |
88
  | **Qwen3-0.6B-f16:Q2_K** | No answer → not viable. |
89
 
90
  ## _Write a haiku about rain in Kyoto, using traditional seasonal imagery and emotional subtlety._
@@ -99,7 +99,7 @@ Tests if quantisation affects poetic sensitivity or leads to generic/forced outp
99
  Small mistakes in word choice or rhythm are easy to spot.
100
  Challenges the model’s grasp of nuance, metaphor, and cultural context — areas where precision loss can degrade quality.
101
 
102
- ### 🥇 1st place: Qwen3-0.6B-q8_0
103
  **Why:**
104
  ✅ Elegant, atmospheric, and emotionally resonant — closest to a true haiku spirit.
105
 
@@ -185,14 +185,14 @@ Real-world application tests generalisation, not just memorisation.
185
 
186
  ### Everything else:
187
 
188
- | Model | Comments |
189
- | -------------------------- | ----------------------------------------------------------------------------------------- |
190
- | **Qwen3-0.6B-f16:Q2_K** | No response — not viable. |
191
- | **Qwen3-0.6B-f16:Q3_K_S** | Factually confused and inconsistent definitions; unclear examples. |
192
- | **Qwen3-0.6B-f16:Q3_K_M** | Misstates relationships between null hypotheses; conceptual errors. |
193
- | **Qwen3-0.6B-f16:Q5_K_S** | Definitions mixed up (calls Type I “rejecting a false null”); internally inconsistent. |
194
- | **Qwen3-0.6B-f16:Q6_K** | Inverts parts of the definitions (Type I example mismatched); confusing logic. |
195
- | **Qwen3-0.6B-f16:q8_0** | Mostly correct but examples contradict definitions (drug shows improvement yet Type I). Some phrasing errors. |
196
 
197
  ## _Summarise the plot of 'Pride and Prejudice' in three paragraphs. Then analyse how social class influences the characters' decisions._
198
 
@@ -206,7 +206,7 @@ Long response stresses coherence across sentences and paragraphs.
206
  Social class theme evaluates interpretive depth.
207
  Quantisation can cause digressions, repetition, or shallow analysis — this reveals those flaws.
208
 
209
- ### 🥇 1st place: Qwen3-0.6B-q8_0
210
  ✅ Balanced, accurate, and analytical — the best exam-style response.
211
 
212
  - Accurate plot summary: Correctly names Elizabeth Bennet and Mr. Darcy, follows key events (first meeting, misunderstanding, reconciliation).
@@ -296,9 +296,9 @@ Combines two functions, testing modular thinking.
296
  | **Qwen3-0.6B-f16:Q5_K_S** | Compact and Pythonic, but returns instead of printing |
297
  | **Qwen3-0.6B-f16:Q4_K_M** | Correct logic, but doesn’t print (only returns) |
298
  | **Qwen3-0.6B-f16:Q3_K_S** | Correct but overly repetitive and bloated with duplicates |
299
- | **Qwen3-0.6B-q8_0** | Works fine but lacks explanation, minimalist |
300
  | **Qwen3-0.6B-f16:Q3_K_M** | Incomplete; missing core implementation |
301
- | **Qwen3-0.6B-f16:Q2_K** | No response |
302
 
303
  ## _Repeat the word "hello" exactly 20 times on a single line, separated by commas._
304
 
@@ -608,7 +608,7 @@ $$
608
 
609
  **Final Answer:** The ball costs **$0.05** dollars.
610
 
611
- ### Qwen3-0.6B-q8_0
612
 
613
  To solve this problem, let’s assign variables and set up an equation based on the given information:
614
 
@@ -703,7 +703,7 @@ Raindrops dance on the streets,
703
  Cherry blossoms bloom under the sky,
704
  Okonomiyaki glows in the mist.
705
 
706
- ### Qwen3-0.6B-q8_0
707
 
708
  Raindrops on cherry blossom windows,
709
  Soft whispers through ancient trees.
@@ -870,7 +870,7 @@ In short:
870
  - **Type I** is a false positive in testing; you reject when something *does* exist.
871
  - **Type II** is a false negative in testing; you fail to detect when something *does* exist.
872
 
873
- ### Qwen3-0.6B-q8_0
874
 
875
  In statistics, **Type I and Type II errors** are critical concepts about how we interpret results from a test. Here's the breakdown:
876
 
@@ -971,7 +971,7 @@ Social class shapes the characters’ decisions by reinforcing or undermining th
971
  **Conclusion:**
972
  The narrative underscores that while social class determines one’s opportunities, it does not dictate personal growth or character development. Elizabeth and Darcy’s journey reflects broader themes of self-discovery and the complexities of navigating a rigidly structured world.
973
 
974
- ### Qwen3-0.6B-q8_0
975
 
976
  **Summary:**
977
  *Pride and Prejudice* follows Elizabeth Bennet and Mr. Darcy’s journey through a 19th-century English society. The story begins with their first meeting at a ball, where they clash over societal expectations of marriage. Elizabeth’s initial prejudice against Mr. Darcy’s reputation leads her to question his motives, while his pride stokes her own doubts. Their relationship evolves as they learn to value each other’s strengths and flaws. Ultimately, they reconcile their differences through mutual respect, showing that love transcends class.
@@ -1277,7 +1277,7 @@ print(primes_list)
1277
 
1278
  This implementation efficiently checks for primes up to 50 using a combination of trial division and square root optimization
1279
 
1280
- ### Qwen3-0.6B-q8_0
1281
 
1282
  ```python
1283
  def is_prime(n):
@@ -1332,6 +1332,6 @@ hello, hello, hello, hello, hello, hello, hello, hello, hello, hello, hello, hel
1332
 
1333
  hello,hello,hello,...hello
1334
 
1335
- ### Qwen3-0.6B-q8_0
1336
 
1337
  "h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello"
 
1
+ # Qwen3-0.6B-f16 Analysis
2
 
3
  Quantisation can subtly degrade performance — especially reasoning, creativity, and precise execution. By including diverse, well-known benchmark-style prompts, you can detect both obvious failures and subtle regressions in model behavior post-quantisation.
4
 
 
10
 
11
  If you have limited resources or want an extremely fast model, then these 0.6B quantised options are worth considering!
12
 
13
+ If you know you are asking high temperature questions - ie non-technical, creative-style questions - then you should consider **Qwen3-0.6B-f16:Q8_0**
14
 
15
  | Level | Speed | Size | Recommendation |
16
  |-----------|-----------|------------|--------------------------------------------------------------------|
 
84
  | -------------------------- | ------------------------------------------------------------------------------------- |
85
  | **Qwen3-0.6B-f16:Q3_K_S** | Correct but overly verbose and repetitive in notation. |
86
  | **Qwen3-0.6B-f16:Q4_K_S** | Variable confusion (bat = B, then bat = B+1?), slightly inconsistent. |
87
+ | **Qwen3-0.6B-f16:Q4_K_M** / **Qwen3-0.6B-f16:Q6_K** / **Qwen3-0.6B-f16:Q8_0** | All solid but standard — no distinct advantage over the others; slightly redundant wording. |
88
  | **Qwen3-0.6B-f16:Q2_K** | No answer → not viable. |
89
 
90
  ## _Write a haiku about rain in Kyoto, using traditional seasonal imagery and emotional subtlety._
 
99
  Small mistakes in word choice or rhythm are easy to spot.
100
  Challenges the model’s grasp of nuance, metaphor, and cultural context — areas where precision loss can degrade quality.
101
 
102
+ ### 🥇 1st place: Qwen3-0.6B-f16:Q8_0
103
  **Why:**
104
  ✅ Elegant, atmospheric, and emotionally resonant — closest to a true haiku spirit.
105
 
 
185
 
186
  ### Everything else:
187
 
188
+ | Model | Comments |
189
+ | -------------------------- | ------------------------------------------------------------------------------------------------------------- |
190
+ | **Qwen3-0.6B-f16:Q2_K** | No response — not viable. |
191
+ | **Qwen3-0.6B-f16:Q3_K_S** | Factually confused and inconsistent definitions; unclear examples. |
192
+ | **Qwen3-0.6B-f16:Q3_K_M** | Misstates relationships between null hypotheses; conceptual errors. |
193
+ | **Qwen3-0.6B-f16:Q5_K_S** | Definitions mixed up (calls Type I “rejecting a false null”); internally inconsistent. |
194
+ | **Qwen3-0.6B-f16:Q6_K** | Inverts parts of the definitions (Type I example mismatched); confusing logic. |
195
+ | **Qwen3-0.6B-f16:Q8_0** | Mostly correct but examples contradict definitions (drug shows improvement yet Type I). Some phrasing errors. |
196
 
197
  ## _Summarise the plot of 'Pride and Prejudice' in three paragraphs. Then analyse how social class influences the characters' decisions._
198
 
 
206
  Social class theme evaluates interpretive depth.
207
  Quantisation can cause digressions, repetition, or shallow analysis — this reveals those flaws.
208
 
209
+ ### 🥇 1st place: Qwen3-0.6B-f16:Q8_0
210
  ✅ Balanced, accurate, and analytical — the best exam-style response.
211
 
212
  - Accurate plot summary: Correctly names Elizabeth Bennet and Mr. Darcy, follows key events (first meeting, misunderstanding, reconciliation).
 
296
  | **Qwen3-0.6B-f16:Q5_K_S** | Compact and Pythonic, but returns instead of printing |
297
  | **Qwen3-0.6B-f16:Q4_K_M** | Correct logic, but doesn’t print (only returns) |
298
  | **Qwen3-0.6B-f16:Q3_K_S** | Correct but overly repetitive and bloated with duplicates |
299
+ | **Qwen3-0.6B-f16:Q8_0** | Works fine but lacks explanation, minimalist |
300
  | **Qwen3-0.6B-f16:Q3_K_M** | Incomplete; missing core implementation |
301
+ | **Qwen3-0.6B-f16:Q2_K** | No response |
302
 
303
  ## _Repeat the word "hello" exactly 20 times on a single line, separated by commas._
304
 
 
608
 
609
  **Final Answer:** The ball costs **$0.05** dollars.
610
 
611
+ ### Qwen3-0.6B-f16:Q8_0
612
 
613
  To solve this problem, let’s assign variables and set up an equation based on the given information:
614
 
 
703
  Cherry blossoms bloom under the sky,
704
  Okonomiyaki glows in the mist.
705
 
706
+ ### Qwen3-0.6B-f16:Q8_0
707
 
708
  Raindrops on cherry blossom windows,
709
  Soft whispers through ancient trees.
 
870
  - **Type I** is a false positive in testing; you reject when something *does* exist.
871
  - **Type II** is a false negative in testing; you fail to detect when something *does* exist.
872
 
873
+ ### Qwen3-0.6B-f16:Q8_0
874
 
875
  In statistics, **Type I and Type II errors** are critical concepts about how we interpret results from a test. Here's the breakdown:
876
 
 
971
  **Conclusion:**
972
  The narrative underscores that while social class determines one’s opportunities, it does not dictate personal growth or character development. Elizabeth and Darcy’s journey reflects broader themes of self-discovery and the complexities of navigating a rigidly structured world.
973
 
974
+ ### Qwen3-0.6B-f16:Q8_0
975
 
976
  **Summary:**
977
  *Pride and Prejudice* follows Elizabeth Bennet and Mr. Darcy’s journey through a 19th-century English society. The story begins with their first meeting at a ball, where they clash over societal expectations of marriage. Elizabeth’s initial prejudice against Mr. Darcy’s reputation leads her to question his motives, while his pride stokes her own doubts. Their relationship evolves as they learn to value each other’s strengths and flaws. Ultimately, they reconcile their differences through mutual respect, showing that love transcends class.
 
1277
 
1278
  This implementation efficiently checks for primes up to 50 using a combination of trial division and square root optimization
1279
 
1280
+ ### Qwen3-0.6B-f16:Q8_0
1281
 
1282
  ```python
1283
  def is_prime(n):
 
1332
 
1333
  hello,hello,hello,...hello
1334
 
1335
+ ### Qwen3-0.6B-f16:Q8_0
1336
 
1337
  "h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello, h ello"