IQ2_M generate garbage
#2
by
AekDevDev
- opened
OH,MY GOD!I'm worried that the downloaded iQ3_xs will be garbage too.
OH,MY GOD!I'm worried that the downloaded iQ3_xs will be garbage too.
Please let us know if it is. Idealy you would test using llama.cpp
OH,MY GOD!I'm worried that the downloaded iQ3_xs will be garbage too.
Please let us know if it is. Idealy you would test using llama.cpp
When he used it to write code, it started repeating infinitely, indicating that the quantization of IQ3XS is unusable.