K quants in non K quants
#13
by
Henk717
- opened
I saw you replaced some of the non K quants with versions with Q5 layers, this introduced a problem as _K isn't compatible with lora loading.
I understand the intent for hybrid quants if Q4_1 performs subpar, but this would have to be done with a non K varient to prevent compatibility issues.