Layer-wise quantization Q5_K_M

Layer-wise quantization Q5_K_S

Layer-wise quantization Q6_K

Layer-wise quantization Q8_0

Update README.md

Add GGUF internal file structure

Generate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores

Layer-wise quantization IQ3_M

Layer-wise quantization IQ3_S

Layer-wise quantization IQ4_NL

Layer-wise quantization Q3_K_L

Layer-wise quantization Q3_K_M

Layer-wise quantization Q3_K_S

Layer-wise quantization Q4_K_M

Layer-wise quantization Q4_K_S

Layer-wise quantization Q5_K_M

Layer-wise quantization Q5_K_S

Layer-wise quantization Q6_K

Layer-wise quantization Q8_0

Generate base model logits

Convert safetensor to GGUF @ F16

Generate imatrices

Add .gitignore

Update .gitattributes

initial commit