AKT-caption-lfm2-350m-GGUF - GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Available Model files:

  • AKT-caption-v0.1-LFM2-350M_Q5_K_M.gguf
  • AKT-caption-v0.1-LFM2-350M_Q8_0.gguf
  • AKT-caption-v0.1-LFM2-350M_Q4_K_M.gguf

Perpose

This model was finetuned for summarizing user activity based on AKT log data.

Note

The model's BOS token behavior was adjusted for GGUF compatibility.

Downloads last month
482
GGUF
Model size
0.4B params
Architecture
lfm2
Hardware compatibility
Log In to view the estimation

4-bit

5-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Japan-AI-Consulting/AKT-caption-v0.1-lfm2-350m-gguf