tool parser?
#8
by
prudant
- opened
its support function calling with vllm? any config for that?
Kimi Linear is not enhanced by tool calls. However, Kimi Linear can use the same configuration as kimi k2, just specify that the tool parser is kimi_k2.
@zhiyuan8 Wish list for next update :
- Tool call support
- thinking version trained with RL (thinking emulation with system prompt seems to help a bit, so a real thinking model would be great) and kimi-vl-thinking is already partially there
- Quantization Aware Training for better 4bit quality with official 4bit variant
- coding version with more training on aider/opencode/... and agentic use.
- Honestly, it's a good coder, but (using AWQ 4bit) :
- it doesn't always follow instructions in aider for diff-edit. Didn't try other coding cli.
- it fails on generating git diffs sometimes
- Honestly, it's a good coder, but (using AWQ 4bit) :
- when issues are fixed, benchmark it on https://aider.chat/docs/leaderboards/. This gets great visibility, like those posts about K2 performances on X or youtube or on r/LocalLLaMA
- kimi-cli integration
Frankly it works really well, quite good for local coding. Can't run K2 locally, but this is great.
K2 for architecture planning/debuging large codebase and Kimi-Linear as small coder = best combo !
Kimi-Linear is not available on API ? You should add it, it would be a great addition.
exaple of errors I get in aider :
...
> Use `./TODO.md` file. NOT `engine/TODO.md`
----------------------------------------------------------------------------------------
I'll update the TODO.md file with the changes you specified:
engine/TODO.md
...