How to stop reasoning?
#16
by
yuchenxie
- opened
I want to use this model as a reasoning and non reasoning model. How do I stop reasoning? /no_think does not work even for glm 4.5 I tried
If you want to disable reasoning, you should add extra_body={"chat_template_kwargs": {"enable_thinking": False}} when using vLLM or sglang.
What about in llama.cpp situation? Having to type /nothink can get tedious sometimes.
What about in llama.cpp situation? Having to type /nothink can get tedious sometimes.
for llama.cpp: --chat-template-kwargs '{"enable_thinking":"False"}'
ZHANGYUXUAN-zR
changed discussion status to
closed