Support for tools / function calling?
When trying to add tools to request, it returns an error that it does not support tools. AFAIK this is supported in the original model as stated in tech report. Is there any way to fix this?
Can you provide detailed technical details?
Can you provide detailed technical details?
I am running the model using ollama, which has the following description for the model:
Model
architecture qwen3-omni
parameters 16.4B
context length 65536
embedding length 2048
quantization unknown
Capabilities
completion
For comparison, this is for Qwen3 30B A3B:
Model
architecture qwen3moe
parameters 30.5B
context length 262144
embedding length 2048
quantization Q4_K_M
Capabilities
completion
tools
thinking
Parameters
repeat_penalty 1
stop "<|im_start|>"
stop "<|im_end|>"
temperature 0.6
top_k 20
top_p 0.95
License
Apache License
Version 2.0, January 2004
...
So clearly the omni model isn't recognized as a model that supports tools. I guess this will be something related to the template, but I don't know for sure
This is probably because Ollama does not support Qwen3-omni yet.
Right, this is very likely the issue. Thank you for the great work anyway
I strongly recommend you to try the non-GGUF quantized version.
https://huggingface.co/vito95311/Qwen3-Omni-30B-A3B-Thinking-INT8FP16