GGUF
conversational

issue with the model's prompt template

#1
by RochyRoch - opened

Failed to regenerate message
Error rendering prompt with jinja template: "Parser Error: Expected closing statement token. Dot !== CloseStatement.".

This is usually an issue with the model's prompt template. If you are using a popular model, you can try to search the model under lmstudio-community, which will have fixed prompt templates. If you cannot find one, you are welcome to post this issue to our discord or issue tracker on GitHub. Alternatively, if you know how to write jinja templates, you can override the prompt template in My Models > model settings > Prompt Template.

Update to the latest version of LM Studio and runtime extensions in the Runtime page. Also, make sure that the latest llama.cpp for your system is selected for GGUF under My Engines/Engines

Sign up or log in to comment