Text-to-Speech
GGUF
audio
speech
speech-language-models
imatrix
conversational

vram

#1
by SUP3RMASS1VE - opened

is it normal to use 24gb vram during generatin using q4gguf?

Nevermind. i was using 11 seconds audio. trimmed it down to 7 seconds and its now using around 15gb

Sign up or log in to comment