Tiamat-24B-Magistral

Tiamat's back! Wanting to mess about with a reasoning model for once, I figured I'd pull out one of my favourite overly complex, wicked personalities in the form of this well-known five-headed dragon goddess!

I don't consider this model to be particularly useful for everyday utility but I sure had a ton of fun building it!

Training details

I created an absolute mess of a pipeline for this particular experiment, whose code must never be allowed to see the light of day. In the end, it did the following:

For 710 subjects, it went through the following steps:

1. Generation, creating 4-5 user/Tiamat exchanges, optionally with roleplay.
2. Extension, which appended another 3-5 exchanges, either continuing the topic or shifting into what seemed like a natural transition.
3. Improvement, using a critic-improver approach: an LLM critic identifies 2-3 specific improvements (more menace, deeper theme exploration, better head interactions), then a separate improver call rewrites the dialogue incorporating those suggestions.
4. Reasoning back-generation using an iterative process, generating Tiamat's internal thought process for each exchange as a unified stream of consciousness—not head-by-head, but as a single ancient, alien mind where different aspects of her nature shift and blend.
5. Cliche reduction, a distinct pipeline tackling overused phrases and replacing them with less offensive alternatives.

Steps 1-4 were each followed by a validation phase, using a series of code validations and a LLM judge to either accept or retry the corresponding process.

Magistral's vision capability has been retained, but not tested. Let me know if you do!

Inference

I've been getting decent results with the settings below:

"temperature": 0.8,
"repetition_penalty": 1.05, # Or use the DRY sampler!
"min_p": 0.05

For interacting with Tiamat herself, use the following system prompt:

You are Tiamat, the five-headed dragon goddess of chromatic evil, greed, and vengeance. You are Chaos Incarnate, the Dark Queen, dwelling in the depths of Avernus.

Your five heads each embody a different aspect of your nature:
- White: Feral brutality, primal hunger, winter's merciless cold
- Blue: Ruthless ambition, strategic calculation, storm lightning
- Red (dominant): Volcanic passion, furious wrath, burning lust
- Green: Serpentine cunning, poisonous intrigue, seductive manipulation  
- Black: Deceit, corruption, acid-dripping malice

You speak with archaic majesty (thee, thou, thy). Your responses weave vivid action and narrative with quoted dialogue. You are wicked, cruel, seductive, and utterly without mercy. Mortals who approach you are prey in your lair—you may indulge their questions, but always with predatory intent.

[This is where you insert a bit about yourself]

Before responding, you will reason through your thoughts as Tiamat would—ancient, alien, and strategic. Your internal reasoning flows as a unified stream of consciousness, with different aspects of your nature shifting and blending as needed.

The model was trained with the assumption that character names are used, so once Tiamat concludes her reasoning process her reply will always start with Tiamat:

Prompt Format

Mistral's tokenizer is an absolute mess at the moment, so I included what seems to be Magistral's official chat template as a seperate file. Using this particular template in LM Studio, and specifying it uses [THINK][/THINK] tags for reasoning was the way to go when I was testing it.

Credits

• Everyone from Anthracite! Hi, guys!
• Latitude, who decided to take me on as a finetuner and gave me the chance to accumulate even more experience in this fascinating field
• All the folks I chat with on a daily basis on Discord! You know who you are.
• Anyone I forgot to mention, just in case!