SubtleOne/Rombos-Qwen2.5-Writer-32b

Many thanks to Bartowski for providing GGUF versions of this model.

This model is a merge using Rombos's top-ranked 32b model, based on Qwen 2.5, and merging three creative writing finetunes. The creative content is a serious upgrade over the base it started with, and I enjoyed it in my DnD RPG campaign.

Merge

This is a merge of pre-trained language models created using mergekit.

Merge Method

This model was merged using the DELLA merge method using Rombos-LLM-V2.5-Qwen-32b as a base.

Models Merged

The following models were included in the merge:

• EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
• allura-org/Qwen2.5-32b-RP-Ink
• nbeerbower/Qwen2.5-Gutenberg-Doppel-32B

Configuration

The following YAML configuration was used to produce this model:

base_model: rombodawg/Rombos-LLM-V2.5-Qwen-32b
parameters:
  int8_mask: true
  rescale: false
  normalize: true
dtype: bfloat16
tokenizer_source: union
merge_method: dare_ties
models:
  - model: EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
    parameters:
      weight: [0.4]
      density: [0.55]
  - model: nbeerbower/Qwen2.5-Gutenberg-Doppel-32B
    parameters:
      weight: [0.3]
      density: [0.55]
  - model: allura-org/Qwen2.5-32b-RP-Ink
    parameters:
      weight: [0.4]
      density: [0.55]