--- base_model: - Delta-Vector/Rei-V1-32B-Base - allura-org/GLM4-32B-Neon-v2 library_name: transformers tags: - mergekit - merge --- # glm-merge-0-2 This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method. ### Models Merged The following models were included in the merge: * [Delta-Vector/Rei-V1-32B-Base](https://huggingface.co/Delta-Vector/Rei-V1-32B-Base) * [allura-org/GLM4-32B-Neon-v2](https://huggingface.co/allura-org/GLM4-32B-Neon-v2) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: allura-org/GLM4-32B-Neon-v2 - model: Delta-Vector/Rei-V1-32B-Base merge_method: slerp base_model: allura-org/GLM4-32B-Neon-v2 parameters: t: - value: 0.2 dtype: bfloat16 tokenizer_source: base ```