KQ_Omni-12B-v1 / README.md
kainatq's picture
Upload folder using huggingface_hub
b672917 verified
metadata
library_name: transformers
license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
base_model:
  - mistralai/Mistral-Nemo-Base-2407
  - shisa-ai/shisa-v2-mistral-nemo-12b
  - EpistemeAI2/Fireball-Mistral-Nemo-12B-Philos
  - nbeerbower/Denker-mistral-nemo-12B

KQ_Omni-12B-v1

KQ_Omni-12B-v1 is a merge of the following models using mergekit:

🧩 Configuration

merge_method: model_stock
base_model: kainatq/Kinggaroo-12b-v2
parameters:
models:
  - model: mistralai/Mistral-Nemo-Base-2407
  - model: shisa-ai/shisa-v2-mistral-nemo-12b
  - model: EpistemeAI2/Fireball-Mistral-Nemo-12B-Philos
  - model: nbeerbower/Denker-mistral-nemo-12B
dtype: bfloat16