mergekit-community
/

mergekit-linear-qtqmpco

Text Generation

text-generation-inference

Model card Files Files and versions

mergekit-linear-qtqmpco / mergekit_config.yml

chargoddard's picture

Upload folder using huggingface_hub

6400b4c verified 11 months ago

history blame contribute delete

255 Bytes

	models:
	- model: Qwen/Qwen2.5-0.5B-Instruct
	parameters:
	weight: 2.0
	- model: Qwen/Qwen2-0.5B-Instruct
	parameters:
	weight: 1.0
	merge_method: linear
	base_model: Qwen/Qwen2.5-0.5B-Instruct
	parameters:
	int8_mask: true
	dtype: bfloat16