YAML Metadata Warning: The pipeline tag "text2text-generation" is not in the official list: text-classification, token-classification, table-question-answering, question-answering, zero-shot-classification, translation, summarization, feature-extraction, text-generation, fill-mask, sentence-similarity, text-to-speech, text-to-audio, automatic-speech-recognition, audio-to-audio, audio-classification, audio-text-to-text, voice-activity-detection, depth-estimation, image-classification, object-detection, image-segmentation, text-to-image, image-to-text, image-to-image, image-to-video, unconditional-image-generation, video-classification, reinforcement-learning, robotics, tabular-classification, tabular-regression, tabular-to-text, table-to-text, multiple-choice, text-ranking, text-retrieval, time-series-forecasting, text-to-video, image-text-to-text, visual-question-answering, document-question-answering, zero-shot-image-classification, graph-ml, mask-generation, zero-shot-object-detection, text-to-3d, image-to-3d, image-feature-extraction, video-text-to-text, keypoint-detection, visual-document-retrieval, any-to-any, video-to-video, other

eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO - GGUF

This repo contains GGUF format model files for eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO.

The files were quantized using machines provided by TensorBlock, and they are compatible with llama.cpp as of commit b5165.

Our projects

Forge

An OpenAI-compatible multi-provider routing layer.
🚀 Try it now! 🚀
Awesome MCP Servers	TensorBlock Studio

A comprehensive collection of Model Context Protocol (MCP) servers.	A lightweight, open, and extensible multi-LLM interaction studio.
👀 See what we built 👀	👀 See what we built 👀

Prompt template

Unable to determine prompt format automatically. Please check the original model repository for the correct prompt format.

Model file specification

Filename	Quant type	File Size	Description
ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-Q2_K.gguf	Q2_K	2.719 GB	smallest, significant quality loss - not recommended for most purposes
ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-Q3_K_S.gguf	Q3_K_S	3.165 GB	very small, high quality loss
ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-Q3_K_M.gguf	Q3_K_M	3.519 GB	very small, high quality loss
ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-Q3_K_L.gguf	Q3_K_L	3.822 GB	small, substantial quality loss
ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-Q4_0.gguf	Q4_0	4.109 GB	legacy; small, very high quality loss - prefer using Q3_K_M
ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-Q4_K_S.gguf	Q4_K_S	4.140 GB	small, greater quality loss
ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-Q4_K_M.gguf	Q4_K_M	4.368 GB	medium, balanced quality - recommended
ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-Q5_0.gguf	Q5_0	4.998 GB	legacy; medium, balanced quality - prefer using Q4_K_M
ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-Q5_K_S.gguf	Q5_K_S	4.998 GB	large, low quality loss - recommended
ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-Q5_K_M.gguf	Q5_K_M	5.131 GB	large, very low quality loss - recommended
ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-Q6_K.gguf	Q6_K	5.942 GB	very large, extremely low quality loss
ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-Q8_0.gguf	Q8_0	7.696 GB	very large, extremely low quality loss - not recommended

Downloading instruction

Command line

Firstly, install Huggingface Client

pip install -U "huggingface_hub[cli]"

Then, downoad the individual model file the a local directory

huggingface-cli download tensorblock/eren23_ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-GGUF --include "ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-Q2_K.gguf" --local-dir MY_LOCAL_DIR

If you wanna download multiple model files with a pattern (e.g., *Q4_K*gguf), you can try:

huggingface-cli download tensorblock/eren23_ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'

Downloads last month: 12

GGUF

Model size

7B params

Architecture

llama

Hardware compatibility

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Model tree for tensorblock/eren23_ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-GGUF

Base model

eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO

Quantized

(3)

this model

Dataset used to train tensorblock/eren23_ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-GGUF

Evaluation results

normalized accuracy on AI2 Reasoning Challenge (25-Shot)
test set Open LLM Leaderboard

73.120
normalized accuracy on HellaSwag (10-Shot)
validation set Open LLM Leaderboard

89.090
accuracy on MMLU (5-Shot)
test set Open LLM Leaderboard

64.800
mc2 on TruthfulQA (0-shot)
validation set Open LLM Leaderboard

77.450
accuracy on Winogrande (5-shot)
validation set Open LLM Leaderboard

84.770
accuracy on GSM8k (5-shot)
test set Open LLM Leaderboard

69.450

View on Papers With Code