Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,47 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
datasets:
|
| 4 |
+
- Azure99/blossom-v6.2-sft-stage1
|
| 5 |
+
- Azure99/blossom-v6.2-sft-stage2
|
| 6 |
+
language:
|
| 7 |
+
- zh
|
| 8 |
+
- en
|
| 9 |
+
base_model:
|
| 10 |
+
- Azure99/Blossom-V6.2-14B
|
| 11 |
+
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# **BLOSSOM-V6.2-14B-GGUF**
|
| 15 |
+
|
| 16 |
+
[💻Github](https://github.com/Azure99/BlossomLM) • [🚀Blossom Chat Demo](https://blossom-chat.com/)
|
| 17 |
+
|
| 18 |
+
### Introduction
|
| 19 |
+
|
| 20 |
+
Blossom is a powerful open-source conversational large language model that provides reproducible post-training data, dedicated to delivering an open, powerful, and cost-effective locally accessible general-purpose model for everyone.
|
| 21 |
+
|
| 22 |
+
| Chat Model | Resource | Base Model |
|
| 23 |
+
| ------------------------------------------------------------ | ------------------------------------------------------------ | ----------------- |
|
| 24 |
+
| [Blossom-V6.2-36B](https://huggingface.co/Azure99/Blossom-V6.2-36B) | [Demo](https://huggingface.co/spaces/Azure99/Blossom-V6.2-36B-Demo) [GGUF](https://huggingface.co/Azure99/Blossom-V6.2-36B-GGUF) [Ollama](https://ollama.com/azure99/blossom-v6.2:36b) | Seed-OSS-36B-Base |
|
| 25 |
+
| [Blossom-V6.2-32B](https://huggingface.co/Azure99/Blossom-V6.2-32B) | [Demo](https://huggingface.co/spaces/Azure99/Blossom-V6.2-32B-Demo) [GGUF](https://huggingface.co/Azure99/Blossom-V6.2-32B-GGUF) [Ollama](https://ollama.com/azure99/blossom-v6.2:32b) | Qwen2.5-32B |
|
| 26 |
+
| [Blossom-V6.2-14B](https://huggingface.co/Azure99/Blossom-V6.2-14B) | [Demo](https://huggingface.co/spaces/Azure99/Blossom-V6.2-14B-Demo) [GGUF](https://huggingface.co/Azure99/Blossom-V6.2-14B-GGUF) [Ollama](https://ollama.com/azure99/blossom-v6.2:14b) | Qwen3-14B-Base |
|
| 27 |
+
| [Blossom-V6.2-8B](https://huggingface.co/Azure99/Blossom-V6.2-8B) | [Demo](https://huggingface.co/spaces/Azure99/Blossom-V6.2-8B-Demo) [GGUF](https://huggingface.co/Azure99/Blossom-V6.2-8B-GGUF) [Ollama](https://ollama.com/azure99/blossom-v6.2:8b) | Qwen3-8B-Base |
|
| 28 |
+
|
| 29 |
+
Hint: Across the vast majority of use cases, **Blossom-V6.2-36B** outperforms **Blossom-V6.2-32B**.
|
| 30 |
+
|
| 31 |
+
You can find the training data here: [Blossom-V6.2-SFT-Stage1](https://huggingface.co/datasets/Azure99/blossom-v6.2-sft-stage1) (1 epoch)、[Blossom-V6.2-SFT-Stage2](https://huggingface.co/datasets/Azure99/blossom-v6.2-sft-stage2) (3 epoch).
|
| 32 |
+
|
| 33 |
+
### **Data Synthesis Workflow Overview**
|
| 34 |
+
|
| 35 |
+
Primarily employs three cost-effective models: Deepseek-V3.1, Gemini 2.5 Flash, and Qwen3-235B-A22B-Instruct-2507 (denoted as A, B, C)—to regenerate responses under different scenarios using tailored synthesis strategies.
|
| 36 |
+
|
| 37 |
+
For example:
|
| 38 |
+
|
| 39 |
+
- In objective scenarios like mathematics (where answers are unique), Model A first generates responses as a "teacher." If reference answers exist in the source data, Model B verifies the correctness of A's responses against them. If no reference answers exist, Model C generates a second response, and Model B checks consistency between A and C's outputs. Inconsistent responses are filtered out.
|
| 40 |
+
- For subjective scenarios, three models cross-evaluate each other. For instance, Models A and B generate responses to a question, and Model C evaluates which is better. The superior response may be retained as training data or used for preference data construction. To mitigate model bias, roles (respondent/evaluator) are randomly assigned to A, B, and C in each instance.
|
| 41 |
+
|
| 42 |
+
Additional rule-based filtering is applied, such as:
|
| 43 |
+
|
| 44 |
+
- N-Gram filtering to remove data with many repetitions.
|
| 45 |
+
- Discarding questions containing toxic content that triggers teacher model refusals.
|
| 46 |
+
|
| 47 |
+
Further technical details will be released in the future. The data is synthesized by the [🌸BlossomData](https://github.com/Azure99/BlossomData) framework.
|