Update README.md
Browse files
README.md
CHANGED
|
@@ -24,7 +24,7 @@ metrics:
|
|
| 24 |
|
| 25 |
🔗 Github link: [Training code](https://github.com/purbeshmitra/semantic-soft-bootstrapping)
|
| 26 |
|
| 27 |
-
Semantic Soft Bootstrapping (SSB)
|
| 28 |
<p align="center">
|
| 29 |
<img src="assets/ssb.png" alt="Alt Text" width="750">
|
| 30 |
</p>
|
|
|
|
| 24 |
|
| 25 |
🔗 Github link: [Training code](https://github.com/purbeshmitra/semantic-soft-bootstrapping)
|
| 26 |
|
| 27 |
+
Semantic Soft Bootstrapping (SSB) is an RL-free self-distillation framework that improves long-context reasoning in LLMs by training the model on its own hinted reasoning as a teacher. Rather than relying on a separate larger teacher or on-policy gradient with sparse rewards, SSB uses the same base model in two semantic roles: a hinted teacher that sees both correct and incorrect solutions and synthesizes a robust explanation, and a hint-free student that learns to reproduce this behavior from the bare question alone. Starting from a raw problem–answer dataset, we construct paired teacher–student conversations and then precompute teacher logits over the answer tokens, enabling efficient offline distillation without any human annotation or online RL loop. This is depicted as following:
|
| 28 |
<p align="center">
|
| 29 |
<img src="assets/ssb.png" alt="Alt Text" width="750">
|
| 30 |
</p>
|