|
|
--- |
|
|
base_model: |
|
|
- LiquidAI/LFM2-1.2B |
|
|
tags: |
|
|
- text-generation-inference |
|
|
- transformers |
|
|
- unsloth |
|
|
- lfm2 |
|
|
license: apache-2.0 |
|
|
language: |
|
|
- en |
|
|
datasets: |
|
|
- miriad/miriad-4.4M |
|
|
--- |
|
|
|
|
|
# 🦷 DentaInstruct-1.2B |
|
|
|
|
|
<img src="banner.png" width="800" /> |
|
|
|
|
|
**DentaInstruct-1.2B** is a fine-tuned instruction-following language model designed to assist with dental domain queries. It was trained using clinically focused questions and answers from the [`miriad/miriad-4.4M`](https://huggingface.co/datasets/miriad/miriad-4.4M) dataset, specifically filtered for the `Dental & Oral Medicine` specialty. The base model used is [`LiquidAI/LFM2-1.2B`](https://huggingface.co/LiquidAI/LFM2-1.2B), optimized with the [Unsloth](https://github.com/unslothai/unsloth) fine-tuning library. |
|
|
|
|
|
--- |
|
|
|
|
|
## Model Details |
|
|
|
|
|
- **Architecture**: LFM2-1.2B (decoder-only transformer) |
|
|
- **Base Model**: [`LiquidAI/LFM2-1.2B`](https://huggingface.co/LiquidAI/LFM2-1.2B) |
|
|
- **Fine-tuning Library**: [Unsloth](https://github.com/unslothai/unsloth) |
|
|
- **Instruction Format**: Chat-style, formatted using `apply_chat_template` |
|
|
- **Trained On**: Dental subset of [`miriad-4.4M`](https://huggingface.co/datasets/miriad/miriad-4.4M) |
|
|
- **Compute**: Trained using Google Colab T4 (free tier) |
|
|
|
|
|
--- |
|
|
|
|
|
## Benchmark Summary |
|
|
|
|
|
The model was evaluated on a curated set of dental prompts with rich terminology across endodontics, periodontics, prosthodontics, and oral surgery. Responses were assessed for fluency, accuracy, and domain relevance. |
|
|
|
|
|
- ✅ **Terminology Handling**: Excellent coverage of dental-specific terms |
|
|
- ✅ **Instruction Following**: Clear, context-aware responses |
|
|
- ✅ **Answer Structure**: Consistently professional and clinically coherent |
|
|
- ⚠️ **Minor Hallucinations**: A few outputs demonstrated factual drift in rare cases |
|
|
|
|
|
--- |
|
|
|
|
|
## Limitations & Warnings |
|
|
|
|
|
This model was fine-tuned using the MIRIAD dataset, which comes with the following caution: |
|
|
|
|
|
> *This model is trained on data that has not been manually reviewed by medical experts. It should not be used for diagnostic purposes or to inform medical decision-making. It is intended for research and educational purposes only.* |
|
|
|
|
|
- **Not a substitute for professional dental care** |
|
|
- **Do not use this model for clinical diagnosis or treatment advice** |
|
|
|
|
|
--- |
|
|
|
|
|
## Intended Use |
|
|
|
|
|
- Educational Q&A for dental students |
|
|
- Conversational chatbots focused on oral health |
|
|
- Research on clinical-domain instruction tuning |
|
|
|
|
|
--- |
|
|
|
|
|
## Citation |
|
|
|
|
|
If you use this model or parts of it, please consider citing: |
|
|
|
|
|
```bibtex |
|
|
@misc{miriad2024, |
|
|
title={MIRIAD: Medical Instructional Record with Interactions and Answers Dataset}, |
|
|
author={Xue, Yutong and others}, |
|
|
year={2024}, |
|
|
url={https://huggingface.co/datasets/miriad/miriad-4.4M} |
|
|
} |
|
|
```` |
|
|
|
|
|
--- |
|
|
|
|
|
## Acknowledgements |
|
|
|
|
|
* [LiquidAI](https://huggingface.co/LiquidAI) for the LFM2 model series |
|
|
* [Unsloth](https://github.com/unslothai/unsloth) for training acceleration |
|
|
* [MIRIAD authors](https://huggingface.co/datasets/miriad/miriad-4.4M) for the publicly available medical dataset |
|
|
|
|
|
--- |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth) |
