reedmayhew commited on
Commit
8d73598
·
verified ·
1 Parent(s): ff98bdc

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +33 -0
README.md ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: unsloth/gemma-3-4b-it
3
+ tags:
4
+ - text-generation-inference
5
+ - transformers
6
+ - unsloth
7
+ - gemma3
8
+ license: apache-2.0
9
+ language:
10
+ - en
11
+ datasets:
12
+ - reedmayhew/Grok-3-reasoning-100x
13
+ ---
14
+
15
+ # xAI Grok 3 w/Reasoning
16
+ Distilled - Gemma 3 4B
17
+
18
+ ## Overview
19
+ This model is a Gemma 3 4B variant distilled from xAI’s Grok 3, with reasoning. It was fine-tuned to emulate Grok’s depth and structured clarity, particularly in tasks involving complex thought, such as problem-solving, coding, and mathematics.
20
+
21
+ ## Technical Details
22
+ - **Developed by:** reedmayhew
23
+ - **Base Model:** google/gemma-3-4b-it
24
+ - **Training Speed Enhancement:** Trained 2x faster with Unsloth and Huggingface's TRL library
25
+
26
+ ## Training Data
27
+ The model was trained on:
28
+ - reedmayhew/Grok-3-reasoning-100x
29
+
30
+ This dataset consists of 100 high-quality Grok 3 completions with reasoning responding to deep questions, solving math problems, and writing or analyzing code. The aim was to distill Grok’s analytical approach and technical versatility into a smaller, accessible model.
31
+
32
+ This Gemma model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
33
+ [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)