richard-park
/

llama-3.1-fineweb-edu-1m-Inst

Text Generation

text-generation-inference

Model card Files Files and versions

richard-park commited on Mar 7

Commit

78a91cb

·

verified ·

1 Parent(s): 6998053

#4

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -12,6 +12,7 @@ tags:
 - phase
 <details>
   <summary> hyperparameter in phase</summary>
    - pre1
     ```
     hyperparameter test: rank=16 lr=1e-5 weight_decay=0.01 drop_out=0.1

 - phase
 <details>
   <summary> hyperparameter in phase</summary>
    - pre1
     ```
     hyperparameter test: rank=16 lr=1e-5 weight_decay=0.01 drop_out=0.1