Hugging Face's logo

EddyGiusepe
/
tinyllama-aira_Chatbot-lora

Text Generation
Transformers
TensorBoard
Safetensors
llama
trl
sft
Generated from Trainer
text-generation-inference
Model card Files
xet
Metrics Community
EddyGiusepe commited on
Commit
38e187c
·
verified ·
1 Parent(s): 0d3200f

End of training

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -34,14 +34,14 @@ More information needed
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
- - learning_rate: 0.0002
38
  - train_batch_size: 2
39
  - eval_batch_size: 2
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: cosine
43
  - lr_scheduler_warmup_ratio: 0.03
44
- - training_steps: 300
45
  - mixed_precision_training: Native AMP
46
 
47
  ### Training results
 
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
+ - learning_rate: 2e-05
38
  - train_batch_size: 2
39
  - eval_batch_size: 2
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: cosine
43
  - lr_scheduler_warmup_ratio: 0.03
44
+ - training_steps: 1000
45
  - mixed_precision_training: Native AMP
46
 
47
  ### Training results