Hugging Face's logo

dnhkng
/
RYS-Gemma-2-27b-it

Safetensors
gemma2
Model card Files
xet
Community
1
dnhkng commited on
Commit
ecc6d96
·
verified ·
1 Parent(s): a7596cf

Upload config.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. config.json +1 -1
config.json CHANGED
@@ -18,7 +18,7 @@
18
  "max_position_embeddings": 8192,
19
  "model_type": "gemma2",
20
  "num_attention_heads": 32,
21
- "num_hidden_layers": 50,
22
  "num_key_value_heads": 16,
23
  "pad_token_id": 0,
24
  "query_pre_attn_scalar": 144,
 
18
  "max_position_embeddings": 8192,
19
  "model_type": "gemma2",
20
  "num_attention_heads": 32,
21
+ "num_hidden_layers": 56,
22
  "num_key_value_heads": 16,
23
  "pad_token_id": 0,
24
  "query_pre_attn_scalar": 144,