Missing parameters?
Hi, just wanted to create an MLX version of the model, received the following error message:
Error: Received 210 parameters not in model: model.layers.26.eh_proj.weight, model.layers.26.embed_tokens.weight, model.layers.26.enorm.weight, model.layers.26.hnorm.weight, model.layers.26.input_layernorm.weight, model.layers.26.mlp.experts.0.down_proj.weight, model.layers.26.mlp.experts.0.gate_proj.weight, model.layers.26.mlp.experts.0.up_proj.weight, model.layers.26.mlp.experts.1.down_proj.weight, model.layers.26.mlp.experts.1.gate_proj.weight, model.layers.26.mlp.experts.1.up_proj.weight, model.layers.26.mlp.experts.10.down_proj.weight, model.layers.26.mlp.experts.10.gate_proj.weight, model.layers.26.mlp.experts.10.up_proj.weight, model.layers.26.mlp.experts.11.down_proj.weight, model.layers.26.mlp.experts.11.gate_proj.weight, model.layers.26.mlp.experts.11.up_proj.weight, model.layers.26.mlp.experts.12.down_proj.weight, model.layers.26.mlp.experts.12.gate_proj.weight, model.layers.26.mlp.experts.12.up_proj.weight, model.layers.26.mlp.experts.13.down_proj.weight,
...and so on. Could you please have a look at this? Thanks ✌️
Hi! This is MTP block, you can ignore it (or drop it) in convert