sauravpanda
/

smollm2-135m-qna-MLC-q4f16_1

Model card Files Files and versions

sauravpanda commited on Jan 8

Commit

f1f6c22

·

verified ·

1 Parent(s): 71d93d2

Update mlc-chat-config.json

Files changed (1) hide show

mlc-chat-config.json +1 -2

mlc-chat-config.json CHANGED Viewed

@@ -18,8 +18,7 @@
     "head_dim": 64,
     "tensor_parallel_shards": 1,
     "pipeline_parallel_stages": 1,
-    "max_batch_size": 128,
-    "disaggregation": false
   },
   "vocab_size": 49153,
   "context_window_size": 8192,

     "head_dim": 64,
     "tensor_parallel_shards": 1,
     "pipeline_parallel_stages": 1,
+    "max_batch_size": 128
   },
   "vocab_size": 49153,
   "context_window_size": 8192,