Upload folder using huggingface_hub
Browse files
README.md
CHANGED
|
@@ -169,7 +169,7 @@ print("content:", content)
|
|
| 169 |
For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.5` or to create an OpenAI-compatible API endpoint:
|
| 170 |
- SGLang:
|
| 171 |
```shell
|
| 172 |
-
python -m sglang.launch_server --model-path Qwen/Qwen3-235B-A22B-Thinking-2507 --tp 8 --context-length 262144 --reasoning-parser
|
| 173 |
```
|
| 174 |
- vLLM:
|
| 175 |
```shell
|
|
|
|
| 169 |
For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.5` or to create an OpenAI-compatible API endpoint:
|
| 170 |
- SGLang:
|
| 171 |
```shell
|
| 172 |
+
python -m sglang.launch_server --model-path Qwen/Qwen3-235B-A22B-Thinking-2507 --tp 8 --context-length 262144 --reasoning-parser deepseek-r1
|
| 173 |
```
|
| 174 |
- vLLM:
|
| 175 |
```shell
|