feihu.hf commited on
Commit
59d33b9
·
2 Parent(s): 665f077 039f298

Merge branch 'main' of hf.co:Qwen/Qwen3-30B-A3B-GPTQ-Int4

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -95,7 +95,7 @@ print("thinking content:", thinking_content)
95
  print("content:", content)
96
  ```
97
 
98
- For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.5` or to create an OpenAI-compatible API endpoint:
99
  - SGLang:
100
  ```shell
101
  python -m sglang.launch_server --model-path Qwen/Qwen3-30B-A3B-GPTQ-Int4 --reasoning-parser qwen3
 
95
  print("content:", content)
96
  ```
97
 
98
+ For deployment, you can use `sglang>=0.4.6.post1` or `vllm==0.8.4` or to create an OpenAI-compatible API endpoint:
99
  - SGLang:
100
  ```shell
101
  python -m sglang.launch_server --model-path Qwen/Qwen3-30B-A3B-GPTQ-Int4 --reasoning-parser qwen3