We’re officially releasing the quantized models of Qwen3 today!

Now you can deploy Qwen3 via Ollama, LM Studio, SGLang, and vLLM — choose from multiple formats including GGUF, AWQ, and GPTQ for easy local deployment.

Find all models in the Qwen3 collection on Hugging Face and ModelSope.
Hugging Face:https://huggingface.co/collections/Qwen/qwen3-67dd247413f0e2e4f653967f
ModelScope:https://modelscope.cn/collections/Qwen3-9743180bdc6b48

For more usage examples, check out the image below!

https://x.com/Alibaba_Qwen/status/1921907010855125019
We’re officially releasing the quantized models of Qwen3 today! Now you can deploy Qwen3 via Ollama, LM Studio, SGLang, and vLLM — choose from multiple formats including GGUF, AWQ, and GPTQ for easy local deployment. Find all models in the Qwen3 collection on Hugging Face and ModelSope. Hugging Face:https://huggingface.co/collections/Qwen/qwen3-67dd247413f0e2e4f653967f ModelScope:https://modelscope.cn/collections/Qwen3-9743180bdc6b48 📷 For more usage examples, check out the image below! https://x.com/Alibaba_Qwen/status/1921907010855125019
·173 Views ·0 Reviews