Q
Qwen3.5-9B (GGUF Q4_K_M + vision)
Alibaba / Qwen (GGUF: unsloth) · Qwen3.5
LLMApache-2.0publicTrusted9B params
llama.cpp GGUF build (Q4_K_M) of Qwen3.5-9B - one artifact runs on Metal, CUDA and CPU; the build the GGUF consensus engine was proven on. Manifest carries the F16 projector, so the entry reads images as well as text.
llama.cpp GGUF build (Q4_K_M) of Qwen3.5-9B - one artifact runs on Metal, CUDA and CPU; the build the GGUF consensus engine was proven on. Manifest carries the F16 projector, so the entry reads images as well as text.
At a glance
- Task: LLM (InferenceV1)
- Params: 9B
- License: Apache-2.0 (commercial use OK)
- Hardware: 7 GB+ VRAM
- dtype: Int4