Qwen3.5-9B (GGUF Q4_K_M + vision)

Alibaba / Qwen (GGUF: unsloth) · Qwen3.5
LLMApache-2.0publicTrusted9B params

llama.cpp GGUF build (Q4_K_M) of Qwen3.5-9B - one artifact runs on Metal, CUDA and CPU; the build the GGUF consensus engine was proven on. Manifest carries the F16 projector, so the entry reads images as well as text.

llama.cpp GGUF build (Q4_K_M) of Qwen3.5-9B - one artifact runs on Metal, CUDA and CPU; the build the GGUF consensus engine was proven on. Manifest carries the F16 projector, so the entry reads images as well as text.

At a glance

  • Task: LLM (InferenceV1)
  • Params: 9B
  • License: Apache-2.0 (commercial use OK)
  • Hardware: 7 GB+ VRAM
  • dtype: Int4