Qwen3.5-9B (GGUF Q4_K_M)

llama.cpp GGUF build (Q4_K_M) of Qwen3.5-9B - one artifact runs on Metal, CUDA and CPU; the build the GGUF consensus engine was proven on.

At a glance

• Task: LLM (InferenceV1)
• Params: 9B
• License: Apache-2.0 (commercial use OK)
• Hardware: 7 GB+ VRAM
• dtype: Int4