Granite Switch 4.1 8B (GGUF Q8_0)

IBM · Granite
LLMApache-2.0publicTrusted8.8B params

IBM's own llama.cpp GGUF build (Q8_0) of Granite Switch 4.1 8B.

IBM's own llama.cpp GGUF build (Q8_0) of Granite Switch 4.1 8B.

At a glance

  • Task: LLM (InferenceV1)
  • Params: 8.8B
  • License: Apache-2.0 (commercial use OK)
  • Hardware: 12 GB+ VRAM
  • dtype: Int8