Granite Switch 4.1 30B (GGUF Q8_0)

IBM · Granite
LLMApache-2.0publicTrusted30B params

IBM's own llama.cpp GGUF build (Q8_0) of Granite Switch 4.1 30B.

IBM's own llama.cpp GGUF build (Q8_0) of Granite Switch 4.1 30B.

At a glance

  • Task: LLM (InferenceV1)
  • Params: 30B
  • License: Apache-2.0 (commercial use OK)
  • Hardware: 38 GB+ VRAM
  • dtype: Int8