Nemotron 3.5 Bolt E4B (GGUF Q4_K_M)

NVIDIA · Nemotron 3.5
LLMOpenMDW-1.1publicTrusted8B params

NVIDIA's own llama.cpp GGUF build (Q4_K_M) of Nemotron 3.5 Bolt E4B: one file for Metal, CUDA, ROCm and CPU.

NVIDIA's own llama.cpp GGUF build (Q4_K_M) of Nemotron 3.5 Bolt E4B: one file for Metal, CUDA, ROCm and CPU.

At a glance

  • Task: LLM (InferenceV1)
  • Params: 8B
  • License: OpenMDW-1.1 (commercial use OK)
  • Hardware: 7 GB+ VRAM
  • dtype: Int4