N
Nemotron 3.5 Bolt E4B (GGUF Q4_K_M)
NVIDIA · Nemotron 3.5
LLMOpenMDW-1.1publicTrusted8B params
NVIDIA's own llama.cpp GGUF build (Q4_K_M) of Nemotron 3.5 Bolt E4B: one file for Metal, CUDA, ROCm and CPU.
NVIDIA's own llama.cpp GGUF build (Q4_K_M) of Nemotron 3.5 Bolt E4B: one file for Metal, CUDA, ROCm and CPU.
At a glance
- Task: LLM (InferenceV1)
- Params: 8B
- License: OpenMDW-1.1 (commercial use OK)
- Hardware: 7 GB+ VRAM
- dtype: Int4