N
Nemotron 3.5 Bolt 74B-A9B (GGUF UD-Q4_K_XL + vision)
NVIDIA (GGUF: unsloth) · Nemotron 3.5
LLMOpenMDW-1.1publicTrusted75B params
llama.cpp GGUF build (Unsloth Dynamic Q4_K_XL) of Nemotron 3.5 Bolt, 74B MoE with 9B active. The BF16 vision projector reads images.
llama.cpp GGUF build (Unsloth Dynamic Q4_K_XL) of Nemotron 3.5 Bolt, 74B MoE with 9B active. The BF16 vision projector reads images.
At a glance
- Task: LLM (InferenceV1)
- Params: 75B
- License: OpenMDW-1.1 (commercial use OK)
- Hardware: 58 GB+ VRAM
- dtype: Int4