Nemotron 3.5 Lightning 30B-A3B (FP8)

NVIDIA / Red Hat AI · Nemotron 3.5
LLMOpenMDW-1.1publicTrusted32B params

FP8 build of Nemotron 3.5 Lightning 30B-A3B by Red Hat AI.

FP8 build of Nemotron 3.5 Lightning 30B-A3B by Red Hat AI.

At a glance

  • Task: LLM (InferenceV1)
  • Params: 32B
  • License: OpenMDW-1.1 (commercial use OK)
  • Hardware: 36 GB+ VRAM
  • dtype: Fp8