Tech AI LatestNVIDIA details Nemotron 3.5 Super and Lightning, open hybrid Mamba MoE models for agents
NVIDIA's report on Nemotron 3.5 Super (120B, 12B active) and Lightning (30B, 3B active) explains how the open hybrid Mamba-Transformer models were trained.
Summary
NVIDIA published the technical report for Nemotron 3.5 Super and Nemotron 3.5 Lightning on arXiv on 28 October 2026. Super is a 120B-parameter multimodal model with 12B active parameters; Lightning is a 30B text model with 3B active. Both are open mixture-of-experts models that mix Mamba and Transformer layers. NVIDIA reports 51.78% on SWE-bench Pro for Super and releases base, BF16 and NVFP4 checkpoints, datasets and recipes under OpenMDW 1.1.