Model
| File | Size | Download |
|---|---|---|
| .gitattributes | 4.7 KB | Download |
| BF16/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16-00001-of-00004.gguf | 7.5 MB | Download |
| BF16/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16-00002-of-00004.gguf | 46 GB | Download |
| BF16/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16-00003-of-00004.gguf | 46 GB | Download |
| BF16/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16-00004-of-00004.gguf | 46 GB | Download |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-IQ2_XXS.gguf | 21 GB | Download |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-IQ1_M.gguf | 19 GB | Download |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-IQ1_S.gguf | 17 GB | Download |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-IQ2_M.gguf | 23 GB | Download |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-IQ2_XXS.gguf | 21 GB | Download |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-IQ3_XXS.gguf | 29 GB | Download |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-Q2_K_XL.gguf | 27 GB | Download |
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-Q3_K_XL.gguf | 36 GB | Download |
| Q8_0/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-Q8_0-00001-of-00003.gguf | 7.5 MB | Download |
| Q8_0/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-Q8_0-00002-of-00003.gguf | 46 GB | Download |
| Q8_0/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-Q8_0-00003-of-00003.gguf | 27 GB | Download |
| README.md | 77 KB | Download |
| UD-Q4_K_XL/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-Q4_K_XL-00001-of-00003.gguf | 7.5 MB | Download |
| UD-Q4_K_XL/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-Q4_K_XL-00002-of-00003.gguf | 46 GB | Download |
| UD-Q4_K_XL/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-Q4_K_XL-00003-of-00003.gguf | 655 MB | Download |
| UD-Q5_K_XL/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-Q5_K_XL-00001-of-00003.gguf | 7.5 MB | Download |
| UD-Q5_K_XL/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-Q5_K_XL-00002-of-00003.gguf | 46 GB | Download |
| UD-Q5_K_XL/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-Q5_K_XL-00003-of-00003.gguf | 8.7 GB | Download |
| UD-Q6_K_XL/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-Q6_K_XL-00001-of-00003.gguf | 7.5 MB | Download |
| UD-Q6_K_XL/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-Q6_K_XL-00002-of-00003.gguf | 47 GB | Download |
| UD-Q6_K_XL/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-UD-Q6_K_XL-00003-of-00003.gguf | 21 GB | Download |
| dflash-NVIDIA-Nemotron-3.5-Bolt-74B-A9B-NVFP4.gguf | 952 MB | Download |
| mmproj-BF16.gguf | 1.6 GB | Download |
