Edit Models filters

Model Tree

nvidia/Nemotron-Mini-4B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

23

Full-text search

Active filters: nvidia/Nemotron-Mini-4B-Instruct

NikolayKozloff/Nemotron-Mini-4B-Instruct-Q8_0-GGUF

4B • Updated Sep 13, 2024 • 25 • 2

bartowski/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Sep 13, 2024 • 1.61k • 15

abiks/Nemotron-Mini-4B-Instruct-GGUF-Q8

4B • Updated Sep 14, 2024 • 7 • 3

second-state/Nemotron-Mini-4B-Instruct-GGUF

4B • Updated Aug 29, 2025 • 486

gaianet/Nemotron-Mini-4B-Instruct-GGUF

4B • Updated Sep 15, 2024 • 141

Felladrin/gguf-Q5_K_L-Nemotron-Mini-4B-Instruct

4B • Updated Sep 16, 2024 • 9

Felladrin/gguf-Q5_K_M-Nemotron-Mini-4B-Instruct

4B • Updated Sep 16, 2024 • 5

Solshine/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF

4B • Updated Sep 18, 2024 • 14

DevQuasar/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Dec 4, 2024 • 73

Triangle104/Nemotron-Mini-4B-Instruct-Q4_0-GGUF

4B • Updated Sep 20, 2024 • 14

WSDW/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF

4B • Updated Sep 30, 2024 • 11

jairo/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF

4B • Updated Oct 5, 2024 • 26

MaziyarPanahi/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Oct 20, 2024 • 215 • 1

nvidia/Nemotron-Mini-4B-Instruct-ONNX-INT4

Updated Nov 18, 2024 • 5

mradermacher/Nemotron-Mini-4B-Instruct-GGUF

4B • Updated Feb 15, 2025 • 218

mradermacher/Nemotron-Mini-4B-Instruct-i1-GGUF

4B • Updated Feb 15, 2025 • 1.1k

performanceoptician/Nemotron-Mini-4B-Instruct-IQ4_NL-GGUF

4B • Updated Nov 26, 2024 • 31

performanceoptician/Nemotron-Mini-4B-Instruct-IQ4_XS-GGUF

4B • Updated Nov 26, 2024 • 5

mitulagr2/gguf-Q5_K_M-Nemotron-Mini-4B-Instruct

4B • Updated Jan 21, 2025 • 49

DevQuasar/nvidia.Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Feb 17, 2025 • 134 • 1

BernTheCreator/Nemotron-Mini-4B-Instruct-Q4_0-GGUF

Text Generation • 4B • Updated Mar 6, 2025 • 12

itlwas/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 19, 2025 • 12

tensorblock/nvidia_Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Jul 9, 2025 • 106