https://huggingface.co/nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16
#2664
by sinni80 - opened
This appeared recently and nobody seems to have any quants on it yet 🙏️
The tree at least doesn't have any. It seems like an ideal down size of Nemotron for 128gb devices like Strix Halo because at 9B active...
Anyway, thanks in advance!
It's queued!
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16-GGUF for quants to appear.
No llamacpp support yet. remind me in a few days please
Many thanks!
Also I really didn't realize Llama didn't have it yet, so we'll see, oops.