nvidia/Nemotron-Cascade-2-30B-A3B
Text Generation • 32B • Updated • 3.31k • 199
Maik Göken
Plugyy
AI & ML interests
None yet
Recent Activity
liked a model 3 days ago
nvidia/Nemotron-Cascade-2-30B-A3B upvoted a changelog 4 days ago
Hugging Face Papers for AI Agents upvoted a collection 8 days ago
Cerebras REAPOrganizations
None yet
liked a
model 3 days ago
upvoted a changelog 4 days ago
Hugging Face Changelog
Hugging Face Papers for AI Agents
• 109
upvoted a collection 8 days ago
liked 2
models 21 days ago
liked a
model about 1 month ago
upvoted an article 2 months ago
Article
Introducing Falcon H1R 7B
•
58
liked 5
models 3 months ago
mistralai/Devstral-2-123B-Instruct-2512
125B • Updated • 57.7k • 305
Nanbeige/Nanbeige4-3B-Thinking-2511
Text Generation • 4B • Updated • 4.74k • 200
mistralai/Ministral-3-8B-Instruct-2512
9B • Updated • 95.4k • 156
mistralai/Ministral-3-3B-Instruct-2512
Updated • 137k • 208
mistralai/Devstral-Small-2-24B-Instruct-2512
24B • Updated • 322k • 557
liked 3
models 4 months ago
upvoted a collection 4 months ago
upvoted an article 5 months ago
Article
Granite 4.0 Nano: Just how small can you go?
•
123
liked 2
models 9 months ago
reactedto bartowski's post with 🤗 9 months ago
Post
101807
Was going to post this on /r/LocalLLaMa, but apparently it's without moderation at this time :')
bartowski/mistralai_Mistral-Small-3.2-24B-Instruct-2506-GGUF
Was able to use previous mistral chat templates, some hints from Qwen templates, and Claude to piece together a seemingly working chat template, tested it with llama.cpp server and got perfect results, though lmstudio still seems to be struggling for some reason (don't know how to specify a jinja file there)
Outlined the details of the script and results in my llama.cpp PR to add the jinja template:
https://github.com/ggml-org/llama.cpp/pull/14349
Start server with a command like this:
and it should be perfect! Hoping it'll work for ALL tools if lmstudio gets an update or something, not just llama.cpp, but very happy to see it works flawlessly in llama.cpp
In the meantime, will try to open a PR to minja to make the strftime work, but no promises :)
bartowski/mistralai_Mistral-Small-3.2-24B-Instruct-2506-GGUF
Was able to use previous mistral chat templates, some hints from Qwen templates, and Claude to piece together a seemingly working chat template, tested it with llama.cpp server and got perfect results, though lmstudio still seems to be struggling for some reason (don't know how to specify a jinja file there)
Outlined the details of the script and results in my llama.cpp PR to add the jinja template:
https://github.com/ggml-org/llama.cpp/pull/14349
Start server with a command like this:
./llama-server -m /models/mistralai_Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf --jinja --chat-template-file /models/Mistral-Small-3.2-24B-Instruct-2506.jinjaand it should be perfect! Hoping it'll work for ALL tools if lmstudio gets an update or something, not just llama.cpp, but very happy to see it works flawlessly in llama.cpp
In the meantime, will try to open a PR to minja to make the strftime work, but no promises :)