Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Nemotron-H-4B-Instruct-128K-Q6_K-GGUF – AI Model by sillykiwi | AlphaNeural AI
You can deploy this model and start earning money today!
sillykiwi
/
Nemotron-H-4B-Instruct-128K-Q6_K-GGUF
like
0
transformers
gguf
nvidia
pytorch
llama-cpp
gguf-my-repo
text-generation
en
nvidia/Nemotron-H-4B-Instruct-128K
quantized
other
endpoints_compatible
us
conversational
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
sillykiwi/Nemotron-H-4B-Instruct-128K-Q6_K-GGUF
This model was converted to GGUF format from
nvidia/Nemotron-H-4B-Instruct-128K
using llama.cpp via the ggml.ai's
GGUF-my-repo
space. Refer to the
original model card
for more details on the model.
KoboldCpp gives me errors when loading this. It is possible this quantization is corrupt.