Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
MamayLM-Gemma-3-4B-IT-v1.0-bnb-4bit – AI Model by cybertruck32489 | AlphaNeural AI
You can deploy this model and start earning money today!
cybertruck32489
/
MamayLM-Gemma-3-4B-IT-v1.0-bnb-4bit
like
0
safetensors
gemma3
INSAIT-Institute/MamayLM-Gemma-3-4B-IT-v1.0
quantized
4-bit
bitsandbytes
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This is a converted weight from
MamayLM-Gemma-3-4B-IT-v1.0
model in
unsloth 4-bit dynamic quant
using this
collab notebook
.
About this Conversion
This conversion uses
Unsloth
to load the model in
4-bit
format and force-save it in the same
4-bit
format.
How 4-bit Quantization Works
The actual
4-bit quantization
is handled by
BitsAndBytes (bnb)
, which works under
Torch
via
AutoGPTQ
or
BitsAndBytes
.
Unsloth
acts as a wrapper, simplifying and optimizing the process for better efficiency.
This allows for reduced memory usage and faster inference while keeping the model compact.
