Search 3.2M models and datasets…
⌘K
Chat
Models
Datasets
Deploy
Pricing
Docs
Chat
Models
Datasets
Deploy
More
gemma-4-E4B-it-heretic-GGUF – AI Model by Abiray | AlphaNeural AI
You can deploy this model and start earning money today!
Abiray
/
gemma-4-E4B-it-heretic-GGUF
like
0
gguf
llama-cpp
gemma-4
any-to-any
coder3101/gemma-4-E4B-it-heretic
quantized
apache-2.0
endpoints_compatible
us
imatrix
conversational
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
· from $0.17/hr
gemma-4-E4B-it-heretic-GGUF
This repository contains GGUF format quantizations of
coder3101/gemma-4-E4B-it-heretic
.
Quantizations Provided
The following quantization formats have been provided to accommodate various hardware setups:
Q8_0
: Very high quality, near-unquantized performance.
Q6_K
: High quality, excellent balance of size and performance.
Q5_K_M
: Good quality, slightly smaller footprint.
Q4_K_M
: Standard medium quantization, optimal for general use.
Q3_K_M
: Maximum compression for tight VRAM/RAM constraints.
