You can deploy this model and start earning money today!

DeepDavid/
gemma-4-e4b-it-qcache-q8

Name: gemma-4-e4b-it-qcache-q8
Rating: 2.5 (105 reviews)

Views

No views yet

gemma-4-e4b-it — Q8_0 weight cache + auxiliary tensors

Quantized deployment artifacts for google/gemma-4-e4b-it.

qcache-q8_0.v1.gguf — GGML Q8_0 tensors for the model's linear projections, stored in a GGUF container keyed by the original checkpoint tensor paths (no metadata KVs). Produced by in-memory quantization of the bf16 checkpoint with a candle-based loader.
aux-tensors.safetensors — everything the cache does not carry: embeddings, norms and other non-projection tensors, in their original dtypes.
Config and tokenizer files are copied unmodified from the base repository.

Format note: this is not a llama.cpp-compatible GGUF — tensors keep their original checkpoint names and only linear projections are quantized. Load it with a runtime that pairs the cache with the auxiliary safetensors.

Weights are redistributed under the same terms as the base model.

DeepDavid/gemma-4-e4b-it-qcache-q8

gemma-4-e4b-it — Q8_0 weight cache + auxiliary tensors

DeepDavid/
gemma-4-e4b-it-qcache-q8