Gemma 4 E2B in MLX format, 8-bit quantized, converted from LetheanNetwork/lemer's bf16 safetensors via mlx_lm.convert. Higher-precision sibling of LetheanNetwork/lemer-mlx (which is 4-bit). For the LEK-merged variant see lthn/lemer.

Variants in this family

Repo	Format	Bits	Use case
`LetheanNetwork/lemer`	safetensors + gguf Q4_K_M	bf16 / 4	Source weights + llama.cpp/Ollama
`LetheanNetwork/lemer-mlx`	mlx	4	Apple Silicon default
`LetheanNetwork/lemer-mlx-8bit`	mlx	8	This repo — higher precision
`LetheanNetwork/lemer-mlx-bf16`	mlx	bf16	Full-precision reference

Usage

python

from mlx_lm import load, generate

model, tokenizer = load("LetheanNetwork/lemer-mlx-8bit")
response = generate(
    model, tokenizer,
    prompt=tokenizer.apply_chat_template(
        [{"role": "user", "content": "Hello"}],
        add_generation_prompt=True,
        enable_thinking=True,
    ),
    max_tokens=512,
)

Provenance

Source: LetheanNetwork/lemer bf16 safetensors (= google/gemma-4-E2B-it)
Converter: mlx_lm.convert (mlx-lm — LM Studio / Apple ML Research)
Quant: 8-bit group quantization, ~8.5 bits/weight effective
License: Apache 2.0 (Gemma Terms of Use)

License

Apache 2.0, subject to the Gemma Terms of Use.