Views
No views yet
config.json.google/gemma-4-31B-it; Pearl is this checkpoint.| Model | GPQA | MMLU | HumanEval (pass@1) | MGSM3 | MMMU-Pro Vision* | Video-MME (short) |
|---|---|---|---|---|---|---|
| Original | 77.27% | 90.93% | 94.70% | 88.62% | 54.57% | 79.0% |
| Pearl | 77.37% | 90.56% | 94.15% | 89.09% | 54.45% | 78.2% |
mmmu_pro_vision, direct-answer prompting, max_new_tokens=256, full test set (1730 samples). Google reports 76.9% on MMMU Pro in the Gemma 4 model card; they do not publish the eval recipe for that figure (prompting, subset, or aggregation).pearld node (RPC), pearl-gateway, and the vLLM miner build that loads the Pearl plugin (NoisyGEMM / gateway integration). Details are in the miner README.pearld with RPC enabled.uv, CUDA + NVIDIA GPU (see miner docs for supported architectures)pearld with RPC credentials for the gatewaydocker buildx build -t vllm_miner . -f miner/vllm-miner/Dockerfile1docker run --rm -it --gpus all \
2 -p 8000:8000 -p 8337:8337 -p 8339:8339 \
3 -e PEARLD_RPC_URL=<PEARLD_URL> \
4 -e PEARLD_RPC_USER=<RPC_USER> \
5 -e PEARLD_RPC_PASSWORD=<RPC_PASSWORD> \
6 -v ~/.cache/huggingface:/root/.cache/huggingface \
7 --shm-size 8g \
8 vllm_miner:latest \
9 pearl-ai/Gemma-4-31B-it-pearl \
10 --host 0.0.0.0 --port 8000 \
11 --max-model-len 8192 \
12 --gpu-memory-utilization 0.9 \
13 --enforce-eager1uv run vllm serve pearl-ai/Gemma-4-31B-it-pearl \
2 --host 0.0.0.0 \
3 --port 8000 \
4 --max-model-len 8192 \
5 --gpu-memory-utilization 0.9 \
6 --enforce-eageruv run vllm serve pearl-ai/Gemma-4-31B-it-pearl --host 0.0.0.0 --port 8000 --max-model-len 8192 --gpu-memory-utilization 0.9 --enforce-eager--language-model-only if you only need text — it disables the vision tower and uses less GPU memory.Gemma4ForConditionalGeneration (model_type: gemma4)