Run pearld with RPC enabled.
Start the Pearl miner/vLLM stack.
Serve this model through vLLM while Pearl gateway/miner components handle mining-side integration.

How To Use (Pearl vLLM Plugin)

Follow the miner setup from the Pearl repo:

pearl/miner README

High-level prerequisites:

Python 3.12
uv
CUDA + NVIDIA GPU (sm90 class, e.g. H100/H200, per project docs)
Rust toolchain
Running pearld node with RPC credentials

Docker Example

From the Pearl repository root:

docker buildx build -t vllm_miner . -f miner/vllm-miner/Dockerfile

bash

docker run --rm -it --gpus all \
  -p 8000:8000 -p 8337:8337 -p 8339:8339 \
  -e PEARLD_RPC_URL=<PEARLD_URL> \
  -e PEARLD_RPC_USER=<RPC_USER> \
  -e PEARLD_RPC_PASSWORD=<RPC_PASSWORD> \
  -v ~/.cache/huggingface:/root/.cache/huggingface \
  --shm-size 8g \
  vllm_miner:latest \
  pearl-ai/Llama-3.1-8B-Instruct-pearl \
  --host 0.0.0.0 --port 8000 \
  --max-model-len 8192 \
  --gpu-memory-utilization 0.9 \
  --enforce-eager

License

This model is a derivative of Llama 3.1 and is distributed under the Llama 3.1 license terms.

Limitations

Can generate incorrect, unsafe, or biased outputs.
Requires careful deployment controls and output validation.
Hardware/software compatibility depends on the Pearl miner stack and supported GPU architectures.