# Pull the image (7.3GB compressed)
docker pull hellohal2064/vllm-dgx-spark-gb10:latest
# Run with your model
docker run --rm --gpus all \
-v /path/to/models:/models \
-p 8000:8000 \
-e MODEL_PATH=/models/your-model \
-e MAX_MODEL_LEN=131072 \
-e GPU_MEMORY_UTIL=0.90 \
hellohal2064/vllm-dgx-spark-gb10:latest
Option 2: HuggingFace Download
Download the pre-built image tarball from this repository:
# Download image tarball from this repo
wget https://huggingface.co/Hellohal2064/vllm-dgx-spark-gb10/resolve/main/docker/vllm-gb10-latest.tar.gz
# Load the image
gunzip -c vllm-gb10-latest.tar.gz | docker load
# Run with your model
docker run --rm --gpus all \
-v /path/to/models:/models \
-p 8000:8000 \
-e MODEL_PATH=/models/your-model \
-e MAX_MODEL_LEN=131072 \
-e GPU_MEMORY_UTIL=0.90 \
vllm-gb10:latest
Option 3: Build from Source
Clone this repository and build locally:
# Clone and build
git clone https://huggingface.co/Hellohal2064/vllm-dgx-spark-gb10
cd vllm-dgx-spark-gb10
docker build -t vllm-gb10:latest .
🔧 Environment Variables
Variable
Default
Description
MODEL_PATH
(required)
Path to model inside container
MAX_MODEL_LEN
32768
Maximum context window (see below)
GPU_MEMORY_UTIL
0.90
GPU memory utilization (0.0-1.0)
ATTENTION_BACKEND
TRITON_ATTN
Attention implementation
TENSOR_PARALLEL
1
Tensor parallelism degree
📏 Context Window Configuration
The MAX_MODEL_LEN environment variable controls the maximum context window size. The DGX Spark's 119GB unified memory allows for very large context windows:
