Views
No views yet
Coralfil/Atlantis-Pyramid-14B-Glyph — Coralfil's marine-science LLM, purpose-built for the ocean economy and serving as the intelligence layer behind the Atlantis assistant in Coralfil OS (os.coralfil.com).Atlantis-Pyramid-32B-AWQ; measured weights are ~14.7B parameters (Qwen2.5-14B dimensions: 48 layers, hidden 5120). The "32B" label was a lineage artifact — corrected across all repos for the Coralfil OS 2.0 launch. Old URLs redirect here permanently.--max-model-len 8192, API-key enforced (401 unauthenticated / 200 authenticated), engine --restart always.| Property | Value |
|---|---|
| Architecture | Qwen2ForCausalLM (48 layers, hidden 5120, vocab 152,064) |
| Measured parameters | ~14.7B (Qwen2.5-14B dimensions) |
| Source weights | Coralfil/Atlantis-Pyramid-14B-Glyph (bf16 merge, 29.5 GB) |
| Quantized size | 9.4 GB (2 safetensors shards + index) |
| Quantization | AWQ W4A16, GEMM, q_group_size 128, zero_point |
| Tokenizer | Qwen2.5 BPE (same as fine-tune — no tokenization drift) |
| Native context | 32,768 tokens (serve with --max-model-len per VRAM; 8,192 validated on A10-24GB) |
| Recommended runtime | vLLM ≥ 0.26 (--gpu-memory-utilization 0.92 on 24 GB) |
1docker run -d --gpus all --restart always -p 8080:8000 \
2 -v /models:/workspace/models \
3 vllm/vllm-openai:latest \
4 --model /workspace/models/Atlantis-Pyramid-14B-Glyph-AWQ \
5 --served-model-name atlantis-pyramid-14b-glyph-awq \
6 --max-model-len 8192 \
7 --gpu-memory-utilization 0.92 \
8 --api-key "$VLLM_API_KEY"1from openai import OpenAI
2client = OpenAI(base_url="http://localhost:8080/v1", api_key="<VLLM_API_KEY>")
3client.chat.completions.create(
4 model="atlantis-pyramid-14b-glyph-awq",
5 messages=[{"role": "user", "content": "Design a broodstock conditioning protocol for Crassostrea gigas under warming SSTs."}],
6)Deployment note: the current Coralfil production instance still answers to the legacy served idatlantis-pyramid-32b-awq; the id alias migrates toatlantis-pyramid-14b-glyph-awqwith the OS 2.0 backend cutover.
other — see Coralfil for commercial terms.