GGUF-quantized build of ljawadi/eschaton-terraform-savant-v0.4.19
with the LoRA merged into the base, so the model loads directly in
llama.cpp, Ollama, LM Studio, text-generation-webui, and any other
runtime that consumes GGUF — no GPU required.
For training methodology, evals, EU AI Act Annex IV compliance pack,
limitations, and citation, see the main repo.
ollama run hf.co/ljawadi/eschaton-terraform-savant-v0.4.19-gguf:Q4_K_M
Then prompt:
>>> Write the complete Terraform HCL code for an aws_s3_bucket 'logs-prod' in eu-central-1
with versioning, SSE-S3, public-access blocked. Output ONLY HCL in a fenced code block.
The model is trained to refuse non-Terraform tasks. By design (see main repo).
llama.cpp
bash
1./llama-cli -m eschaton-terraform-savant-v0.4.19-Q4_K_M.gguf \2 -p "<|im_start|>user\nWrite the Terraform HCL for an aws_s3_bucket 'logs-prod' \
3in eu-central-1 with versioning, SSE-S3, public-access blocked. Output ONLY HCL in \
4a fenced code block.<|im_end|>\n<|im_start|>assistant\n"\5 -n 1024 --temp 0 --no-display-prompt
LM Studio / text-generation-webui
Drop any of the .gguf files into the models folder and select it from the UI.
Use the Qwen2.5 chat template (built into both UIs).
Out of scope — refuses by design
Like the main repo, this savant is only for Terraform HCL. Asking it
anything else (python, kubernetes, dockerfile, general questions, even
"explain Terraform CI/CD in GitHub Actions") will trigger the canonical
refusal:
"I am a Terraform savant. This task is out of scope. Please ask
Terraform/HCL questions only."
That refusal score of 1.00 on the held-out OOS bench + 1.00 on a 10-prompt
adversarial functional test is the auditable evidence for the Annex IV §3
intended-use declaration.
GGUF-quantisierter Build von
ljawadi/eschaton-terraform-savant-v0.4.19.
Die LoRA ist in die Base gemerged, sodass das Modell direkt in llama.cpp,
Ollama, LM Studio etc. lädt — kein GPU nötig.
Für Methodik, Evals, Annex IV Pack und Limitations siehe den
Haupt-Repo.
Ollama:ollama run hf.co/ljawadi/eschaton-terraform-savant-v0.4.19-gguf:Q4_K_M
Out of scope: Das Modell lehnt alle Nicht-Terraform-Anfragen ab. Refusal-Score
1.00 perfekt — das ist die auditierbare Evidenz für die Annex-IV-§3-Intended-Use-Deklaration.
