| Parameter | Value |
|---|---|
| Base Model | |
| Method | QLoRA (4-bit NF4, double quantization) |
| LoRA Config | r=16, alpha=32, dropout=0.05, target_linear=True |
| Hardware | NVIDIA A100-80GB (Modal) |
| Duration | ~40 minutes |
| Epochs | 3 |
| Dataset | 265 gold synthetic examples (FinOps, Terraform, AWS Cost, BYaML) |
| Sequence Length | 2048 tokens |
| Optimizer | paged_adamw_8bit, lr=2e-4, cosine schedule |
| Category | Count | Description |
|---|---|---|
| Terraform HCL | 100 | Audit + refactor (rightsizing, tags, encryption, lifecycle) |
| AWS Cost JSON | 80 | Anomaly detection, budget alerts, cost-by-service |
| BYaML Governance | 50 | Schema validation, policy checks, relationship verification |
| FinOps Q&A | 15 | Deep expert answers (frameworks, strategies, tooling) |
| Bash/Python Scripts | 20 | Real boto3 + bash for cloud automation |
