Views
No views yet
| Model | Purpose | HuggingFace | GGUF |
|---|---|---|---|
| Auditor | Legal analysis, compliance review, document parsing | Diamond-Swarm-Auditor-7B | GGUF |
| Writer | Personal statements, nexus letters, buddy statements | Diamond-Swarm-Writer-7B | GGUF |
| Rater | VA rating calculations, bilateral factor, TDIU assessment | Diamond-Swarm-Rater-7B | GGUF |
1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model = AutoModelForCausalLM.from_pretrained("Vet-Rate-org/Diamond-Swarm-Auditor-7B")
4tokenizer = AutoTokenizer.from_pretrained("Vet-Rate-org/Diamond-Swarm-Auditor-7B")1# Download GGUF
2wget https://huggingface.co/Vet-Rate-org/Diamond-Swarm-Auditor-7B-GGUF/resolve/main/vetrate-auditor-7b-v2-Q4_K_M.gguf
3
4# Run server
5./llama-server -m vetrate-auditor-7b-v2-Q4_K_M.gguf -c 4096 -ngl 99 --port 80801# Create Modelfile
2FROM ./vetrate-auditor-7b-v2-Q4_K_M.gguf
3PARAMETER temperature 0.7
4SYSTEM You are a VA claims expert specializing in legal analysis.
5
6# Create model
7ollama create diamond-auditor -f Modelfile
8ollama run diamond-auditor