Views
No views yet
| Model | Win Rate | Avg Savings (€M) | Compliance Error |
|---|---|---|---|
| Baseline (Untrained) | 8.0% | €2.10M | 24.0% |
| GTOP-RL (Ours) | 34.0% | €15.10M | 2.0% |
unsloth library for 2x faster inference.1from unsloth import FastVisionModel
2
3# 1. Load Model
4model, tokenizer = FastVisionModel.from_pretrained(
5 "arghyachaks/GTOP-RL-Ministral-3B",
6 load_in_4bit=True,
7)
8FastVisionModel.for_inference(model)
9
10# 2. Run Inference
11messages = [
12 {"role": "user", "content": "Analyze the tax liability for a subsidiary in Ireland with €50M revenue..."}
13]
14inputs = tokenizer.apply_chat_template(messages, return_tensors="pt").to("cuda")
15outputs = model.generate(inputs, max_new_tokens=500)
16print(tokenizer.decode(outputs[0]))