Views
No views yet
SimpleMCQModel)| Metric | Score |
|---|---|
| Validation Accuracy | 91.50% |
| MAP@3 Score | 0.9531 |
| Training Loss | 0.3854 |
| Epochs | 5 |
| Random Seed | 42 |
1from model1_hf.inference import MCQInferencePipeline
2
3pipeline = MCQInferencePipeline.load_from_dir("./model1_hf")
4result = pipeline.predict(
5 prompt="What is the capital of France?",
6 options=["London", "Paris", "Berlin", "Madrid", "Rome"]
7)
8
9print("Top Prediction:", result["top1_label"], "-", result["top1_option_text"])
10print("Top 3 Choices:", result["top3_str"])
11print("Confidence Scores:", result["confidence_scores"])