DeBERTa Large fine tuned on SNLI
Model
This checkpoint is based on microsoft/deberta-large.
It was fine tuned on the SNLI training split.
The model predicts one of three labels:
| Label | Meaning |
|---|
| 0 | entailment |
| 1 | neutral |
| 2 | contradiction |
The input order is premise first and hypothesis second.
Evaluation
Accuracy was measured on the official SNLI validation and test splits.
| Split | Accuracy | Examples |
|---|
| Validation | 93.59% | 9,842 |
| Test | 92.76% | 9,824 |
These values are plain classification accuracy.
Comparisons should use the same SNLI splits and the same label mapping.
The machine readable results are stored in baseline_eval.json.
Training
| Setting | Value |
|---|
| Base model | microsoft/deberta-large |
| Epochs | 2 |
| Batch size | 16 |
| Gradient accumulation steps | 4 |
| Learning rate | 0.000009788877958737822 |
| Weight decay | 0.1 |
| Warmup ratio | 0.15333747665030725 |
| Label smoothing | 0.0 |
| Adam beta 2 | 0.999 |
| Maximum sequence length | 128 |
| Seed | 1299843651 |
| Numerical precision | FP32 |
The hyperparameters were selected for this model and dataset combination.
The full training record is stored in model_card.json.
Use
Load the repository with AutoTokenizer and AutoModelForSequenceClassification from the Transformers library.
Pass the premise and hypothesis as a text pair.
Use a maximum sequence length of 128 to match training.
Files
| File | Purpose |
|---|
model.safetensors | Model weights |
config.json | Architecture and label mapping |
tokenizer.json | Tokenizer data |
tokenizer_config.json | Tokenizer settings |
baseline_eval.json | Evaluation results |
model_card.json | Training record and provenance |
README.md | Model card |
Limitations
The model was trained and evaluated on English SNLI data.
Performance on other NLI datasets may differ.
The model can inherit errors and biases from the base model and the training data.
The checkpoint has not been evaluated for high risk or safety critical use.
License
The base model microsoft/deberta-large is licensed under MIT.
The SNLI training data is licensed under CC BY-SA 4.0.
This checkpoint is released under CC BY-SA 4.0.
Users must follow the terms of the base model and the SNLI dataset.
Adapted material must be shared under CC BY-SA 4.0 or a compatible license.
Associated research
This model was trained as part of the following research manuscript:
“Opening the Black Box: Localizing semantic inconsistency in NLI models with Deep k -Nearest Neighbors”
The manuscript is in preparation. It has not been submitted or published.
This section will be updated when a public preprint or an accepted version becomes available.
Citation
Until the paper is public, please cite this model repository:
1@misc{mashiach2026debertasnli,
2 author = {Lidor Mashiach},
3 title = {DeBERTa Large fine tuned on SNLI},
4 year = {2026},
5 publisher = {Hugging Face},
6 url = {https://huggingface.co/Lidor-Mashiach/deberta-large-snli}
7}
Please also cite the DeBERTa and SNLI papers.
Contact
Questions, corrections, and reproducibility reports can be posted in the Community tab of this repository.
