This model is a fine-tuned version of
prajjwal1/bert-tiny
as part of our submission to
ReNeuIR 2024.
The model is based on the pre-trained
prajjwal1/bert-tiny. It is fine-tuned on a 1GB subset of data
extracted from msmarco's
Train Triples Small.
Tiny-bert-ranker is part of our investigation into the tradeoffs between efficiency and effectiveness in ranking models.
This approach does not involve BM25 score injection or distillation.
