Views
No views yet
1from rankers import Cat
2import pyterrier as pt
3
4dataset = pt.get_dataset("irds:sara")
5
6# Index the corpus
7indexer = pt.IterDictIndexer('./indices/sara')
8indexer.index(dataset.get_corpus_iter())
9
10index_ref = pt.IndexRef.of('./indices/sara')
11bm25 = pt.BatchRetrieve(index_ref, wmodel='BM25')
12
13# Load the reranker
14reranker = Cat.from_pretrained("cost-sensitive-opt/sara_ce_ranknet_sans").to_pyterrier()
15
16# Retrieval pipeline
17pipeline = bm25 % 10 >> dataset.text_loader() >> reranker
18
19pipeline.search("Your query goes here!")
20| qid | docid | docno | score | query | text | rank |
21|------:|--------:|:-------------------|----------:|:----------------------|:------------------------|-------:|
22| 1 | 90929 | namely-clean-horse | -9.3688 | Your query goes here! | -----Original Messag... | 0 |
23| 1 | 1998 | badly-big-pigeon | -9.47719 | Your query goes here! | Geoff, Attached is y... | 1 |
24| 1 | 126384 | wholly-proud-bison | -9.6181 | Your query goes here! | All - We have saved ... | 2 |
25| 1 | 114876 | safely-quick-gecko | -9.77931 | Your query goes here! | Casey, I ran curve q... | 3 |
26| 1 | 43652 | firmly-well-dassie | -9.79426 | Your query goes here! | My impression is tha... | 4 |
27| 1 | 83963 | mainly-moving-ray | -9.81702 | Your query goes here! | -----Original Messag... | 5 |
28| 1 | 108431 | poorly-trusty-dove | -9.92241 | Your query goes here! | I got the queries to... | 6 |
29| 1 | 5496 | badly-star-bat | -10.1594 | Your query goes here! | <!DOCTYPE HTML PUBLI... | 7 |
30| 1 | 48895 | fully-pet-alpaca | -10.3165 | Your query goes here! | Anna, I just left yo... | 8 |
31| 1 | 72466 | lately-joint-fawn | -10.5109 | Your query goes here! | David, Here's the in... | 9 |