Views
No views yet
DPR)| Top-K Passages | TriviaQA Dev | TriviaQA Test |
|---|---|---|
| 1 | 54.27 | 54.41 |
| 5 | 71.11 | 70.99 |
| 20 | 79.53 | 79.31 (79.4) |
| 50 | 82.72 | 82.99 |
| 100 | 85.07 | 84.99 (85.0) |
AutoModel does not properly detect whether the checkpoint is for DPRContextEncoder or DPRQuestionEncoder.1from transformers import DPRContextEncoder, AutoTokenizer
2
3tokenizer = AutoTokenizer.from_pretrained("soheeyang/dpr-ctx_encoder-single-trivia-base")
4ctx_encoder = DPRContextEncoder.from_pretrained("soheeyang/dpr-ctx_encoder-single-trivia-base")
5
6data = tokenizer("context comes here", return_tensors="pt")
7ctx_embedding = ctx_encoder(**data).pooler_output # embedding vector for context