This repository contains the DeeperImpact model trained on the MS-MARCO passage dataset expanded using a
fine-tuned Llama 2 model
with hard negatives, distillation, and pre-trained CoCondenser model initialization.
The code to train and run inferences using DeeperImpact can be found in the
DeeperImpact Repo.
Please refer to the following notebook to understand how to use the model:
inference_deeper_impact.ipynbFor running inference on a larger collection of documents, use the following command:
1python -m src.deep_impact.index \
2 --collection_path <expanded_collection.tsv> \
3 --output_file_path <path> \
4 --model_checkpoint_path soyuj/deeper-impact \
5 --num_processes <n> \
6 --process_batch_size <process_batch_size> \
7 --model_batch_size <model_batch_size>
It distributes the inference across multiple GPUs in the machine. To manually set the GPUs, use CUDA_VISIBLE_DEVICES environment variable.
