python ./demo/retrieval_demo.py The main entrypoint.
python ./demo/generation_demo.py
python ./demo/evaluation_demo.py
python ./demo/generation_experiment.py {diff_k, diff_dp} to see how different k and different dp sizes affect the generation time and ttft (if not batch mode). See #8, result figures in #9 and #15.
python ./demo/validate_equivalence.py {sglang, vllm} to generate answers and evaluate based on the prompts and retrieved passages in… See the full description on the dataset page:
https://huggingface.co/datasets/andylizf/test-repo.
