iboing/

CorDA_KPA_nqopen_finetuned_math

The LLaMA-2-7b model finetuned on the Math task using CorDA in the KPA mode with nqopen.

You can evaluate the model's performance following the step-3 in CorDA github repo.

Note: The model trained using CorDA adapter is based on customized code. If you want to restore the original LLaMA architecture, execute merge_adapter_for_corda.py in CorDA github repo.