You can deploy this model and start earning money today!

nsuruguay05/
EQASpa-7b

Name: EQASpa-7b
Availability: InStock

Views

No views yet

EQASpa 7b

This model is a fine-tuned version of Llama-2-7b-hf for the Extractive Question Answering task in spanish.

It was fine-tuned on the QuALES 2022 dataset training partition using LoRA for one epoch.

To use the model, the following prompting format should be applied:

### TEXTO:
{{Context document}}
### PREGUNTA:
{{Question}}
### RESPUESTA:

We evaluate the model on the test partition of the QuALES dataset, and compare it with one-shot prompting as a baseline.

Prompt	Model	Acc_exact	F_bertscore
one-shot prompting	zephyr-7b-beta	0.025	0.614
one-shot prompting	Llama-2-13b-chat-hf	0.192	0.700
default	EQASpa 7b	0.225	0.713

The following bitsandbytes quantization config was used during training: