ColPaliGemma-3B model is fine-tuned on a specific question and answering dataset from a book about Oil and Gas in Norwegian language. Fine tuning is done on Colab Pro's NVIDIA A100 GPU.
Intended uses & limitations
This model is suited for RAG uses in oil and gas domain, specifically if the query is in Norwegian
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
learning_rate: 5e-05
train_batch_size: 4
eval_batch_size: 4
seed: 42
gradient_accumulation_steps: 4
total_train_batch_size: 16
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
