swap-uniba/

LLaMAntino-3-ANITA-8B-Inst-DPO-ITA_GGUF

"Built with Meta Llama 3".

Model Details

https://github.com/marcopoli/LLaMAntino-3-ANITA

• Full Model: LaMAntino-3-ANITA-8B-Inst-DPO-ITA
• LLaMA.cpp - F16 model
• LLaMA.cpp - Q8_0 model
• LLaMA.cpp - Q4_K_M model
• LLaMA.cpp - Q2_K model

Specifications

• Model developers:
  Ph.D. Marco Polignano - University of Bari Aldo Moro, Italy
  SWAP Research Group
  
• Variations: The model release has been supervised fine-tuning (SFT) using QLoRA 4bit, on instruction-based datasets. DPO approach over the mlabonne/orpo-dpo-mix-40k dataset is used to align with human preferences for helpfulness and safety.
• Input: Models input text only.
• Language: Multilingual 🏁 + Italian 🇮🇹
• Output: Models generate text and code only.
• Model Architecture: Llama 3 architecture.
• Context length: 8K, 8192.
• Library Used: LLaMA.cpp

Prompt Template

<|start_header_id|>system<|end_header_id|>

{ SYS Prompt }<|eot_id|><|start_header_id|>user<|end_header_id|>

{ USER Prompt }<|eot_id|><|start_header_id|>assistant<|end_header_id|>

{ ASSIST Prompt }<|eot_id|>

LLaMA.cpp

Citation instructions