Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Mistral-LiPPA-LoRA-12B – AI Model by mpasila | AlphaNeural AI
You can deploy this model and start earning money today!
mpasila
/
Mistral-LiPPA-LoRA-12B
like
0
peft
safetensors
text-generation-inference
transformers
unsloth
mistral
trl
en
mpasila/LimaRP-PIPPA-Mix-8K-Context
grimulkan/LimaRP-augmented
KaraKaraWitch/PIPPA-ShareGPT-formatted
mistralai/Mistral-Nemo-Base-2407
adapter
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
LoRA trained in 4-bit with 8k context using
mistralai/Mistral-Nemo-Base-2407
as the base model for 1 epoch.
Dataset used is
mpasila/LimaRP-PIPPA-Mix-8K-Context
which was made using
grimulkan/LimaRP-augmented
and
KaraKaraWitch/PIPPA-ShareGPT-formatted
.
Merged LoRA:
mpasila/Mistral-LiPPA-12B
Prompt format: Llama 3 Instruct
Unsloth changed assistant to gpt and user to human.
Uploaded model
Developed by:
mpasila
License:
apache-2.0
Finetuned from model :
unsloth/mistral-nemo-base-2407-bnb-4bit
This mistral model was trained 2x faster with
Unsloth
and Huggingface's TRL library.
