Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
neurotic-crown-clown-7b-tak-stack-dpo – AI Model by CorticalStack | AlphaNeural AI
You can deploy this model and start earning money today!
CorticalStack
/
neurotic-crown-clown-7b-tak-stack-dpo
like
0
transformers
safetensors
mistral
text-generation
dpo
conversational
CorticalStack/neurotic-crown-clown-7b-ties
finetune
apache-2.0
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Neurotic crown clown tak stack logo
neurotic-crown-clown-7b-tak-stack-dpo
neurotic-crown-clown-7b-tak-stack-dpo is a DPO fine-tuned version of
CorticalStack/neurotic-crown-clown-7b-ties
using the
CorticalStack/tak-stack-dpo
dataset.
LoRA
r: 32
LoRA alpha: 32
LoRA dropout: 0.05
Training arguments
Batch size: 4
Gradient accumulation steps: 4
Optimizer: paged_adamw_32bit
Max steps: 100
Learning rate: 5e-05
Learning rate scheduler type: cosine
Beta: 0.1
Max prompt length: 1024
Max length: 1536
