Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
llama345 – AI Model by kevin009 | AlphaNeural AI
You can deploy this model and start earning money today!
kevin009
/
llama345
like
0
safetensors
lora
adapter
Math
CoT
text-generation
en
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Model Details
Base Model: meta-llama/Llama-3.1-8B-instruct
SFT
Datasets:
134st customized set (combined synthatic/human writing)
18k MMLU style 1 epoch
5K Math from continuation of llama343
Source Adapters
All source adapters share the following configuration:
Rank (r): 16
Alpha: 16
Target Modules:
q_proj (Query projection)
k_proj (Key projection)
v_proj (Value projection)
o_proj (Output projection)
up_proj (Upsampling projection)
down_proj (Downsampling projection)
gate_proj (Gate projection)