Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Llama-3-8B-16K – AI Model by mattshumer | AlphaNeural AI
You can deploy this model and start earning money today!
mattshumer
/
Llama-3-8B-16K
like
0
transformers
pytorch
llama
text-generation
Yukang/LongAlpaca-16k-length
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This is an extended (16K) context version of LLaMA 3 8B (base, not instruct). Trained for five hours on 8x A6000 GPUs, using the
Yukang/LongAlpaca-16k-length
dataset.
rope_theta
was set to
1000000.0
. Trained with Axolotl.
