Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Llama-3-8B-16K-GGUF – AI Model by LoneStriker | AlphaNeural AI
You can deploy this model and start earning money today!
LoneStriker
/
Llama-3-8B-16K-GGUF
like
0
Yukang/LongAlpaca-16k-length
endpoints_compatible
gguf
template
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This is an extended (16K) context version of LLaMA 3 8B (base, not instruct). Trained for five hours on 8x A6000 GPUs, using the
Yukang/LongAlpaca-16k-length
dataset.
rope_theta
was set to
1000000.0
. Trained with Axolotl.
