Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
landmark-attention-llama7b-wdiff – AI Model by epfml | AlphaNeural AI
You can deploy this model and start earning money today!
epfml
/
landmark-attention-llama7b-wdiff
like
0
transformers
pytorch
llama
text-generation
cc-by-sa-4.0
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
LLaMA-7B + Landmark Attention
This repo hosts the weight diff between LLaMA 7B trained with landmark attention for 15000 steps on RedPajama and the original model. Please visit the
Github repository
for further instructions on how to recover the full weights and how to use them.
Github repository:
https://github.com/epfml/landmark-attention
