Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Manticore-13b-Landmark-GPTQ – AI Model by Honkware | AlphaNeural AI
You can deploy this model and start earning money today!
Honkware
/
Manticore-13b-Landmark-GPTQ
like
0
transformers
pytorch
llama
text-generation
custom_code
2305.16300
2210.17323
other
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Manticore-13b-Landmark-GPTQ
Key Features
Landmark Attention
Large Context Size (~18k)
4-Bit Quantization
Composition
Manticore-13b-Landmark-GPTQ is a 4-bit quantization of:
Manticore-13B-Landmark
Using
Oobabooga
Trust Remote Code -
(Enabled)
Add the bos_token to the beginning of prompts -
(Disabled)
Truncate the prompt up to this length -
(Increased)
Landmark Training Code
See
GitHub
for the training code.
