Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Lazarus-30b-SuperHOT-8k-GPTQ – AI Model by MrDragonFox | AlphaNeural AI
You can deploy this model and start earning money today!
MrDragonFox
/
Lazarus-30b-SuperHOT-8k-GPTQ
like
0
transformers
pytorch
llama
text-generation
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
--max_seq_len 8192 --compress_pos_emb 4 --loader exllama_hf check monkeypatch in ooba ..
for 16384 compress_pos_emb 8
works on 2 a6000 just fine
