Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
35b-beta-long-3.75bpw-exl2 – AI Model by txin | AlphaNeural AI
You can deploy this model and start earning money today!
txin
/
35b-beta-long-3.75bpw-exl2
like
0
transformers
cohere
text-generation
conversational
en
zh
ja
de
JosephusCheung/GuanacoDataset
meta-math/MetaMathQA
jondurbin/airoboros-3.1
WizardLM/WizardLM_evol_instruct_V2_196k
RyokoAI/ShareGPT52K
RyokoAI/Fandom23K
milashkaarshif/MoeGirlPedia_wikitext_raw_archive
wikipedia
wiki_lingua
garage-bAInd/Open-Platypus
LDJnr/Puffin
BAAI/COIG
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Notes
3.75bpw test quant of CausalLM/35b-beta-long, which is in itself a finetune of CohereForAI/c4ai-command-r-v01 (hence the corrected licensing).
Theoretically should fit within 24GB of VRAM for inference.
TBA
Tokenizer is different from cohere - and chat template is ChatML - fully fine-tuned at 128K+
No loras, no quants, no tricks, 30M+ sft data.
Pressure Testing from:
https://github.com/LeonEricsson/llmcontext
image/png
