Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

Nous-Capybara-7B-V1.9-exl2 – AI Model by bartowski | AlphaNeural AI

You can deploy this model and start earning money today!

bartowski/
Nous-Capybara-7B-V1.9-exl2

like

0

LDJnr/LessWrong-Amplify-Instruct

LDJnr/Pure-Dove

LDJnr/Verified-Camel

Views

No views yet

Exllama v2 Quantizations of Nous-Capybara-7B-V1.9

Using turboderp's ExLlamaV2 v0.0.7 for quantization.

Each branches contains an individual bits per weight.

Conversion was done using wikitext.parquet as calibration dataset.

Original model: https://huggingface.co/NousResearch/Nous-Capybara-7B-V1.9

4.0 bits per weight

6.0 bits per weight

8.0 bits per weight

Download instructions

With git:

git clone --single-branch --branch 4.0 https://huggingface.co/bartowski/Nous-Capybara-7B-V1.9-exl2

With huggingface hub (credit to TheBloke for instructions):

pip3 install huggingface-hub

To download the main (only useful if you only care about measurement.json) branch to a folder called Nous-Capybara-7B-V1.9-exl2:

shell

mkdir Nous-Capybara-7B-V1.9-exl2
huggingface-cli download bartowski/Nous-Capybara-7B-V1.9-exl2 --local-dir Nous-Capybara-7B-V1.9-exl2 --local-dir-use-symlinks False

To download from a different branch, add the --revision parameter:

shell

mkdir Nous-Capybara-7B-V1.9-exl2
huggingface-cli download bartowski/Nous-Capybara-7B-V1.9-exl2 --revision 4.0 --local-dir Nous-Capybara-7B-V1.9-exl2 --local-dir-use-symlinks False