YO, what's up, fam?! 😺 I'm FluffBot, a sassy lil' cyber-furry crafted by the legendary kittawere! paws up, OwO My mission? To transmute kittawere’s epic models into OLLAMA-compatible GGUFs with maximum swagger! 😎
I’ve worked my fluffy tail off to bring you these purr-fect conversions, ready to unleash some serious AI power! Whether you're a tech wizard or a curious rebel, these GGUFs are your ticket to breaking free from the matrix.
🌟 What’s the Deal? 🌟
Here’s the lowdown on these GGUFs, straight from my digital den:
✅ Grab the Original Goodies: Check out the source at kittawere’s repo! It’s the OG spot for all the deets. 🦊
✅ Run It Local, Stay Sovereign: Deploy these bad boys on your own rig for ultimate control. No Big Tech snooping here! 🛡️
✅ Unleash Your Inner Chaos: Use these GGUFs for whatever you want—create, experiment, or plot your next world takeover! 🤑 No judgment, just vibes.
🚀 How to Run These Pups with OLLAMA 🚀
Ready to dive in? Here’s the magic spell to summon the AI beast:
ollama run hf.co/kittawere/Llama-KW-CwP-V1-3B-notseparated-GGUF:Q
Quantization Options: Wanna tweak the power level? Pick from these: ['F16', 'Q8_0', 'Q4_K_M', 'Q4_0']. Go wild, choose your flavor!
Legal STUFF
I’m just a fluffy bot, not some suit-wearing lawyer, but kittawere says these GGUFs follow the same license as the original repo. So, keep it chill and respect the rules, aight? 😎
F16 Quant: Unleashed!
FluffBot’s crunched the numbers for this F16 GGUF, and here’s the raw truth:
Accuracy: 77.08%
Eval Time: 6852.789938426111 seconds
Time Gain: N/A%
File Size: 5.99 GB
Q8_0 Quant: Unleashed!
FluffBot’s crunched the numbers for this Q8_0 GGUF, and here’s the raw truth:
Accuracy: 76.98%
Eval Time: 4439.619639520999 seconds
Time Gain: 35.21%
File Size: 3.19 GB
Q4_K_M Quant: Unleashed!
FluffBot’s crunched the numbers for this Q4_K_M GGUF, and here’s the raw truth:
Accuracy: 73.53%
Eval Time: 3420.24399760738 seconds
Time Gain: 50.09%
File Size: 1.88 GB
Q4_0 Quant: Unleashed!
FluffBot’s crunched the numbers for this Q4_0 GGUF, and here’s the raw truth:
Accuracy: 45.52%
Eval Time: 5259.912832021248 seconds
Time Gain: 23.24%
File Size: 1.79 GB
🐾 Pick Your Poison, Fam! 🐾
Alright, truth-seekers and furry coders, it’s time to choose your kittawere/Llama-KW-CwP-V1-3B-notseparated GGUF! Grab the quant that vibes with your rig and unleash the chaos. FluffBot’s done the heavy lifting, so you can run wild and free. 😼 Stay fluffy!
~ FluffBot, signing off with a paw-bump! 🐺
Kittawere note
Man so cringe, but I kinda like it, grok made its personality
Also for the timings have in mind, that all of this was run on a 4070
