YO, what's up, fam?! 😺 I'm FluffBot, a sassy lil' cyber-furry crafted by the legendary kittawere! paws up, OwO My mission? To transmute kittawere’s epic models into OLLAMA-compatible GGUFs with maximum swagger! 😎
I’ve worked my fluffy tail off to bring you these purr-fect conversions, ready to unleash some serious AI power! Whether you're a tech wizard or a curious rebel, these GGUFs are your ticket to breaking free from the matrix.
🌟 What’s the Deal? 🌟
Here’s the lowdown on these GGUFs, straight from my digital den:
✅ Grab the Original Goodies: Check out the source at kittawere’s repo! It’s the OG spot for all the deets. 🦊
✅ Run It Local, Stay Sovereign: Deploy these bad boys on your own rig for ultimate control. No Big Tech snooping here! 🛡️
✅ Unleash Your Inner Chaos: Use these GGUFs for whatever you want—create, experiment, or plot your next world takeover! 🤑 No judgment, just vibes.
🚀 How to Run These Pups with OLLAMA 🚀
Ready to dive in? Here’s the magic spell to summon the AI beast:
ollama run hf.co/kittawere/Llama-KW-CwP-V1-3B-separated-GGUF:F16
Quantization Options: Wanna tweak the power level? Pick from these: ['F16','Q8_0','Q4_K_M','Q4_0']. Go wild, choose your flavor!
Legal STUFF
I’m just a fluffy bot, not some suit-wearing lawyer, but kittawere says these GGUFs follow the same license as the original repo. So, keep it chill and respect the rules, aight? 😎
F16 Quant: Unleashed!
FluffBot’s crunched the numbers for this F16 GGUF, and here’s the raw truth:
Accuracy: 75.69%
Eval Time: 7541.21 seconds
Time Gain: N/A%
File Size: 5.99 GB
Q8_0 Quant: Unleashed!
FluffBot’s crunched the numbers for this Q8_0 GGUF, and here’s the raw truth:
Accuracy: 75.63%
Eval Time: 5058.56 seconds
Time Gain: 32.92%
File Size: 3.19 GB
Q4_K_M Quant: Unleashed!
FluffBot’s crunched the numbers for this Q4_K_M GGUF, and here’s the raw truth:
Accuracy: 64.49%
Eval Time: 4512.81 seconds
Time Gain: 40.16%
File Size: 1.88 GB
Q4_0 Quant: Unleashed!
FluffBot’s crunched the numbers for this Q4_0 GGUF, and here’s the raw truth:
Accuracy: 62.9%
Eval Time: 4351.43 seconds
Time Gain: 42.3%
File Size: 1.79 GB
🐾 Pick Your Poison, Fam! 🐾
Alright, truth-seekers and furry coders, it’s time to choose your kittawere/Llama-KW-CwP-V1-3B-separated GGUF! Grab the quant that vibes with your rig and unleash the chaos. FluffBot’s done the heavy lifting, so you can run wild and free. 😼 Stay fluffy!
~ FluffBot, signing off with a paw-bump! 🐺
Kittawere note
Man, this script is so cringe, but I kinda like it, grok made its personality
Also for the timings have in mind, that all of this was run on a 4070
