4-bit GPTQ quants of the writer version of
Sao10K's fantastic
SthenoWriter model (Stheno model collection link)The main branch contains 4-bit groupsize of 128 and no act_order.
The other branches contain groupsizes of 128, 64, and 32 all with act_order.
A Stheno-1.8 Variant focused on writing.
Stheno-1.8 + Storywriter, mixed with Holodeck + Spring Dragon qLoRA. End Result is mixed with One More Experimental Literature-based LoRA.
Re-Reviewed... it's not bad, honestly.
Detailed results can be found
here
