This is an MLX quant of of FlatOrcamaid, MLX is for use with Apple silicon.
The 4bpw fits seems to work well on my 16gig M1 MBP, 8bpw needs more ram.
SillyTavern config files:
Context,
Instruct.
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
Kooten on discord.
