You are probably looking for the raven models found here :
https://huggingface.co/BlinkDL/rwkv-4-raven
This is a collection of converted CPP binaries, that maybe prequantized.
This is primarily used for the rwkv-cpp-node project here :
https://github.com/RWKV/RWKV-cpp-node