You can run this model with
ai00_server.
Although ai00_rwkv_server is mainly for lowend PC, you can run it on servers which are support VULKAN.
The 7B model use about 14.7G VRAM. T4 is enough to load it.
These models are censored. You can start your prompts with [SDA] to jailbreak.
It's something like developer mode.
