You can deploy this model and start earning money today!

keras/
rwkv7_g1a_0.3b

Name: rwkv7_g1a_0.3b
Availability: InStock

Views

No views yet

This is a RWKV7 model uploaded using the KerasHub library and can be used with JAX, TensorFlow, and PyTorch backends. Model config:

name: rwkv7_backbone
trainable: True
dtype: {'module': 'keras', 'class_name': 'DTypePolicy', 'config': {'name': 'float32'}, 'registered_name': None}
hidden_size: 1024
head_size: 64
gate_lora: 128
mv_lora: 32
aaa_lora: 64
decay_lora: 64
vocabulary_size: 65536
dropout_rate: 0
intermediate_dim: 4096
num_layers: 24

This model card has been generated automatically and should be completed by the model author. See Model Cards documentation for more information.

keras/rwkv7_g1a_0.3b